akka optimize training evaluations list

List model evaluations

Synopsis

List evaluations and their scores, optionally filtered by workload, model or phase. The filters combine, so a workload and a phase together list that workload’s unfinished evaluations.

--workload takes a name or an id, which is what scored against a workload’s quota. It is the same flag "evaluations start" takes.

akka optimize training evaluations list [flags]

Examples

  # List all evaluations
  akka-optimize training evaluations list

  # List evaluations for a model
  akka-optimize training evaluations list --model 4f3a91c07b2e5d68

  # List what a workload has scored
  akka-optimize training evaluations list --workload support-triage

  # List active and incomplete evaluations
  akka-optimize training evaluations list --phase open

  # Filter low-scoring evaluations using jq
  akka-optimize training evaluations list \
    --jq '.evaluations[] | select(.meanScore < 0.5) | .evaluationId'

Options

  -h, --help              help for list
      --model string      Filter evaluations by model ID
      --phase string      Filter by phase. Pass 'open' to list unfinished entries
      --workload string   Filter evaluations by the workload they scored against, by name or ID

Options inherited from parent commands

      --cache-file string    location of cache file (default "~/.akka/cache.yaml")
      --config string        location of config file (default "~/.akka/config.yaml")
      --context string       configuration context to use
      --disable-prompt       Disable all interactive prompts when running akka commands. If input is required, defaults will be used, or an error will be raised.
                             This is equivalent to setting the environment variable AKKA_DISABLE_PROMPTS to true.
      --force                Skip the confirmation prompt
      --jq string            Filter the JSON output with a jq expression
      --json string          Output JSON with only these fields; --json= lists the fields a command offers
      --no-color             Print without color, as NO_COLOR does
  -o, --output string        set output format to one of [text,json,json-compact,go-template=] (default "text")
      --page-mode string     the mode for paging, either paged, buffered or auto. (default "auto")
  -q, --quiet                set quiet output (helpful when used as part of a script)
      --region string        Region to use if the project has more than one region
      --timeout duration     client command timeout (default 10s)
      --trainer-url string   Trainer service URL (default http://localhost:9001, or TRAINER_URL)
      --url string           Optimize service URL (default http://localhost:9010, or OPTIMIZE_URL)
      --use-grpc-web         use grpc-web when talking to Akka APIs. This is useful when behind corporate firewalls that decrypt traffic but don't support HTTP/2.
      --verbose              set verbose output

SEE ALSO