akka optimize training projects scores

Compare candidate model scores against baselines for a training project

Synopsis

Display score comparison tables for candidate models grouped by base model version.

Each table lists the baseline model score alongside columns for each training configuration. Cells show scores for runs evaluated under the configured dataset and grader of the training project.

Use --dataset and --grader to inspect scores recorded under previous evaluation configurations.

akka optimize training projects scores PROJECT [flags]

Examples

  # Compare scores using default evaluation settings
  akka optimize training projects scores commit-router

  # Compare scores using specific evaluation settings
  akka optimize training projects scores commit-router \
    --dataset 4b1c2f9b2ae4 --grader json-label-match

Options

      --dataset string   Evaluation dataset to display scores for, by registry reference
      --grader string    Grader specification to display scores for
  -h, --help             help for scores

Options inherited from parent commands

      --cache-file string    location of cache file (default "~/.akka/cache.yaml")
      --config string        location of config file (default "~/.akka/config.yaml")
      --context string       configuration context to use
      --disable-prompt       Disable all interactive prompts when running akka commands. If input is required, defaults will be used, or an error will be raised.
                             This is equivalent to setting the environment variable AKKA_DISABLE_PROMPTS to true.
      --force                Skip the confirmation prompt
      --jq string            Filter the JSON output with a jq expression
      --json string          Output JSON with only these fields; --json= lists the fields a command offers
      --no-color             Print without color, as NO_COLOR does
  -o, --output string        set output format to one of [text,json,json-compact,go-template=] (default "text")
      --page-mode string     the mode for paging, either paged, buffered or auto. (default "auto")
  -q, --quiet                set quiet output (helpful when used as part of a script)
      --region string        Region to use if the project has more than one region
      --timeout duration     client command timeout (default 10s)
      --trainer-url string   Trainer service URL (default TRAINER_URL, then AKKA_OPTIMIZE_URL, then http://localhost:9001)
      --url string           Optimize service URL (default OPTIMIZE_URL, then AKKA_OPTIMIZE_URL, then http://localhost:9010)
      --use-grpc-web         use grpc-web when talking to Akka APIs. This is useful when behind corporate firewalls that decrypt traffic but don't support HTTP/2.
      --verbose              set verbose output

SEE ALSO