akka optimize eval experiments record

The finished record: the run’s report, or the numbers behind it

Synopsis

The service composes the report, and this prints it as it was written. It is one document: what the run found, what failed and what each evaluator said, which items answered differently between runs, how the judge scored, what the run cannot tell you, and what it cost.

--summary prints the measurements instead — the rates, what went unsettled, and the per-group breakdown worst first. A run that recorded no report shows the same thing.

Every number here is the service’s. Nothing is recomputed from the parts, because two pass rates that disagree by rounding are worse than one.

akka optimize eval experiments record ID [flags]

Examples

  akka-optimize eval experiments record exp-ed745d2f
  akka-optimize eval experiments record exp-ed745d2f --summary
  akka-optimize eval experiments record exp-ed745d2f --jq .metrics.overall.rate

Options

  -h, --help      help for record
      --summary   print what the run measured instead of the report it wrote

Options inherited from parent commands

      --cache-file string    location of cache file (default "~/.akka/cache.yaml")
      --config string        location of config file (default "~/.akka/config.yaml")
      --context string       configuration context to use
      --disable-prompt       Disable all interactive prompts when running akka commands. If input is required, defaults will be used, or an error will be raised.
                             This is equivalent to setting the environment variable AKKA_DISABLE_PROMPTS to true.
      --force                Skip the confirmation prompt
      --jq string            Filter the JSON output with a jq expression
      --json string          Output JSON with only these fields; --json= lists the fields a command offers
      --no-color             Print without color, as NO_COLOR does
  -o, --output string        set output format to one of [text,json,json-compact,go-template=] (default "text")
      --page-mode string     the mode for paging, either paged, buffered or auto. (default "auto")
  -q, --quiet                set quiet output (helpful when used as part of a script)
      --region string        Region to use if the project has more than one region
      --timeout duration     client command timeout (default 10s)
      --trainer-url string   Trainer service URL (default http://localhost:9001, or TRAINER_URL)
      --url string           Optimize service URL (default http://localhost:9010, or OPTIMIZE_URL)
      --use-grpc-web         use grpc-web when talking to Akka APIs. This is useful when behind corporate firewalls that decrypt traffic but don't support HTTP/2.
      --verbose              set verbose output

SEE ALSO