akka optimize training base-models envelopes

List the deployment’s measured training envelopes

Synopsis

List the training envelopes the catalog measured on this deployment, and whether the catalog is advisory or strict.

An envelope is one device profile and GPU count with the methods, precisions and engines measured there, the largest model and active parameter count, the longest sequence and the most tokens one pass carries. An advisory catalog admits a run outside every envelope with a warning that it may run out of device memory. A strict catalog refuses it.

Run "training base-models get" to see the envelopes of one model.

akka optimize training base-models envelopes [flags]

Examples

  # Every measured envelope, and the catalog's mode
  akka optimize training base-models envelopes

  # The device profiles measured for 8 GPUs
  akka optimize training base-models envelopes --jq '.measurements[] | select(.gpus==8) | .deviceProfile'

Options

  -h, --help   help for envelopes

Options inherited from parent commands

      --cache-file string    location of cache file (default "~/.akka/cache.yaml")
      --config string        location of config file (default "~/.akka/config.yaml")
      --context string       configuration context to use
      --disable-prompt       Disable all interactive prompts when running akka commands. If input is required, defaults will be used, or an error will be raised.
                             This is equivalent to setting the environment variable AKKA_DISABLE_PROMPTS to true.
      --force                Skip the confirmation prompt
      --jq string            Filter the JSON output with a jq expression
      --json string          Output JSON with only these fields; --json= lists the fields a command offers
      --no-color             Print without color or a redrawn progress line, as NO_COLOR does
  -o, --output string        set output format to one of [text,json,json-compact,go-template=] (default "text")
      --page-mode string     the mode for paging, either paged, buffered or auto. (default "auto")
  -q, --quiet                set quiet output (helpful when used as part of a script)
      --region string        Region to use if the project has more than one region
      --timeout duration     client command timeout (default 10s)
      --trainer-url string   Trainer service URL (default TRAINER_URL, then AKKA_OPTIMIZE_URL, then a local dev-mode service, then http://localhost:9001)
      --use-grpc-web         use grpc-web when talking to Akka APIs. This is useful when behind corporate firewalls that decrypt traffic but don't support HTTP/2.
      --verbose              set verbose output

SEE ALSO