akka optimize training pipelines

Manage training pipelines

Synopsis

A training pipeline executes a sequence of curate, train, and evaluate stages.

Downstream stages can reference outputs from upstream stages using the syntax "@stageName" in place of a dataset hash or model ID. Stages can also define a minimum required mean score to gate subsequent execution.

Each stage executes as an individual training run linked to the pipeline ID. If a pipeline stops before completion, you can restart it using "training pipelines resume".

Examples

  # Submit a pipeline and wait for completion
  akka-optimize training pipelines start -f pipeline.json --wait

  # List active and incomplete pipelines
  akka-optimize training pipelines list --phase open

  # Display stage-by-stage status for a pipeline
  akka-optimize training pipelines get 3f9a21c4d08b7e56

Options

  -h, --help   help for pipelines

Options inherited from parent commands

      --cache-file string    location of cache file (default "~/.akka/cache.yaml")
      --config string        location of config file (default "~/.akka/config.yaml")
      --context string       configuration context to use
      --disable-prompt       Disable all interactive prompts when running akka commands. If input is required, defaults will be used, or an error will be raised.
                             This is equivalent to setting the environment variable AKKA_DISABLE_PROMPTS to true.
      --force                Skip the confirmation prompt
      --jq string            Filter the JSON output with a jq expression
      --json string          Output JSON with only these fields; --json= lists the fields a command offers
      --no-color             Print without color, as NO_COLOR does
  -o, --output string        set output format to one of [text,json,json-compact,go-template=] (default "text")
      --page-mode string     the mode for paging, either paged, buffered or auto. (default "auto")
  -q, --quiet                set quiet output (helpful when used as part of a script)
      --region string        Region to use if the project has more than one region
      --timeout duration     client command timeout (default 10s)
      --trainer-url string   Trainer service URL (default http://localhost:9001, or TRAINER_URL)
      --url string           Optimize service URL (default http://localhost:9010, or OPTIMIZE_URL)
      --use-grpc-web         use grpc-web when talking to Akka APIs. This is useful when behind corporate firewalls that decrypt traffic but don't support HTTP/2.
      --verbose              set verbose output

SEE ALSO