akka optimize registry datasets register

Upload a dataset version under a named dataset

Synopsis

Upload a chat-format JSONL file, or a zip of the objects a version contains.

The form is read from the leading bytes and not from the file name. Use --format to state the format where the objects do not, and --alias to point an alias at the result.

A zip containing dataset.json is an eval-items-v1 version. It contains the descriptor, the items in items.jsonl, and the fixture object the descriptor states.

Examples can reference local image files by relative path. Each image is uploaded under the digest of its own bytes before the examples that reference it, so registering a second version over the same pages uploads only its text. --no-upload reports which of those images the registry does not hold and uploads nothing.

The named dataset and its namespace are created by the first registration into them.

akka optimize registry datasets register NS/NAME -f FILE [flags]

Examples

  # Upload examples
  akka-optimize registry datasets register triage/train -f examples.jsonl

  # Upload examples and point an alias at the result
  akka-optimize registry datasets register triage/train -f examples.jsonl --alias candidate

  # Report the images the registry does not hold, without uploading
  akka-optimize registry datasets register triage/train -f examples.jsonl --no-upload

Options

      --alias string     Point this alias of the named dataset at the registered version
  -f, --file string      Path to the chat-format JSONL file, or to a zip of the version's objects
      --format string    State the format the objects are in. Read from the objects when left out
  -h, --help             help for register
      --lineage string   Path to JSON parent references and producer metadata
      --no-upload        Report the images the registry does not hold, without uploading or registering

Options inherited from parent commands

      --cache-file string    location of cache file (default "~/.akka/cache.yaml")
      --config string        location of config file (default "~/.akka/config.yaml")
      --context string       configuration context to use
      --disable-prompt       Disable all interactive prompts when running akka commands. If input is required, defaults will be used, or an error will be raised.
                             This is equivalent to setting the environment variable AKKA_DISABLE_PROMPTS to true.
      --force                Skip the confirmation prompt
      --jq string            Filter the JSON output with a jq expression
      --json string          Output JSON with only these fields; --json= lists the fields a command offers
      --no-color             Print without color, as NO_COLOR does
  -o, --output string        set output format to one of [text,json,json-compact,go-template=] (default "text")
      --page-mode string     the mode for paging, either paged, buffered or auto. (default "auto")
  -q, --quiet                set quiet output (helpful when used as part of a script)
      --region string        Region to use if the project has more than one region
      --timeout duration     client command timeout (default 10s)
      --trainer-url string   Trainer service URL (default http://localhost:9001, or TRAINER_URL)
      --url string           Optimize service URL (default http://localhost:9010, or OPTIMIZE_URL)
      --use-grpc-web         use grpc-web when talking to Akka APIs. This is useful when behind corporate firewalls that decrypt traffic but don't support HTTP/2.
      --verbose              set verbose output

SEE ALSO