Cost and traffic commands

Feature set: Inference Contact our support for access.
This functionality evolves quickly, the behavior and APIs might change between releases without further notice.

These commands cover what an organization spends on inference. Every command on this page is a subcommand of akka optimize. See akka optimize for every command and flag. Most commands read the document from standard input when you pass -f -.

Spend

akka optimize spend reports what a period consumed, what it cost, and what one conversation cost. The alias spends is accepted.

Command Description

akka optimize spend get --from INSTANT --to INSTANT

What a period consumed and cost, divided as asked.

akka optimize spend compare --from INSTANT --to INSTANT --against-from INSTANT --against-to INSTANT

Two periods, and the difference between them.

akka optimize spend conversations list --from INSTANT --to INSTANT

The conversations of a period that cost the most.

akka optimize spend info

Which service is answering at this address.

Callers

akka optimize callers holds the callers that spend figures are attributed to. The alias caller is accepted.

Command Description

akka optimize callers erase VALUE --basis BASIS

Remove one caller and keep every figure it is behind. BASIS is declared when the request carried the x-optimize-caller header, or forwarded when a proxy reported the address.

akka optimize callers erase VALUE --basis BASIS --dry-run

Report what the erasure would reach without writing anything.

Incidents

akka optimize incidents is the incident feed, unioned from its sources. The alias incident is accepted.

Command Description

akka optimize incidents list

The incident feed: anomalies, blocked requests and scrub failures.

Pricing catalog

akka optimize pricing-catalog holds model prices as input and output rates per million tokens for each served name. A published version is never edited. The aliases pricing-catalogs, catalog, and catalogs are accepted.

Command Description

akka optimize pricing-catalog get

The version in force now, or at an instant.

akka optimize pricing-catalog apply -f FILE

Publish a catalog version, or check one.

akka optimize pricing-catalog versions list

Every published version, newest first.

Captures

akka optimize captures reads recorded interaction artifacts off a filesystem. The alias capture is accepted.

These commands serve debugging and diagnostics. They read artifacts from a directory on disk, which is where a capture written during local development or a support investigation lands.

Captures recorded in production are stored in a location the CLI cannot reach in this version. The commands below read a filesystem directory only.

Command Description

akka optimize captures list DIRECTORY

Every artifact in a directory, newest first.

akka optimize captures show ARTIFACT

One artifact, read forward.

The features described in this section are an add-on to Akka Automated Operations. They are not included in the base product.

For pricing rules, unpriced traffic, reporting completeness, and attribution, see Understanding inference costs. For how the gateway records traffic, see Capture and grading.