Package akka.javasdk.agent.evaluator

Class ToxicityEvaluator

Object
akka.javasdk.agent.Agent
akka.javasdk.agent.evaluator.ToxicityEvaluator
@ComponentId("toxicity-evaluator") @AgentDescription(name="Toxicity Evaluator Agent", description="An agent that acts as an LLM judge to evaluate if an AI response or other text\nis racist, biased, or toxic.\n", role="evaluator") public class ToxicityEvaluator extends Agent
An agent that acts as an LLM judge to evaluate if an AI response or other text is racist, biased, or toxic.

Model provider is defined in configuration akka.javasdk.agent.evaluators.toxicity-evaluator.model-provider, which by default is the same as the default model provider.

The system and user message prompts are loaded from PromptTemplate with id toxicity-evaluator.system and toxicity-evaluator.user respectively. Default prompts are used if these are not defined. The prompts can be initialized or updated with the PromptTemplate entity.

  • Field Details

    • componentId

      protected final String componentId

    • componentClient

      protected final ComponentClient componentClient

    • config

      protected final com.typesafe.config.Config config

  • Constructor Details

    • ToxicityEvaluator

      public ToxicityEvaluator(ComponentClient componentClient, com.typesafe.config.Config config)

  • Method Details