A composable framework for reproducible evaluation of long-running agents.
- Deterministic scripts: compare candidate artifacts or environment states against reference materials, optionally returning structured checks.
- Agent-as-judge / LLM-as-judge: bind an independent judge profile in profiles.yaml to inspect artifacts across single or multiple steps.