Skip to main content

​
Overview

The geval check command evaluates contracts against eval results and enforces decisions.

​
Usage

geval check --contract <path> --eval <paths...> [options]

​
Options

OptionDescription
-c, --contract <path>Path to eval contract (YAML/JSON) (required)
-e, --eval <paths...>Path(s) to eval result files (CSV/JSON/JSONL) (required)
-b, --baseline <path>Path to baseline eval results for comparison
--adapter <name>Force specific adapter (promptfoo, langsmith, openevals, generic)
--jsonOutput results as JSON
--no-colorDisable colored output
--verboseShow detailed output

​
Examples

​
Basic check

geval check -c contract.yaml -e results.csv

​
Multiple eval files

geval check -c contract.yaml -e results1.json results2.json

​
With baseline comparison

geval check -c contract.yaml -e results.csv -b baseline.json

​
JSON output for CI

geval check -c contract.yaml -e results.csv --json

​
Exit Codes

  • 0 - PASS (safe to merge/deploy)
  • 1 - BLOCK (do not merge/deploy)
  • 2 - REQUIRES_APPROVAL (needs human review)
  • 3 - ERROR (something went wrong)