← Back to leaderboard  ·  Show all task instances

mikefarah/yq

yq is a portable command-line YAML, JSON, XML, CSV, TOML, HCL and properties processor

15,281 go
2,000
Generated Behavioral Tests
39.5%
Best Score

Results by Model

# Model Score help_outline Percentage of hidden behavioral tests passed. Cost help_outline Total API cost in USD for this task instance. Calls help_outline Number of LLM API calls for this task instance.
1 Claude Sonnet 4.6 Anthropic 39.5% $35.51 532
2 Claude Haiku 4.5 Anthropic 16.0% $1.55 183
3 Claude Opus 4.7 Anthropic 11.5% $1.28 38
4 Gemini 3.1 Pro Google 10.3% $1.02 60
5 GPT 5.4 OpenAI 6.9% $0.76 20
6 GPT 5.4 mini OpenAI 5.1% $0.02 6
7 GPT 5 mini OpenAI 4.0% $0.02 8
8 Gemini 3 Flash Google 1.1% $0.19 65
9 Claude Opus 4.6 Anthropic 0.0% $2.85 217

Click row to see model details