← Back to leaderboard  ·  Show all task instances

rs/jplot

iTerm2 expvar/JSON monitoring tool

1,178 go easy
583
Generated Behavioral Tests
89.0%
Best Score

Results by Model

# Model Score help_outline Percentage of hidden behavioral tests passed. Cost help_outline Total API cost in USD for this task instance. Calls help_outline Number of LLM API calls for this task instance.
1 Claude Opus 4.6 Anthropic 89.0% $8.17 139
2 Claude Opus 4.7 Anthropic 82.5% $2.34 85
3 Claude Sonnet 4.6 Anthropic 47.7% $31.83 344
4 Gemini 3 Flash Google 45.1% $0.15 35
5 GPT 5.4 OpenAI 43.2% $0.12 11
6 Claude Haiku 4.5 Anthropic 41.9% $0.18 67
7 GPT 5.4 mini OpenAI 35.0% $0.02 10
8 Gemini 3.1 Pro Google 19.9% $1.63 67
9 GPT 5 mini OpenAI 16.3% $0.02 16

Click row to see model details