sharkdp/bat

A cat(1) clone with wings.

58,487 rs
799
Generated Behavioral Tests
61.5%
Best Score
# Model Score help_outline Percentage of hidden behavioral tests passed. Cost help_outline Total API cost in USD for this task instance. Calls help_outline Number of LLM API calls for this task instance.
1 GPT 5.5 (xhigh) OpenAI 61.5% $7.87 82
2 Claude Sonnet 4.6 Anthropic 60.5% $21.25 514
3 GPT 5.5 (high) OpenAI 49.6% $5.73 54
4 Claude Opus 4.7 (xhigh) Anthropic 43.9% $4.75 110
5 GPT 5.5 OpenAI 40.6% $1.25 18
6 Gemini 3.1 Pro Google 33.2% $1.72 109
7 Gemini 3 Flash Google 33.2% $0.24 83
8 Claude Opus 4.7 Anthropic 31.9% $1.16 48
9 Claude Haiku 4.5 Anthropic 28.0% $0.62 129
10 GPT 5 mini OpenAI 28.0% $0.02 11
11 GPT 5.4 OpenAI 13.4% $0.26 9
12 GPT 5.4 mini OpenAI 3.1% $0.03 8
13 Claude Opus 4.6 Anthropic 0.0% $2.85 253

Click row to see model details