sheepla/pingu

🐧ping command but with pingu

2,087 go easy
383
Generated Behavioral Tests
98.7%
Best Score
# Model Score help_outline Percentage of hidden behavioral tests passed. Cost help_outline Total API cost in USD for this task instance. Calls help_outline Number of LLM API calls for this task instance.
1 Claude Opus 4.7 (xhigh) Anthropic 98.7% $5.81 109
2 Claude Opus 4.7 Anthropic 96.6% $3.36 104
3 GPT 5.5 (xhigh) OpenAI 96.3% $4.39 45
4 GPT 5.5 (high) OpenAI 96.1% $2.73 35
5 Claude Opus 4.6 Anthropic 94.0% $6.93 165
6 Claude Sonnet 4.6 Anthropic 92.2% $3.78 175
7 GPT 5.5 OpenAI 88.0% $0.93 19
8 Claude Haiku 4.5 Anthropic 74.2% $0.48 87
9 GPT 5 mini OpenAI 66.3% $0.02 18
10 GPT 5.4 OpenAI 62.1% $0.22 10
11 Gemini 3 Flash Google 59.3% $0.30 59
12 GPT 5.4 mini OpenAI 18.3% $0.01 9
13 Gemini 3.1 Pro Google 0.0% $1.11 48

Click row to see model details