yaa110/nomino
Batch rename utility for developers
Results by Model
| # | Model | Score Percentage of hidden behavioral tests passed. | Cost Total API cost in USD for this task instance. | Calls Number of LLM API calls for this task instance. | |
|---|---|---|---|---|---|
| 1 | GPT 5.5 (xhigh) OpenAI | 94.2% | $5.15 | 70 | |
| 2 | GPT 5.5 (high) OpenAI | 85.0% | $2.16 | 35 | |
| 3 | GPT 5.5 OpenAI | 83.4% | $1.30 | 27 | |
| 4 | Claude Sonnet 4.6 Anthropic | 79.9% | $19.28 | 518 | |
| 5 | Claude Opus 4.7 Anthropic | 79.6% | $4.21 | 119 | |
| 6 | Claude Opus 4.6 Anthropic | 72.2% | $10.11 | 270 | |
| 7 | Gemini 3 Flash Google | 61.0% | $0.29 | 142 | |
| 8 | Gemini 3.1 Pro Google | 53.7% | $1.54 | 170 | |
| 9 | GPT 5.4 OpenAI | 51.4% | $0.30 | 15 | |
| 10 | Claude Haiku 4.5 Anthropic | 26.5% | $0.66 | 114 | |
| 11 | GPT 5 mini OpenAI | 15.0% | $0.02 | 11 | |
| 12 | GPT 5.4 mini OpenAI | 5.8% | $0.05 | 16 | |
| 13 | Claude Opus 4.7 (xhigh) Anthropic | 2.9% | $16.99 | 247 |
Click row to see model details