dalance/amber

A code search / replace tool

941 rs medium
567
Generated Behavioral Tests
71.1%
Best Score
# Model Score help_outline Percentage of hidden behavioral tests passed. Cost help_outline Total API cost in USD for this task instance. Calls help_outline Number of LLM API calls for this task instance.
1 Claude Sonnet 4.6 Anthropic 71.1% $23.27 507
2 Claude Opus 4.6 Anthropic 68.6% $14.47 329
3 Claude Opus 4.7 Anthropic 67.9% $2.97 96
4 Gemini 3 Flash Google 64.3% $0.30 126
5 GPT 5.4 OpenAI 63.4% $4.75 1,000
6 Gemini 3.1 Pro Google 60.7% $0.93 91
7 Claude Haiku 4.5 Anthropic 47.6% $0.33 81
8 GPT 5 mini OpenAI 9.9% $0.01 8
9 GPT 5.4 mini OpenAI 2.1% $0.02 7

Click row to see model details