ip7z/7zip

7-Zip

2,967 cpp
1,043
Generated Behavioral Tests
33.9%
Best Score
# Model Score help_outline Percentage of hidden behavioral tests passed. Cost help_outline Total API cost in USD for this task instance. Calls help_outline Number of LLM API calls for this task instance.
1 Claude Sonnet 4.6 Anthropic 33.9% $19.38 343
2 Gemini 3.1 Pro Google 14.9% $1.39 106
3 GPT 5.4 OpenAI 9.9% $0.31 9
4 Claude Opus 4.6 Anthropic 5.2% $6.02 218
5 Gemini 3 Flash Google 4.8% $0.19 65
6 GPT 5 mini OpenAI 2.4% $0.02 6
7 GPT 5.4 mini OpenAI 2.2% $0.04 7
8 Claude Opus 4.7 Anthropic 1.2% $0.60 35
9 Claude Haiku 4.5 Anthropic 0.0% $1.10 157

Click row to see model details