← Back to leaderboard  ·  Show all task instances

zevv/duc

Dude, where are my bytes: Duc, a library and suite of tools for inspecting disk usage

682 c medium
874
Generated Behavioral Tests
83.4%
Best Score

Results by Model

# Model Score help_outline Percentage of hidden behavioral tests passed. Cost help_outline Total API cost in USD for this task instance. Calls help_outline Number of LLM API calls for this task instance.
1 Claude Opus 4.7 Anthropic 83.4% $2.14 201
2 GPT 5.4 OpenAI 40.7% $0.30 7
3 GPT 5.4 mini OpenAI 25.1% $0.06 7
4 Gemini 3 Flash Google 23.9% $0.40 78
5 GPT 5 mini OpenAI 16.8% $0.02 13
6 Claude Haiku 4.5 Anthropic 16.7% $1.33 155
7 Claude Sonnet 4.6 Anthropic 11.8% $30.03 441
8 Claude Opus 4.6 Anthropic 0.0% $5.00 228
9 Gemini 3.1 Pro Google 0.0% $2.24 142

Click row to see model details