← Back to leaderboard  ·  Show all task instances

lz4/lz4

Extremely Fast Compression algorithm

11,781 c medium
1,496
Generated Behavioral Tests
82.7%
Best Score

Results by Model

# Model Score help_outline Percentage of hidden behavioral tests passed. Cost help_outline Total API cost in USD for this task instance. Calls help_outline Number of LLM API calls for this task instance.
1 Claude Sonnet 4.6 Anthropic 82.7% $25.44 501
2 Claude Opus 4.7 Anthropic 80.0% $5.56 155
3 Claude Opus 4.6 Anthropic 78.7% $9.86 216
4 GPT 5.4 OpenAI 46.6% $0.24 10
5 Gemini 3.1 Pro Google 36.4% $0.84 57
6 Claude Haiku 4.5 Anthropic 22.1% $0.84 97
7 GPT 5 mini OpenAI 14.4% $0.01 9
8 GPT 5.4 mini OpenAI 9.6% $0.04 10
9 Gemini 3 Flash Google 5.2% $0.20 46

Click row to see model details