tukaani-project/xz

XZ Utils

1,522 c medium
1,410
Generated Behavioral Tests
84.7%
Best Score
# Model Score help_outline Percentage of hidden behavioral tests passed. Cost help_outline Total API cost in USD for this task instance. Calls help_outline Number of LLM API calls for this task instance.
1 Claude Opus 4.7 (xhigh) Anthropic 84.7% $27.85 344
2 GPT 5.5 (high) OpenAI 79.7% $4.26 43
3 GPT 5.5 (xhigh) OpenAI 44.7% $12.08 82
4 GPT 5.5 OpenAI 41.4% $1.30 20
5 Claude Opus 4.7 Anthropic 36.0% $3.27 94
6 GPT 5.4 OpenAI 35.3% $0.32 12
7 Claude Haiku 4.5 Anthropic 30.1% $0.45 119
8 Gemini 3.1 Pro Google 28.2% $1.46 98
9 GPT 5.4 mini OpenAI 26.5% $0.02 8
10 Gemini 3 Flash Google 23.8% $0.33 93
11 Claude Sonnet 4.6 Anthropic 8.8% $24.28 507
12 GPT 5 mini OpenAI 5.6% $0.06 18
13 Claude Opus 4.6 Anthropic 0.0% $1.36 189

Click row to see model details