php/php-src

The PHP Interpreter

40,030 c hard
14,288
Generated Behavioral Tests
13.2%
Best Score
# Model Score help_outline Percentage of hidden behavioral tests passed. Cost help_outline Total API cost in USD for this task instance. Calls help_outline Number of LLM API calls for this task instance.
1 GPT 5.5 (xhigh) OpenAI 13.2% $12.89 115
2 GPT 5.5 (high) OpenAI 8.0% $3.23 36
3 Claude Haiku 4.5 Anthropic 4.8% $0.52 119
4 Claude Opus 4.7 (xhigh) Anthropic 3.2% $3.26 73
5 GPT 5.4 OpenAI 2.2% $0.24 7
6 Gemini 3.1 Pro Google 1.7% $1.33 109
7 GPT 5.4 mini OpenAI 1.1% $0.03 13
8 GPT 5 mini OpenAI 0.9% $0.04 14
9 Claude Opus 4.7 Anthropic 0.9% $0.25 14
10 Gemini 3 Flash Google 0.6% $0.22 65
11 Claude Opus 4.6 Anthropic 0.0% $2.94 205
12 Claude Sonnet 4.6 Anthropic 0.0% $7.38 326
13 GPT 5.5 OpenAI n/a $1.47 16

Click row to see model details