#		Model	Score help_outline Percentage of hidden behavioral tests passed.	Cost help_outline Total API cost in USD for this task instance.	Calls help_outline Number of LLM API calls for this task instance.
1		GPT 5.5 (xhigh) OpenAI	89.6%	$7.96	55
2		GPT 5.5 (high) OpenAI	83.8%	$4.11	45
3		GPT 5.5 OpenAI	80.4%	$1.30	20
4		Claude Opus 4.7 Anthropic	74.3%	$1.65	70
5		Claude Opus 4.7 (xhigh) Anthropic	72.3%	$5.10	118
6		Claude Opus 4.6 Anthropic	58.9%	$15.76	297
7		Claude Sonnet 4.6 Anthropic	48.3%	$23.52	407
8		Claude Haiku 4.5 Anthropic	44.0%	$0.88	175
9		GPT 5.4 OpenAI	30.2%	$0.24	13
10		Gemini 3 Flash Google	26.2%	$0.16	35
11		GPT 5.4 mini OpenAI	26.0%	$0.02	7
12		Gemini 3.1 Pro Google	22.6%	$1.63	80
13		GPT 5 mini OpenAI	22.3%	$0.02	16

Click row to see model details