#		Model	Score help_outline Percentage of hidden behavioral tests passed.	Cost help_outline Total API cost in USD for this task instance.	Calls help_outline Number of LLM API calls for this task instance.
1		Claude Opus 4.7 (xhigh) Anthropic	86.5%	$10.01	138
2		Claude Opus 4.6 Anthropic	84.0%	$10.30	218
3		GPT 5.5 (xhigh) OpenAI	83.6%	$7.83	74
4		GPT 5.5 (high) OpenAI	82.9%	$4.43	50
5		GPT 5.5 OpenAI	77.6%	$1.24	16
6		GPT 5.4 OpenAI	76.9%	$0.22	8
7		Claude Opus 4.7 Anthropic	69.4%	$5.70	123
8		Claude Sonnet 4.6 Anthropic	64.4%	$12.01	192
9		Gemini 3.1 Pro Google	63.0%	$2.35	90
10		Gemini 3 Flash Google	58.4%	$0.28	45
11		GPT 5.4 mini OpenAI	39.9%	$0.02	6
12		GPT 5 mini OpenAI	21.7%	$0.01	10
13		Claude Haiku 4.5 Anthropic	5.3%	$0.88	139

Click row to see model details