#		Model	Score help_outline Percentage of hidden behavioral tests passed.	Cost help_outline Total API cost in USD for this task instance.	Calls help_outline Number of LLM API calls for this task instance.
1		GPT 5.5 (xhigh) OpenAI	98.0%	$5.09	69
2		GPT 5.5 (high) OpenAI	96.4%	$3.62	52
3		Claude Opus 4.7 (xhigh) Anthropic	96.2%	$15.99	192
4		Claude Opus 4.6 Anthropic	93.9%	$13.55	325
5		Claude Opus 4.7 Anthropic	92.3%	$3.11	108
6		Claude Sonnet 4.6 Anthropic	88.0%	$22.96	627
7		Gemini 3.1 Pro Google	87.6%	$1.46	104
8		Gemini 3 Flash Google	84.4%	$0.29	140
9		GPT 5.5 OpenAI	84.3%	$0.99	17
10		Claude Haiku 4.5 Anthropic	78.0%	$0.58	144
11		GPT 5.4 OpenAI	60.8%	$0.30	14
12		GPT 5.4 mini OpenAI	37.8%	$0.03	9
13		GPT 5 mini OpenAI	1.2%	$0.02	13

Click row to see model details