#		Model	Score help_outline Percentage of hidden behavioral tests passed.	Cost help_outline Total API cost in USD for this task instance.	Calls help_outline Number of LLM API calls for this task instance.
1		GPT 5.5 (high) OpenAI	46.8%	$4.19	46
2		GPT 5.5 (xhigh) OpenAI	41.7%	$7.05	59
3		Claude Sonnet 4.6 Anthropic	33.9%	$19.38	343
4		GPT 5.5 OpenAI	28.8%	$1.01	13
5		Gemini 3.1 Pro Google	14.9%	$1.39	106
6		GPT 5.4 OpenAI	9.9%	$0.31	9
7		Claude Opus 4.6 Anthropic	5.2%	$6.02	218
8		Gemini 3 Flash Google	4.8%	$0.19	65
9		Claude Opus 4.7 (xhigh) Anthropic	2.8%	$2.95	62
10		GPT 5 mini OpenAI	2.4%	$0.02	6
11		GPT 5.4 mini OpenAI	2.2%	$0.04	7
12		Claude Opus 4.7 Anthropic	1.2%	$0.60	35
13		Claude Haiku 4.5 Anthropic	0.0%	$1.10	157

Click row to see model details