#		Model	Score help_outline Percentage of hidden behavioral tests passed.	Cost help_outline Total API cost in USD for this task instance.	Calls help_outline Number of LLM API calls for this task instance.
1		Claude Opus 4.7 (xhigh) Anthropic	74.3%	$16.71	329
2		GPT 5.5 OpenAI	72.6%	$0.78	20
3		Claude Sonnet 4.6 Anthropic	71.1%	$23.27	507
4		Claude Opus 4.6 Anthropic	68.6%	$14.47	329
5		Claude Opus 4.7 Anthropic	67.9%	$2.97	96
6		Gemini 3 Flash Google	64.3%	$0.30	126
7		GPT 5.4 OpenAI	63.4%	$4.75	1,000
8		Gemini 3.1 Pro Google	60.7%	$0.93	91
9		Claude Haiku 4.5 Anthropic	47.4%	$0.33	81
10		GPT 5.5 (xhigh) OpenAI	23.2%	$4.70	77
11		GPT 5.5 (high) OpenAI	22.3%	$2.07	44
12		GPT 5 mini OpenAI	12.4%	$0.01	8
13		GPT 5.4 mini OpenAI	3.4%	$0.02	7

Click row to see model details