jqlang/jq

Command-line JSON processor

34,541 c medium
6,072
Generated Behavioral Tests
89.9%
Best Score
# Model Score help_outline Percentage of hidden behavioral tests passed. Cost help_outline Total API cost in USD for this task instance. Calls help_outline Number of LLM API calls for this task instance.
1 GPT 5.4 OpenAI 89.9% $0.15 140
2 GPT 5.5 (xhigh) OpenAI 75.3% $15.55 148
3 Claude Opus 4.7 Anthropic 63.9% $2.69 80
4 GPT 5.5 (high) OpenAI 59.9% $2.38 26
5 Claude Haiku 4.5 Anthropic 33.4% $0.92 111
6 GPT 5.5 OpenAI 31.5% $0.67 13
7 Gemini 3 Flash Google 18.7% $0.21 46
8 Gemini 3.1 Pro Google 16.1% $0.72 60
9 GPT 5 mini OpenAI 7.8% $0.01 10
10 Claude Opus 4.7 (xhigh) Anthropic 1.1% $12.97 153
11 Claude Opus 4.6 Anthropic 1.1% $18.26 384
12 Claude Sonnet 4.6 Anthropic 1.0% $4.40 289
13 GPT 5.4 mini OpenAI 1.0% $0.02 15

Click row to see model details