konradsz/igrep

Interactive Grep

827 rs medium
385
Generated Behavioral Tests
86.2%
Best Score
# Model Score help_outline Percentage of hidden behavioral tests passed. Cost help_outline Total API cost in USD for this task instance. Calls help_outline Number of LLM API calls for this task instance.
1 GPT 5.5 (xhigh) OpenAI 86.2% $4.92 51
2 GPT 5.5 (high) OpenAI 75.8% $2.19 32
3 Claude Opus 4.7 (xhigh) Anthropic 75.6% $8.64 125
4 GPT 5.5 OpenAI 74.0% $1.02 20
5 Claude Opus 4.7 Anthropic 73.5% $1.38 54
6 Gemini 3.1 Pro Google 61.8% $0.74 53
7 Claude Sonnet 4.6 Anthropic 60.5% $10.26 279
8 Gemini 3 Flash Google 56.9% $0.21 49
9 Claude Haiku 4.5 Anthropic 53.5% $0.43 76
10 GPT 5 mini OpenAI 51.7% $0.04 12
11 GPT 5.4 mini OpenAI 39.2% $0.03 12
12 GPT 5.4 OpenAI 8.8% $0.21 14
13 Claude Opus 4.6 Anthropic 0.0% $1.32 185

Click row to see model details