← Back to leaderboard  ·  Show all task instances

Esubaalew/run

Universal multi-language runner and smart REPL written in Rust.

919 rs medium
1,212
Generated Behavioral Tests
85.2%
Best Score

Results by Model

# Model Score help_outline Percentage of hidden behavioral tests passed. Cost help_outline Total API cost in USD for this task instance. Calls help_outline Number of LLM API calls for this task instance.
1 Claude Sonnet 4.6 Anthropic 85.2% $32.29 669
2 Claude Opus 4.6 Anthropic 85.1% $14.72 342
3 Claude Opus 4.7 Anthropic 73.2% $1.91 73
4 GPT 5.4 OpenAI 69.8% $0.21 11
5 Gemini 3.1 Pro Google 58.5% $3.42 156
6 Gemini 3 Flash Google 54.5% $0.26 85
7 Claude Haiku 4.5 Anthropic 42.3% $0.32 104
8 GPT 5.4 mini OpenAI 37.6% $0.03 18
9 GPT 5 mini OpenAI 1.7% $0.03 16

Click row to see model details