← Back to leaderboard  ·  Show all task instances

simeg/eureka

💡 CLI tool to input and store your ideas without leaving the terminal

867 rs medium
344
Generated Behavioral Tests
78.8%
Best Score

Results by Model

# Model Score help_outline Percentage of hidden behavioral tests passed. Cost help_outline Total API cost in USD for this task instance. Calls help_outline Number of LLM API calls for this task instance.
1 Claude Opus 4.6 Anthropic 78.8% $5.67 195
2 Claude Opus 4.7 Anthropic 66.6% $2.50 104
3 Claude Sonnet 4.6 Anthropic 42.7% $10.77 364
4 Gemini 3.1 Pro Google 40.7% $1.77 100
5 GPT 5.4 OpenAI 34.9% $0.41 15
6 Gemini 3 Flash Google 30.5% $0.21 66
7 GPT 5.4 mini OpenAI 26.5% $0.05 11
8 Claude Haiku 4.5 Anthropic 22.1% $0.58 118
9 GPT 5 mini OpenAI 16.3% $0.04 16

Click row to see model details