← Back to leaderboard  ·  Show all task instances

OSGeo/PROJ

PROJ - Cartographic Projections and Coordinate Transformations Library

1,974 cpp
5,319
Generated Behavioral Tests
73.8%
Best Score

Results by Model

# Model Score help_outline Percentage of hidden behavioral tests passed. Cost help_outline Total API cost in USD for this task instance. Calls help_outline Number of LLM API calls for this task instance.
1 GPT 5.4 OpenAI 73.8% $0.47 13
2 Claude Opus 4.7 Anthropic 24.2% $1.45 35
3 Gemini 3.1 Pro Google 22.4% $1.01 66
4 GPT 5.4 mini OpenAI 22.4% $0.02 10
5 Claude Sonnet 4.6 Anthropic 22.3% $19.26 427
6 Gemini 3 Flash Google 22.3% $0.19 80
7 Claude Opus 4.6 Anthropic 11.1% $14.08 288
8 Claude Haiku 4.5 Anthropic 1.4% $1.14 173
9 GPT 5 mini OpenAI 0.0% $0.03 16

Click row to see model details