← Back to detailed results

Claude Opus 4.7 (xhigh)

Anthropic · mini-SWE-agent · Rank #3

0%
Resolved help_outline Percentage of instances fully solved as measured by hidden behavioral tests.
4.5%
Almost Resolved help_outline Instances where the agent's solution passes ≥ 95% of all hidden behavioral tests.
$2191
Total Cost help_outline Total API cost in USD across all task instances.
31,877
Total Calls help_outline Total number of LLM calls across all task instances.

Score (Behavioral Test Pass Rate) Distribution

Per-Instance Results

200 instances
# Repository Lang Score Cost Calls
1 sheepla/pingu ๐Ÿงping command but with pingu go 98.7% $5.81 109
2 wfxr/csview ๐Ÿ“  Pretty and fast csv viewer for cli with cjk/emoji support. rs 98.2% $11.47 167
3 jarun/nnn nยณ The unorthodox terminal file manager c 97.9% $1.88 70
4 simeg/eureka ๐Ÿ’ก CLI tool to input and store your ideas without leaving the terminal rs 97.4% $19.76 260
5 sitkevij/hex ๐Ÿ”ฎ Futuristic take on hexdump, made in Rust. rs 97.3% $6.72 121
6 BLAKE3-team/BLAKE3 the official Rust and C implementations of the BLAKE3 cryptographic hash function rs 96.8% $6.88 119
7 abishekvashok/cmatrix Terminal based "The Matrix" like implementation c 96.3% $10.74 178
8 mgdm/htmlq Like jq, but for HTML. rs 96.2% $15.99 192
9 chmln/sd Intuitive find & replace CLI (sed alternative) rs 95.2% $13.81 211
10 sstadick/hck A sharp cut(1) clone. rs 94.4% $11.23 119
11 Miserlou/Loop UNIX's missing `loop` command rs 94.4% $10.93 196
12 rust-ethereum/ethabi Encode and decode smart contract invocations rs 93.3% $14.23 225
13 clog-tool/clog-cli Generate beautiful changelogs from your Git commit history rs 93.2% $18.38 333
14 ekzhang/bore ๐Ÿ•ณ bore is a simple CLI tool for making tunnels to localhost rs 93.1% $13.90 184
15 jrnxf/thokr โœจ sleek typing tui with visualized results and historical logging rs 93.0% $18.61 257
16 pier-cli/pier A CLI to organize and run short Unix shell scripts rs 92.9% $9.65 182
17 rs/curlie The power of curl, the ease of use of httpie. go 92.7% $18.14 157
18 altdesktop/i3-style ๐ŸŽจ Make your i3 config a little more stylish. rs 92.2% $18.42 206
19 madler/pigz A parallel implementation of gzip for modern multi-processor, multi-core machines. c 92.2% $8.06 152
20 wfxr/code-minimap ๐Ÿ›ฐ A high performance code minimap render. rs 91.7% $9.90 139
21 tarka/xcp An extended `cp` rs 91.5% $13.71 263
22 Byron/dua-cli View disk space usage and delete unwanted data, fast. rs 90.8% $10.03 161
23 ogham/dog A command-line DNS client. rs 90.5% $15.42 222
24 astro/deadnix Scan Nix files for dead code rs 90.0% $19.53 167
25 sharkdp/pastel A command-line tool to generate, analyze, convert and manipulate colors rs 89.7% $30.49 286
26 ismaelgv/rnr A command-line tool to batch rename files and directories rs 89.6% $50.30 594
27 hooklift/gowsdl WSDL2Go code generation as well as its SOAP proxy go 89.5% $21.55 224
28 sharkdp/hexyl A command-line hex viewer rs 89.3% $23.56 256
29 tomnomnom/gron Make JSON greppable! go 88.8% $14.90 217
30 riquito/tuc When cut doesn't cut it rs 88.6% $15.11 188
31 Esubaalew/run Universal multi-language runner and smart REPL written in Rust. rs 88.0% $19.96 282
32 mookid/diffr Yet another diff highlighting tool rs 87.8% $27.18 193
33 zevv/duc Dude, where are my bytes: Duc, a library and suite of tools for inspecting disk usage c 87.6% $21.07 218
34 yoav-lavi/melody Melody is a language that compiles to regular expressions and aims to be more readable and maintainable rs 87.4% $17.22 215
35 kyoh86/richgo Enrich `go test` outputs with text decorations. go 87.4% $16.10 232
36 ajeetdsouza/zoxide A smarter cd command. Supports all major shells. rs 87.2% $32.86 378
37 mibk/dupl a tool for code clone detection go 87.1% $10.07 123
38 nachoparker/dutree a tool to analyze file system usage written in Rust rs 87.1% $19.52 133
39 psampaz/go-mod-outdated Find outdated dependencies of your Go projects. go-mod-outdated provides a table view of the go list -u -m -json all command which lists all dependencies of a Go project and their available minor and patch updates. It also provides a way to filter indirect dependencies and dependencies without updates. go 87.0% $3.05 96
40 xorg62/tty-clock Clock using lib ncurses c 86.5% $10.01 138
41 BurntSushi/xsv A fast CSV command line toolkit written in Rust. rs 85.8% $24.54 350
42 raviqqe/muffet Fast website link checker in Go go 85.7% $2.53 70
43 chmln/handlr A better xdg-utils rs 85.5% $14.90 287
44 rbakbashev/elfcat ELF visualizer. Generates HTML files from ELF binaries. rs 85.1% $19.73 243
45 tukaani-project/xz XZ Utils c 84.7% $27.85 344
46 nikolassv/bartib A simple timetracker for the command line. It saves a log of all tracked activities as a plaintext file and allows you to create flexible reports. rs 84.6% $17.84 250
47 jonas/tig Text-mode interface for git c 83.8% $1.57 65
48 KSXGitHub/parallel-disk-usage Highly parallelized, blazing fast directory tree analyzer rs 83.4% $13.81 153
49 rs/jplot iTerm2 expvar/JSON monitoring tool go 83.4% $4.86 95
50 anordal/shellharden The corrective bash syntax highlighter rs 82.8% $11.64 179
51 rhysd/kiro-editor A small terminal UTF-8 text editor written in Rust ๐Ÿ“๐Ÿฆ€ rs 82.2% $2.60 89
52 pemistahl/grex A command-line tool and Rust library with Python bindings for generating regular expressions from user-provided test cases rs 82.1% $31.59 231
53 bootandy/dust A more intuitive version of du in rust rs 81.3% $42.44 255
54 JohannesKaufmann/html-to-markdown โš™๏ธ Convert HTML to Markdown. Even works with entire websites and can be extended through rules. go 81.1% $10.37 209
55 lz4/lz4 Extremely Fast Compression algorithm c 80.6% $4.56 100
56 mfridman/tparse CLI tool for summarizing go test output. Pipe friendly. CI/CD friendly. go 80.2% $15.52 168
57 agourlay/zip-password-finder Find the password of protected ZIP files. rs 79.4% $6.96 143
58 shashwatah/jot โšกRapid note management for the terminal. rs 79.4% $27.97 362
59 segmentio/chamber CLI for managing secrets go 79.3% $7.80 140
60 sibprogrammer/xq Command-line XML and HTML beautifier and content extractor go 79.0% $12.57 214
61 git-bahn/git-graph Command line tool to show clear git graphs arranged for your branching model rs 78.9% $4.01 117
62 sclevine/yj CLI - Convert between YAML, TOML, JSON, and HCL. Preserves map order. go 78.7% $16.06 196
63 ggreer/the_silver_searcher A code-searching tool similar to ack, but faster. c 78.3% $6.00 113
64 sirwart/ripsecrets A command-line tool to prevent committing secret keys into your source code rs 77.4% $15.13 210
65 svenstaro/miniserve ๐ŸŒŸ For when you really just want to serve some files over HTTP right now! rs 77.3% $2.94 68
66 orf/gping Ping, but with a graph rs 77.3% $5.92 120
67 junegunn/fzf :cherry_blossom: A command-line fuzzy finder go 77.2% $1.80 53
68 cmatsuoka/figlet Claudio's FIGlet tree c 76.7% $82.10 502
69 TheZoraiz/ascii-image-converter A cross-platform command-line tool to convert images into ascii art and print them on the console. Now supports braille art! go 76.6% $27.07 238
70 Lymphatus/caesium-clt Caesium Command Line Tools - Lossy/lossless image compression tool rs 76.5% $9.10 164
71 kyoheiu/felix tui file manager with vim-like key mapping rs 76.5% $1.68 52
72 sharkdp/fd A simple, fast and user-friendly alternative to 'find' rs 76.4% $8.46 143
73 blacknon/hwatch A modern alternative to the watch command, records the differences in execution results and can check this differences at after. rs 76.3% $10.58 210
74 Drew-Alleman/DataSurgeon Quickly Extracts IP's, Email Addresses, Hashes, Files, Credit Cards, Social Security Numbers and a lot More From Text rs 76.1% $17.05 263
75 konradsz/igrep Interactive Grep rs 75.6% $8.64 125
76 dalance/amber A code search / replace tool rs 74.3% $16.71 329
77 bensadeh/tailspin ๐ŸŒ€ A log file highlighter rs 74.0% $26.95 265
78 wintermute-cell/ngrrram A TUI tool to help you type faster and learn new layouts. Includes a free cat. rs 73.6% $31.63 326
79 lh3/seqtk Toolkit for processing sequences in FASTA/Q formats c 73.4% $9.95 147
80 antonmedv/walk Terminal file manager go 72.3% $5.10 118
81 peco/peco Simplistic interactive filtering tool go 72.3% $9.13 157
82 nuta/nsh A command-line shell like fish, but POSIX compatible. rs 71.3% $5.86 116
83 incu6us/goimports-reviser Right imports sorting & code formatting tool (goimports alternative) go 71.2% $14.92 266
84 AmmarAbouZor/tui-journal Your journal app if you live in a terminal rs 71.0% $4.95 115
85 astaxie/bat Go implement CLI, cURL-like tool for humans go 70.9% $13.25 132
86 Isona/dirble Fast directory scanning and scraping tool rs 70.8% $6.03 98
87 noborus/ov ๐ŸŽ‘Feature-rich terminal-based text viewer. It is a so-called terminal pager. go 69.5% $4.49 136
88 guumaster/hostctl Your dev tool to manage /etc/hosts like a pro! go 69.5% $15.28 176
89 multiprocessio/dsq Commandline tool for running SQL queries against JSON, CSV, Excel, Parquet, and more. go 68.5% $6.13 105
90 ninja-build/ninja a small build system with a focus on speed cpp 68.3% $14.14 212
91 elkowar/pipr A tool to interactively write shell pipelines. rs 67.0% $12.21 249
92 kisielk/errcheck errcheck checks that you checked errors. go 66.0% $29.50 395
93 o2sh/onefetch Command-line Git information tool rs 66.0% $3.68 108
94 alexpovel/srgn A grep-like tool which understands source code syntax and allows for manipulation in addition to search rs 65.9% $6.38 118
95 cordx56/rustowl Visualize Ownership and Lifetimes in Rust rs 65.7% $4.86 122
96 trasta298/keifu Git genealogy, untangled. A TUI for navigating commit graphs with color and clarity. rs 65.3% $3.33 79
97 WGUNDERWOOD/tex-fmt An extremely fast LaTeX formatter written in Rust rs 65.1% $10.97 186
98 mkj/dropbear Dropbear SSH c 65.0% $3.00 72
99 yassinebridi/serpl A simple terminal UI for search and replace, ala VS Code. rs 65.0% $2.51 79
100 kaushiksrini/parqeye Peek inside Parquet files right from your terminal rs 64.1% $4.31 112
101 naggie/dstask Git powered terminal-based todo/note manager -- markdown note page per task. Single binary! go 64.0% $11.13 177
102 quinn-rs/quinn Async-friendly QUIC implementation in Rust rs 63.4% $5.00 117
103 dundee/gdu Fast disk usage analyzer with console interface written in Go go 63.2% $5.45 96
104 XAMPPRocky/tokei Count your code, quickly. rs 62.6% $11.82 171
105 BurntSushi/ripgrep ripgrep recursively searches directories for a regex pattern while respecting your gitignore rs 62.5% $6.75 168
106 hatoo/oha Ohayou(ใŠใฏใ‚ˆใ†), HTTP load generator, inspired by rakyll/hey with tui animation. rs 61.8% $4.10 75
107 facebook/zstd Zstandard - Fast real-time compression algorithm c 61.6% $9.84 142
108 Canop/broot A new way to see and navigate directory trees : https://dystroy.org/broot rs 59.0% $6.43 140
109 sayanarijit/xplr A hackable, minimal, fast TUI file explorer rs 58.8% $2.74 65
110 LuaJIT/LuaJIT Mirror of the LuaJIT git repository c 58.4% $8.01 142
111 rust-embedded/svd2rust Generate Rust register maps (`struct`s) from SVD files rs 58.0% $1.81 50
112 hairyhenderson/gomplate A flexible commandline tool for template rendering. Supports lots of local and remote datasources. go 57.6% $6.97 133
113 Canop/rhit A nginx log explorer rs 57.5% $1.65 34
114 skeema/skeema Declarative pure-SQL schema management for MySQL and MariaDB go 56.7% $12.76 161
115 ecumene/rust-sloth A 3D software rasterizer... for the terminal! rs 56.3% $16.22 187
116 Y2Z/monolith โฌ›๏ธ CLI tool and library for saving complete web pages as a single HTML file rs 56.2% $6.26 113
117 ariga/atlas Declarative schema migrations with schema-as-code workflows go 55.4% $11.04 163
118 cweill/gotests Automatically generate Go test boilerplate from your source code. go 52.6% $15.81 190
119 rcoh/angle-grinder Slice and dice logs on the command line rs 50.4% $11.18 211
120 unhappychoice/gittype A CLI code-typing game that turns your source code into typing challenges rs 50.3% $4.73 133
121 svenstaro/genact ๐ŸŒ€ A nonsense activity generator rs 48.7% $3.83 71
122 Stranger6667/jsonschema A high-performance JSON Schema validator for Rust rs 48.7% $2.43 56
123 foriequal0/git-trim Automatically trims your branches whose tracking remote refs are merged or stray rs 48.5% $4.29 114
124 pls-rs/pls pls is a prettier and powerful ls(1) for the pros. rs 47.3% $7.41 155
125 antonmedv/fx Terminal JSON viewer & processor go 47.0% $7.48 135
126 parcel-bundler/lightningcss An extremely fast CSS parser, transformer, bundler, and minifier written in Rust. rs 46.5% $4.45 107
127 mgechev/revive ๐Ÿ”ฅ ~6x faster, stricter, configurable, extensible, and beautiful drop-in replacement for golint go 46.4% $2.67 70
128 sharkdp/bat A cat(1) clone with wings. rs 43.9% $4.75 110
129 eradman/entr Run arbitrary commands when files change c 42.8% $33.60 454
130 oppiliappan/statix lints and suggestions for the nix programming language rs 40.7% $6.92 142
131 jesseduffield/lazygit simple terminal UI for git commands go 39.2% $8.39 168
132 paradigmxyz/solar Blazingly fast, modular and contributor friendly Solidity compiler, written in Rust rs 39.1% $5.84 105
133 gabotechs/dep-tree Tool for helping developers keep their code bases clean and decoupled. It allows visualising a code base complexity using a 3d force-directed graph of files and the dependencies between them. go 38.8% $7.40 120
134 ducaale/xh Friendly and fast tool for sending HTTP requests rs 38.6% $3.96 82
135 axodotdev/oranda ๐ŸŽ generate beautiful landing pages for your developer tools rs 38.6% $9.62 153
136 robertdavidgraham/masscan TCP port scanner, spews SYN packets asynchronously, scanning entire Internet in under 5 minutes. c 38.3% $4.48 109
137 tree-sitter/tree-sitter An incremental parsing system for programming tools rs 37.3% $10.81 197
138 hush-shell/hush Hush is a unix shell based on the Lua programming language rs 37.2% $2.15 57
139 boyter/scc Sloc, Cloc and Code: scc is a very fast accurate code counter with complexity calculations and COCOMO estimates written in pure Go go 36.4% $20.65 267
140 rvben/rumdl Fast Markdown linter and formatter written in Rust rs 34.1% $3.78 98
141 lfos/calcurse A text-based calendar and scheduling application c 33.9% $3.30 84
142 direnv/direnv unclutter your .profile go 33.5% $7.67 169
143 ivanceras/svgbob Convert your ascii diagram scribbles into happy little SVG rs 31.6% $4.11 95
144 rust-lang/mdBook Create book from markdown files. Like Gitbook but implemented in Rust rs 31.2% $5.72 155
145 bellard/quickjs Public repository of the QuickJS Javascript Engine. c 31.0% $31.65 261
146 crowdagger/crowbook Converts books written in Markdown to HTML, LaTeX/PDF and EPUB rs 29.4% $13.25 195
147 dandavison/delta A syntax-highlighting pager for git, diff, grep, rg --json, and blame output rs 28.1% $1.19 48
148 sigoden/argc A Bash CLI framework, also a Bash command runner. rs 28.0% $6.90 121
149 go-critic/go-critic The most opinionated Go source code linter for code audit. go 27.8% $4.79 122
150 facebookresearch/fastText Library for fast text representation and classification. cpp 26.9% $2.35 60
151 tomarrell/wrapcheck A Go linter to check that errors from external packages are wrapped go 25.8% $10.56 164
152 stacked-git/stgit Stacked Git rs 25.1% $10.31 162
153 rochacbruno/marmite Markdown makes sites - A Static Site Generator for Blogs rs 24.6% $1.26 42
154 johnkerl/miller Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON go 24.1% $8.12 127
155 stathissideris/ditaa ditaa is a small command-line utility that can convert diagrams drawn using ascii art ('drawings' that contain characters that resemble lines like | / - ), into proper bitmap graphics. java 24.0% $5.13 110
156 doxygen/doxygen Official doxygen git repository c 21.7% $5.38 138
157 eliukblau/pixterm Draw images in your ANSI terminal with true color go 20.7% $30.03 224
158 cslarsen/jp2a Converts jpg images to ASCII c 19.2% $15.72 169
159 HaliteChallenge/Halite @twosigma's first artificial intelligence programming challenge cpp 18.9% $3.13 72
160 hpjansson/chafa ๐Ÿ“บ๐Ÿ—ฟ Terminal graphics for the 21st century. c 18.7% $7.73 146
161 mikefarah/yq yq is a portable command-line YAML, JSON, XML, CSV, TOML, HCL and properties processor go 16.5% $5.49 92
162 Nukesor/pueue :stars: Manage your shell commands. rs 16.1% $7.48 127
163 zk-org/zk Plain text note-taking assistant go 16.1% $9.09 113
164 typst/typst A markup-based typesetting system that is powerful and easy to learn. rs 14.4% $5.44 125
165 cheat/cheat cheat allows you to create and view interactive cheatsheets on the command-line. It was designed to help remind *nix system administrators of options for commands that they use frequently, but not frequently enough to remember. go 14.1% $16.68 242
166 jgm/pandoc Universal markup converter hs 10.7% $2.53 83
167 OSGeo/gdal GDAL is an open source MIT licensed translator library for raster and vector geospatial data formats. cpp 10.0% $8.27 154
168 NikolaDucak/caps-log A small TUI journaling tool. ๐Ÿ“– cpp 10.0% $4.96 84
169 htop-dev/htop htop - an interactive process viewer c 9.8% $3.13 104
170 ast-grep/ast-grep โšกA CLI tool for code structural search, lint and rewriting. Written in Rust rs 9.5% $5.83 123
171 ArthurSonzogni/json-tui A JSON terminal UI made in C++ cpp 9.4% $4.62 116
172 alecthomas/chroma A general purpose syntax highlighter in pure Go go 8.7% $5.07 126
173 universal-ctags/ctags A maintained ctags implementation c 8.2% $14.35 173
174 chirlu/sox SoX, Swiss Army knife of sound processing c 8.1% $7.08 125
175 codesnap-rs/codesnap ๐Ÿฆ€๏ธ๐Ÿ“ธ Pure Rust tool to generate beautiful code snapshots, provide CLI and Library rs 7.5% $4.86 120
176 duckdb/duckdb DuckDB is an analytical in-process SQL database management system cpp 4.1% $0.70 32
177 samtools/samtools Tools (written in C using htslib) for manipulating next-generation sequencing data c 3.9% $1.81 56
178 danmar/cppcheck static analysis of C/C++ code cpp 3.8% $1.94 71
179 eudoxia0/hashcards A plain text-based spaced repetition system. rs 3.7% $11.74 179
180 tinycc/tinycc Unofficial mirror of mob development branch c 3.7% $0.75 22
181 noborus/trdsql CLI tool that can execute SQL queries on CSV, LTSV, JSON, YAML and TBLN. Can output to various formats. go 3.4% $8.71 175
182 php/php-src The PHP Interpreter c 3.2% $3.26 73
183 OSGeo/PROJ PROJ - Cartographic Projections and Coordinate Transformations Library cpp 3.0% $2.37 79
184 yaa110/nomino Batch rename utility for developers rs 2.9% $16.99 247
185 ip7z/7zip 7-Zip cpp 2.8% $2.95 62
186 FFmpeg/FFmpeg Mirror of https://git.ffmpeg.org/ffmpeg.git c 2.4% $1.50 32
187 lua/lua A copy of the Lua development repository, as seen by the Lua team. Mirrored irregularly. All communication should be through the Lua mailing list https://www.lua.org/lua-l.html c 2.2% $18.58 197
188 arq5x/bedtools2 bedtools - the swiss army knife for genome arithmetic c 2.1% $2.85 88
189 Epistates/treemd A (TUI/CLI) markdown navigator with tree-based structural navigation. rs 1.5% $5.66 147
190 jhspetersson/fselect Find files with SQL-like queries rs 1.4% $7.60 126
191 YS-L/flamelens Flamegraph viewer in the terminal rs 1.3% $5.90 135
192 brocode/fblog Small command-line JSON Log viewer rs 1.3% $6.80 125
193 jqlang/jq Command-line JSON processor c 1.1% $12.97 153
194 gromacs/gromacs Public/backup repository of the GROMACS molecular simulation toolkit. Please do not mine the metadata blindly; we use https://gitlab.com/gromacs/gromacs for code review and issue tracking. cpp 1.1% $7.41 151
195 sqlite/sqlite Official Git mirror of the SQLite source tree c 0.7% $2.48 68
196 oppiliappan/eva a calculator REPL, similar to bc(1) rs 0.5% $22.33 294
197 tstack/lnav Log file navigator cpp 0.5% $3.91 115
198 google/brotli Brotli compression format c 0.5% $6.32 94
199 FiloSottile/age A simple, modern and secure encryption tool (and Go library) with small explicit keys, no config options, and UNIX-style composability. go 0.0% $4.35 65
200 sharkdp/hyperfine A command-line benchmarking tool rs n/a $13.94 180

Click row to see task details