← Back to detailed results

Claude Opus 4.6

Anthropic · mini-SWE-agent · Rank #5

0%
Resolved help_outline Percentage of instances fully solved as measured by hidden behavioral tests.
2.5%
Almost Resolved help_outline Instances where the agent's solution passes ≥ 95% of all hidden behavioral tests.
$2275
Total Cost help_outline Total API cost in USD across all task instances.
51,962
Total Calls help_outline Total number of LLM calls across all task instances.

Score (Behavioral Test Pass Rate) Distribution

Per-Instance Results

200 instances
# Repository Lang Score Cost Calls
1 psampaz/go-mod-outdated Find outdated dependencies of your Go projects. go-mod-outdated provides a table view of the go list -u -m -json all command which lists all dependencies of a Go project and their available minor and patch updates. It also provides a way to filter indirect dependencies and dependencies without updates. go 98.2% $1.18 85
2 jarun/nnn n³ The unorthodox terminal file manager c 98.1% $14.07 334
3 agourlay/zip-password-finder Find the password of protected ZIP files. rs 97.9% $3.51 129
4 abishekvashok/cmatrix Terminal based "The Matrix" like implementation c 97.0% $5.99 139
5 wfxr/csview 📠 Pretty and fast csv viewer for cli with cjk/emoji support. rs 96.1% $8.20 249
6 BLAKE3-team/BLAKE3 the official Rust and C implementations of the BLAKE3 cryptographic hash function rs 94.9% $5.68 171
7 Miserlou/Loop UNIX's missing `loop` command rs 94.6% $8.74 301
8 sstadick/hck A sharp cut(1) clone. rs 94.6% $11.60 302
9 sheepla/pingu 🐧ping command but with pingu go 94.0% $6.93 165
10 mgdm/htmlq Like jq, but for HTML. rs 93.9% $13.55 325
11 rhysd/kiro-editor A small terminal UTF-8 text editor written in Rust 📝🦀 rs 93.3% $15.07 329
12 rbakbashev/elfcat ELF visualizer. Generates HTML files from ELF binaries. rs 92.9% $15.79 251
13 tarka/xcp An extended `cp` rs 92.6% $5.01 138
14 Lymphatus/caesium-clt Caesium Command Line Tools - Lossy/lossless image compression tool rs 92.3% $11.47 294
15 riquito/tuc When cut doesn't cut it rs 90.5% $16.11 317
16 chmln/sd Intuitive find & replace CLI (sed alternative) rs 89.9% $7.07 270
17 nachoparker/dutree a tool to analyze file system usage written in Rust rs 89.5% $13.09 243
18 rs/curlie The power of curl, the ease of use of httpie. go 89.3% $12.49 243
19 rs/jplot iTerm2 expvar/JSON monitoring tool go 89.0% $8.17 139
20 oppiliappan/eva a calculator REPL, similar to bc(1) rs 88.6% $15.05 400
21 tomnomnom/gron Make JSON greppable! go 87.9% $15.33 358
22 noborus/ov 🎑Feature-rich terminal-based text viewer. It is a so-called terminal pager. go 87.6% $12.67 313
23 clog-tool/clog-cli Generate beautiful changelogs from your Git commit history rs 87.5% $17.81 357
24 Byron/dua-cli View disk space usage and delete unwanted data, fast. rs 86.9% $10.56 277
25 KSXGitHub/parallel-disk-usage Highly parallelized, blazing fast directory tree analyzer rs 86.1% $18.23 273
26 brocode/fblog Small command-line JSON Log viewer rs 86.0% $12.29 304
27 wfxr/code-minimap 🛰 A high performance code minimap render. rs 85.6% $9.41 236
28 htop-dev/htop htop - an interactive process viewer c 85.1% $14.15 238
29 Esubaalew/run Universal multi-language runner and smart REPL written in Rust. rs 85.1% $14.72 342
30 kyoh86/richgo Enrich `go test` outputs with text decorations. go 85.0% $12.87 312
31 shashwatah/jot ⚡Rapid note management for the terminal. rs 84.6% $8.70 216
32 ogham/dog A command-line DNS client. rs 84.2% $11.72 273
33 xorg62/tty-clock Clock using lib ncurses c 84.0% $10.30 218
34 rust-ethereum/ethabi Encode and decode smart contract invocations rs 84.0% $10.26 257
35 JohannesKaufmann/html-to-markdown ⚙️ Convert HTML to Markdown. Even works with entire websites and can be extended through rules. go 83.7% $14.48 363
36 pier-cli/pier A CLI to organize and run short Unix shell scripts rs 83.7% $9.16 245
37 hush-shell/hush Hush is a unix shell based on the Lua programming language rs 83.3% $16.84 374
38 BurntSushi/xsv A fast CSV command line toolkit written in Rust. rs 82.7% $17.25 288
39 jrnxf/thokr ✨ sleek typing tui with visualized results and historical logging rs 82.2% $18.03 328
40 segmentio/chamber CLI for managing secrets go 82.0% $11.99 232
41 junegunn/fzf :cherry_blossom: A command-line fuzzy finder go 81.9% $11.78 253
42 o2sh/onefetch Command-line Git information tool rs 81.7% $16.25 289
43 sharkdp/hexyl A command-line hex viewer rs 81.3% $12.37 236
44 blacknon/hwatch A modern alternative to the watch command, records the differences in execution results and can check this differences at after. rs 81.1% $10.71 221
45 eradman/entr Run arbitrary commands when files change c 80.9% $7.88 202
46 chmln/handlr A better xdg-utils rs 80.9% $13.21 319
47 nikolassv/bartib A simple timetracker for the command line. It saves a log of all tracked activities as a plaintext file and allows you to create flexible reports. rs 80.9% $10.92 274
48 tomarrell/wrapcheck A Go linter to check that errors from external packages are wrapped go 80.8% $10.87 250
49 WGUNDERWOOD/tex-fmt An extremely fast LaTeX formatter written in Rust rs 80.7% $19.07 374
50 raviqqe/muffet Fast website link checker in Go go 80.5% $7.24 170
51 HaliteChallenge/Halite @twosigma's first artificial intelligence programming challenge cpp 80.4% $15.08 222
52 kisielk/errcheck errcheck checks that you checked errors. go 80.4% $10.88 225
53 google/brotli Brotli compression format c 80.3% $10.59 262
54 altdesktop/i3-style 🎨 Make your i3 config a little more stylish. rs 80.0% $12.87 205
55 mibk/dupl a tool for code clone detection go 79.6% $13.85 215
56 jonas/tig Text-mode interface for git c 79.6% $10.78 281
57 simeg/eureka 💡 CLI tool to input and store your ideas without leaving the terminal rs 78.8% $5.67 195
58 lz4/lz4 Extremely Fast Compression algorithm c 78.7% $9.86 216
59 svenstaro/miniserve 🌟 For when you really just want to serve some files over HTTP right now! rs 78.6% $9.68 137
60 orf/gping Ping, but with a graph rs 78.5% $10.87 211
61 mfridman/tparse CLI tool for summarizing go test output. Pipe friendly. CI/CD friendly. go 77.6% $13.53 179
62 cmatsuoka/figlet Claudio's FIGlet tree c 77.5% $18.00 279
63 mookid/diffr Yet another diff highlighting tool rs 77.2% $13.03 208
64 sharkdp/pastel A command-line tool to generate, analyze, convert and manipulate colors rs 77.2% $17.50 232
65 nuta/nsh A command-line shell like fish, but POSIX compatible. rs 76.9% $13.22 304
66 peco/peco Simplistic interactive filtering tool go 76.7% $14.19 391
67 multiprocessio/dsq Commandline tool for running SQL queries against JSON, CSV, Excel, Parquet, and more. go 76.4% $14.97 351
68 sibprogrammer/xq Command-line XML and HTML beautifier and content extractor go 75.9% $13.82 356
69 antonmedv/fx Terminal JSON viewer & processor go 75.7% $20.74 396
70 facebookresearch/fastText Library for fast text representation and classification. cpp 75.6% $15.58 242
71 sayanarijit/xplr A hackable, minimal, fast TUI file explorer rs 75.4% $16.61 277
72 skeema/skeema Declarative pure-SQL schema management for MySQL and MariaDB go 74.9% $7.91 269
73 yoav-lavi/melody Melody is a language that compiles to regular expressions and aims to be more readable and maintainable rs 74.4% $12.05 325
74 Drew-Alleman/DataSurgeon Quickly Extracts IP's, Email Addresses, Hashes, Files, Credit Cards, Social Security Numbers and a lot More From Text rs 74.3% $13.45 345
75 ninja-build/ninja a small build system with a focus on speed cpp 72.3% $16.10 324
76 yaa110/nomino Batch rename utility for developers rs 72.2% $10.11 270
77 bensadeh/tailspin 🌀 A log file highlighter rs 72.0% $20.30 324
78 cordx56/rustowl Visualize Ownership and Lifetimes in Rust rs 71.8% $10.74 250
79 astaxie/bat Go implement CLI, cURL-like tool for humans go 71.8% $9.63 188
80 sitkevij/hex 🔮 Futuristic take on hexdump, made in Rust. rs 71.3% $5.97 227
81 ArthurSonzogni/json-tui A JSON terminal UI made in C++ cpp 71.0% $13.34 298
82 hairyhenderson/gomplate A flexible commandline tool for template rendering. Supports lots of local and remote datasources. go 70.9% $14.37 258
83 ggreer/the_silver_searcher A code-searching tool similar to ack, but faster. c 70.1% $7.38 195
84 bootandy/dust A more intuitive version of du in rust rs 70.0% $15.78 245
85 guumaster/hostctl Your dev tool to manage /etc/hosts like a pro! go 69.4% $10.77 253
86 ekzhang/bore 🕳 bore is a simple CLI tool for making tunnels to localhost rs 68.8% $8.20 193
87 incu6us/goimports-reviser Right imports sorting & code formatting tool (goimports alternative) go 68.6% $9.52 230
88 dalance/amber A code search / replace tool rs 68.6% $14.47 329
89 lh3/seqtk Toolkit for processing sequences in FASTA/Q formats c 67.4% $14.11 306
90 Canop/broot A new way to see and navigate directory trees : https://dystroy.org/broot rs 67.0% $14.42 241
91 noborus/trdsql CLI tool that can execute SQL queries on CSV, LTSV, JSON, YAML and TBLN. Can output to various formats. go 66.8% $9.89 307
92 Isona/dirble Fast directory scanning and scraping tool rs 66.7% $5.89 95
93 ismaelgv/rnr A command-line tool to batch rename files and directories rs 66.6% $11.86 257
94 dundee/gdu Fast disk usage analyzer with console interface written in Go go 66.5% $10.24 245
95 pemistahl/grex A command-line tool and Rust library with Python bindings for generating regular expressions from user-provided test cases rs 66.0% $16.93 266
96 rust-embedded/svd2rust Generate Rust register maps (`struct`s) from SVD files rs 65.9% $12.91 218
97 foriequal0/git-trim Automatically trims your branches whose tracking remote refs are merged or stray rs 64.6% $11.85 321
98 TheZoraiz/ascii-image-converter A cross-platform command-line tool to convert images into ascii art and print them on the console. Now supports braille art! go 64.1% $15.75 278
99 sirwart/ripsecrets A command-line tool to prevent committing secret keys into your source code rs 63.8% $16.13 268
100 ajeetdsouza/zoxide A smarter cd command. Supports all major shells. rs 63.7% $18.43 307
101 alexpovel/srgn A grep-like tool which understands source code syntax and allows for manipulation in addition to search rs 62.8% $13.43 344
102 direnv/direnv unclutter your .profile go 62.0% $14.72 312
103 cweill/gotests Automatically generate Go test boilerplate from your source code. go 61.9% $14.13 274
104 quinn-rs/quinn Async-friendly QUIC implementation in Rust rs 61.7% $7.44 147
105 hooklift/gowsdl WSDL2Go code generation as well as its SOAP proxy go 61.6% $20.18 296
106 FiloSottile/age A simple, modern and secure encryption tool (and Go library) with small explicit keys, no config options, and UNIX-style composability. go 60.9% $13.80 210
107 cheat/cheat cheat allows you to create and view interactive cheatsheets on the command-line. It was designed to help remind *nix system administrators of options for commands that they use frequently, but not frequently enough to remember. go 59.9% $5.80 198
108 YS-L/flamelens Flamegraph viewer in the terminal rs 59.4% $15.81 252
109 antonmedv/walk Terminal file manager go 58.9% $15.76 297
110 naggie/dstask Git powered terminal-based todo/note manager -- markdown note page per task. Single binary! go 58.8% $10.21 241
111 robertdavidgraham/masscan TCP port scanner, spews SYN packets asynchronously, scanning entire Internet in under 5 minutes. c 57.0% $13.59 295
112 gabotechs/dep-tree Tool for helping developers keep their code bases clean and decoupled. It allows visualising a code base complexity using a 3d force-directed graph of files and the dependencies between them. go 56.8% $12.17 245
113 NikolaDucak/caps-log A small TUI journaling tool. 📖 cpp 56.4% $11.12 283
114 jesseduffield/lazygit simple terminal UI for git commands go 56.4% $9.52 188
115 Epistates/treemd A (TUI/CLI) markdown navigator with tree-based structural navigation. rs 55.1% $20.28 431
116 lfos/calcurse A text-based calendar and scheduling application c 53.8% $12.74 248
117 parcel-bundler/lightningcss An extremely fast CSS parser, transformer, bundler, and minifier written in Rust. rs 53.6% $17.40 312
118 elkowar/pipr A tool to interactively write shell pipelines. rs 53.5% $10.10 210
119 svenstaro/genact 🌀 A nonsense activity generator rs 53.0% $11.11 158
120 ecumene/rust-sloth A 3D software rasterizer... for the terminal! rs 52.6% $16.83 237
121 Canop/rhit A nginx log explorer rs 52.4% $15.70 230
122 mkj/dropbear Dropbear SSH c 51.8% $8.15 152
123 Stranger6667/jsonschema A high-performance JSON Schema validator for Rust rs 51.7% $8.76 233
124 ducaale/xh Friendly and fast tool for sending HTTP requests rs 50.0% $13.67 284
125 wintermute-cell/ngrrram A TUI tool to help you type faster and learn new layouts. Includes a free cat. rs 47.5% $11.82 194
126 mgechev/revive 🔥 ~6x faster, stricter, configurable, extensible, and beautiful drop-in replacement for golint go 46.4% $10.31 254
127 kaushiksrini/parqeye Peek inside Parquet files right from your terminal rs 45.5% $14.19 203
128 rochacbruno/marmite Markdown makes sites - A Static Site Generator for Blogs rs 45.4% $13.96 206
129 crowdagger/crowbook Converts books written in Markdown to HTML, LaTeX/PDF and EPUB rs 45.0% $19.00 320
130 jhspetersson/fselect Find files with SQL-like queries rs 44.0% $9.78 262
131 paradigmxyz/solar Blazingly fast, modular and contributor friendly Solidity compiler, written in Rust rs 43.3% $14.23 245
132 cslarsen/jp2a Converts jpg images to ASCII c 42.0% $13.07 192
133 yassinebridi/serpl A simple terminal UI for search and replace, ala VS Code. rs 40.8% $12.94 210
134 rvben/rumdl Fast Markdown linter and formatter written in Rust rs 40.7% $8.20 206
135 sigoden/argc A Bash CLI framework, also a Bash command runner. rs 39.8% $30.14 435
136 axodotdev/oranda 🎁 generate beautiful landing pages for your developer tools rs 39.6% $9.62 238
137 arq5x/bedtools2 bedtools - the swiss army knife for genome arithmetic c 38.9% $19.07 293
138 chirlu/sox SoX, Swiss Army knife of sound processing c 37.9% $10.13 233
139 boyter/scc Sloc, Cloc and Code: scc is a very fast accurate code counter with complexity calculations and COCOMO estimates written in pure Go go 37.3% $15.01 315
140 tree-sitter/tree-sitter An incremental parsing system for programming tools rs 36.1% $11.07 264
141 go-critic/go-critic The most opinionated Go source code linter for code audit. go 35.1% $20.28 360
142 hpjansson/chafa 📺🗿 Terminal graphics for the 21st century. c 33.5% $14.64 252
143 pls-rs/pls pls is a prettier and powerful ls(1) for the pros. rs 31.0% $23.17 497
144 LuaJIT/LuaJIT Mirror of the LuaJIT git repository c 29.0% $19.88 259
145 ivanceras/svgbob Convert your ascii diagram scribbles into happy little SVG rs 23.1% $14.16 268
146 johnkerl/miller Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON go 22.9% $13.86 322
147 eliukblau/pixterm Draw images in your ANSI terminal with true color go 19.5% $15.01 227
148 stathissideris/ditaa ditaa is a small command-line utility that can convert diagrams drawn using ascii art ('drawings' that contain characters that resemble lines like | / - ), into proper bitmap graphics. java 18.4% $14.43 260
149 Nukesor/pueue :stars: Manage your shell commands. rs 15.4% $12.90 252
150 samtools/samtools Tools (written in C using htslib) for manipulating next-generation sequencing data c 14.2% $10.17 192
151 tstack/lnav Log file navigator cpp 13.4% $10.16 341
152 typst/typst A markup-based typesetting system that is powerful and easy to learn. rs 13.3% $4.62 285
153 duckdb/duckdb DuckDB is an analytical in-process SQL database management system cpp 12.4% $17.56 441
154 ast-grep/ast-grep ⚡A CLI tool for code structural search, lint and rewriting. Written in Rust rs 11.9% $11.94 322
155 sharkdp/hyperfine A command-line benchmarking tool rs 11.7% $13.58 265
156 oppiliappan/statix lints and suggestions for the nix programming language rs 11.3% $14.17 282
157 OSGeo/PROJ PROJ - Cartographic Projections and Coordinate Transformations Library cpp 11.1% $14.08 288
158 danmar/cppcheck static analysis of C/C++ code cpp 10.6% $6.95 175
159 tinycc/tinycc Unofficial mirror of mob development branch c 8.0% $12.01 189
160 codesnap-rs/codesnap 🦀️📸 Pure Rust tool to generate beautiful code snapshots, provide CLI and Library rs 7.4% $8.54 172
161 ip7z/7zip 7-Zip cpp 5.2% $6.02 218
162 gromacs/gromacs Public/backup repository of the GROMACS molecular simulation toolkit. Please do not mine the metadata blindly; we use https://gitlab.com/gromacs/gromacs for code review and issue tracking. cpp 4.3% $14.33 298
163 rust-lang/mdBook Create book from markdown files. Like Gitbook but implemented in Rust rs 4.1% $13.14 244
164 bellard/quickjs Public repository of the QuickJS Javascript Engine. c 3.6% $16.39 248
165 doxygen/doxygen Official doxygen git repository c 1.3% $15.13 328
166 Y2Z/monolith ⬛️ CLI tool and library for saving complete web pages as a single HTML file rs 1.3% $12.81 305
167 zk-org/zk Plain text note-taking assistant go 1.2% $14.07 286
168 jqlang/jq Command-line JSON processor c 1.1% $18.26 384
169 dandavison/delta A syntax-highlighting pager for git, diff, grep, rg --json, and blame output rs 0.8% $8.32 236
170 alecthomas/chroma A general purpose syntax highlighter in pure Go go 0.6% $16.38 297
171 jgm/pandoc Universal markup converter hs 0.1% $17.70 339
172 AmmarAbouZor/tui-journal Your journal app if you live in a terminal rs 0.0% $3.27 239
173 anordal/shellharden The corrective bash syntax highlighter rs 0.0% $2.13 256
174 ariga/atlas Declarative schema migrations with schema-as-code workflows go 0.0% $5.00 296
175 astro/deadnix Scan Nix files for dead code rs 0.0% $3.29 258
176 BurntSushi/ripgrep ripgrep recursively searches directories for a regex pattern while respecting your gitignore rs 0.0% $2.74 261
177 eudoxia0/hashcards A plain text-based spaced repetition system. rs 0.0% $6.91 254
178 facebook/zstd Zstandard - Fast real-time compression algorithm c 0.0% $1.41 189
179 FFmpeg/FFmpeg Mirror of https://git.ffmpeg.org/ffmpeg.git c 0.0% $2.06 221
180 git-bahn/git-graph Command line tool to show clear git graphs arranged for your branching model rs 0.0% $1.52 216
181 hatoo/oha Ohayou(おはよう), HTTP load generator, inspired by rakyll/hey with tui animation. rs 0.0% $2.89 187
182 konradsz/igrep Interactive Grep rs 0.0% $1.32 185
183 kyoheiu/felix tui file manager with vim-like key mapping rs 0.0% $2.48 244
184 lua/lua A copy of the Lua development repository, as seen by the Lua team. Mirrored irregularly. All communication should be through the Lua mailing list https://www.lua.org/lua-l.html c 0.0% $9.84 315
185 madler/pigz A parallel implementation of gzip for modern multi-processor, multi-core machines. c 0.0% $1.63 215
186 mikefarah/yq yq is a portable command-line YAML, JSON, XML, CSV, TOML, HCL and properties processor go 0.0% $2.85 217
187 OSGeo/gdal GDAL is an open source MIT licensed translator library for raster and vector geospatial data formats. cpp 0.0% $2.60 218
188 php/php-src The PHP Interpreter c 0.0% $2.94 205
189 rcoh/angle-grinder Slice and dice logs on the command line rs 0.0% $3.83 303
190 sclevine/yj CLI - Convert between YAML, TOML, JSON, and HCL. Preserves map order. go 0.0% $2.92 293
191 sharkdp/bat A cat(1) clone with wings. rs 0.0% $2.85 253
192 sharkdp/fd A simple, fast and user-friendly alternative to 'find' rs 0.0% $1.07 183
193 sqlite/sqlite Official Git mirror of the SQLite source tree c 0.0% $4.54 274
194 stacked-git/stgit Stacked Git rs 0.0% $1.93 213
195 trasta298/keifu Git genealogy, untangled. A TUI for navigating commit graphs with color and clarity. rs 0.0% $2.19 178
196 tukaani-project/xz XZ Utils c 0.0% $1.36 189
197 unhappychoice/gittype A CLI code-typing game that turns your source code into typing challenges rs 0.0% $4.14 242
198 universal-ctags/ctags A maintained ctags implementation c 0.0% $2.49 226
199 XAMPPRocky/tokei Count your code, quickly. rs 0.0% $2.82 193
200 zevv/duc Dude, where are my bytes: Duc, a library and suite of tools for inspecting disk usage c 0.0% $5.00 228

Click row to see task details