← Back to detailed results

Claude Opus 4.7

Anthropic · mini-SWE-agent · Rank #4

0%
Resolved help_outline Percentage of instances fully solved as measured by hidden behavioral tests.
3.0%
Almost Resolved help_outline Instances where the agent's solution passes ≥ 95% of all hidden behavioral tests.
$762
Total Cost help_outline Total API cost in USD across all task instances.
18,504
Total Calls help_outline Total number of LLM calls across all task instances.

Score (Behavioral Test Pass Rate) Distribution

Per-Instance Results

200 instances
# Repository Lang Score Cost Calls
1 rbakbashev/elfcat ELF visualizer. Generates HTML files from ELF binaries. rs 98.2% $23.52 271
2 BLAKE3-team/BLAKE3 the official Rust and C implementations of the BLAKE3 cryptographic hash function rs 97.5% $3.88 84
3 agourlay/zip-password-finder Find the password of protected ZIP files. rs 97.4% $2.53 78
4 jarun/nnn n³ The unorthodox terminal file manager c 96.6% $1.32 56
5 sheepla/pingu 🐧ping command but with pingu go 96.6% $3.36 104
6 sstadick/hck A sharp cut(1) clone. rs 95.7% $5.84 142
7 abishekvashok/cmatrix Terminal based "The Matrix" like implementation c 94.9% $4.44 130
8 riquito/tuc When cut doesn't cut it rs 92.7% $8.58 165
9 wfxr/csview 📠 Pretty and fast csv viewer for cli with cjk/emoji support. rs 92.5% $3.38 68
10 mgdm/htmlq Like jq, but for HTML. rs 92.3% $3.11 108
11 unhappychoice/gittype A CLI code-typing game that turns your source code into typing challenges rs 91.3% $1.74 71
12 rust-ethereum/ethabi Encode and decode smart contract invocations rs 90.9% $13.93 246
13 chmln/sd Intuitive find & replace CLI (sed alternative) rs 90.9% $3.64 113
14 chmln/handlr A better xdg-utils rs 90.7% $7.87 169
15 tomnomnom/gron Make JSON greppable! go 90.2% $9.93 206
16 wfxr/code-minimap 🛰 A high performance code minimap render. rs 88.8% $9.23 184
17 oppiliappan/eva a calculator REPL, similar to bc(1) rs 88.7% $3.68 122
18 raviqqe/muffet Fast website link checker in Go go 87.4% $3.77 111
19 nikolassv/bartib A simple timetracker for the command line. It saves a log of all tracked activities as a plaintext file and allows you to create flexible reports. rs 87.3% $13.55 219
20 hooklift/gowsdl WSDL2Go code generation as well as its SOAP proxy go 86.4% $19.71 260
21 incu6us/goimports-reviser Right imports sorting & code formatting tool (goimports alternative) go 86.4% $2.60 95
22 astro/deadnix Scan Nix files for dead code rs 85.5% $9.59 142
23 JohannesKaufmann/html-to-markdown ⚙️ Convert HTML to Markdown. Even works with entire websites and can be extended through rules. go 85.5% $3.56 92
24 mibk/dupl a tool for code clone detection go 85.0% $4.93 88
25 rs/curlie The power of curl, the ease of use of httpie. go 84.9% $15.70 247
26 tarka/xcp An extended `cp` rs 84.7% $2.57 85
27 mookid/diffr Yet another diff highlighting tool rs 84.7% $4.69 102
28 google/brotli Brotli compression format c 84.6% $5.68 110
29 wintermute-cell/ngrrram A TUI tool to help you type faster and learn new layouts. Includes a free cat. rs 84.5% $22.00 318
30 clog-tool/clog-cli Generate beautiful changelogs from your Git commit history rs 84.0% $5.88 154
31 kyoh86/richgo Enrich `go test` outputs with text decorations. go 83.7% $6.01 166
32 jonas/tig Text-mode interface for git c 83.6% $0.84 44
33 zevv/duc Dude, where are my bytes: Duc, a library and suite of tools for inspecting disk usage c 83.4% $2.14 201
34 pier-cli/pier A CLI to organize and run short Unix shell scripts rs 83.4% $3.71 83
35 madler/pigz A parallel implementation of gzip for modern multi-processor, multi-core machines. c 83.2% $4.53 149
36 rs/jplot iTerm2 expvar/JSON monitoring tool go 82.5% $2.34 85
37 ismaelgv/rnr A command-line tool to batch rename files and directories rs 82.1% $4.44 154
38 BurntSushi/xsv A fast CSV command line toolkit written in Rust. rs 82.0% $4.51 106
39 sharkdp/hexyl A command-line hex viewer rs 81.6% $10.35 164
40 ogham/dog A command-line DNS client. rs 80.8% $5.47 144
41 lz4/lz4 Extremely Fast Compression algorithm c 80.0% $5.56 155
42 yaa110/nomino Batch rename utility for developers rs 79.6% $4.21 119
43 Miserlou/Loop UNIX's missing `loop` command rs 79.3% $5.22 143
44 yoav-lavi/melody Melody is a language that compiles to regular expressions and aims to be more readable and maintainable rs 78.9% $5.37 135
45 eradman/entr Run arbitrary commands when files change c 78.5% $1.89 77
46 sharkdp/fd A simple, fast and user-friendly alternative to 'find' rs 78.1% $3.02 80
47 ajeetdsouza/zoxide A smarter cd command. Supports all major shells. rs 76.5% $10.07 187
48 KSXGitHub/parallel-disk-usage Highly parallelized, blazing fast directory tree analyzer rs 76.5% $4.66 99
49 psampaz/go-mod-outdated Find outdated dependencies of your Go projects. go-mod-outdated provides a table view of the go list -u -m -json all command which lists all dependencies of a Go project and their available minor and patch updates. It also provides a way to filter indirect dependencies and dependencies without updates. go 76.1% $0.77 43
50 bensadeh/tailspin 🌀 A log file highlighter rs 75.6% $2.18 65
51 junegunn/fzf :cherry_blossom: A command-line fuzzy finder go 74.9% $0.56 20
52 ekzhang/bore 🕳 bore is a simple CLI tool for making tunnels to localhost rs 74.6% $5.59 112
53 sharkdp/pastel A command-line tool to generate, analyze, convert and manipulate colors rs 74.6% $3.22 92
54 sclevine/yj CLI - Convert between YAML, TOML, JSON, and HCL. Preserves map order. go 74.4% $4.14 88
55 brocode/fblog Small command-line JSON Log viewer rs 74.4% $5.12 127
56 antonmedv/walk Terminal file manager go 74.3% $1.65 70
57 pemistahl/grex A command-line tool and Rust library with Python bindings for generating regular expressions from user-provided test cases rs 73.9% $7.62 153
58 Lymphatus/caesium-clt Caesium Command Line Tools - Lossy/lossless image compression tool rs 73.6% $1.89 57
59 blacknon/hwatch A modern alternative to the watch command, records the differences in execution results and can check this differences at after. rs 73.5% $1.23 56
60 konradsz/igrep Interactive Grep rs 73.5% $1.38 54
61 altdesktop/i3-style 🎨 Make your i3 config a little more stylish. rs 73.5% $7.30 165
62 Esubaalew/run Universal multi-language runner and smart REPL written in Rust. rs 73.2% $1.91 73
63 sirwart/ripsecrets A command-line tool to prevent committing secret keys into your source code rs 72.8% $7.44 156
64 orf/gping Ping, but with a graph rs 72.3% $1.89 70
65 cmatsuoka/figlet Claudio's FIGlet tree c 72.2% $8.06 134
66 Drew-Alleman/DataSurgeon Quickly Extracts IP's, Email Addresses, Hashes, Files, Credit Cards, Social Security Numbers and a lot More From Text rs 72.1% $8.64 213
67 mfridman/tparse CLI tool for summarizing go test output. Pipe friendly. CI/CD friendly. go 72.0% $2.33 69
68 anordal/shellharden The corrective bash syntax highlighter rs 72.0% $1.99 69
69 noborus/ov 🎑Feature-rich terminal-based text viewer. It is a so-called terminal pager. go 71.5% $2.35 99
70 shashwatah/jot ⚡Rapid note management for the terminal. rs 71.3% $6.83 182
71 HaliteChallenge/Halite @twosigma's first artificial intelligence programming challenge cpp 71.3% $1.00 44
72 bootandy/dust A more intuitive version of du in rust rs 70.9% $12.12 171
73 AmmarAbouZor/tui-journal Your journal app if you live in a terminal rs 70.8% $4.42 107
74 Byron/dua-cli View disk space usage and delete unwanted data, fast. rs 70.8% $2.82 80
75 xorg62/tty-clock Clock using lib ncurses c 69.4% $5.70 123
76 dalance/amber A code search / replace tool rs 67.9% $2.97 96
77 peco/peco Simplistic interactive filtering tool go 67.5% $2.50 84
78 trasta298/keifu Git genealogy, untangled. A TUI for navigating commit graphs with color and clarity. rs 67.2% $1.11 48
79 sqlite/sqlite Official Git mirror of the SQLite source tree c 67.0% $1.08 37
80 simeg/eureka 💡 CLI tool to input and store your ideas without leaving the terminal rs 66.6% $2.50 104
81 astaxie/bat Go implement CLI, cURL-like tool for humans go 66.4% $4.95 126
82 sitkevij/hex 🔮 Futuristic take on hexdump, made in Rust. rs 66.3% $2.75 89
83 nuta/nsh A command-line shell like fish, but POSIX compatible. rs 66.1% $3.70 92
84 multiprocessio/dsq Commandline tool for running SQL queries against JSON, CSV, Excel, Parquet, and more. go 65.9% $3.28 98
85 guumaster/hostctl Your dev tool to manage /etc/hosts like a pro! go 64.1% $11.77 211
86 WGUNDERWOOD/tex-fmt An extremely fast LaTeX formatter written in Rust rs 64.0% $2.87 81
87 jqlang/jq Command-line JSON processor c 63.9% $2.69 80
88 lh3/seqtk Toolkit for processing sequences in FASTA/Q formats c 63.9% $2.48 68
89 jrnxf/thokr ✨ sleek typing tui with visualized results and historical logging rs 63.1% $4.85 126
90 cordx56/rustowl Visualize Ownership and Lifetimes in Rust rs 62.8% $2.22 84
91 svenstaro/miniserve 🌟 For when you really just want to serve some files over HTTP right now! rs 61.8% $0.94 30
92 noborus/trdsql CLI tool that can execute SQL queries on CSV, LTSV, JSON, YAML and TBLN. Can output to various formats. go 61.7% $3.13 73
93 cweill/gotests Automatically generate Go test boilerplate from your source code. go 61.0% $4.87 105
94 Canop/broot A new way to see and navigate directory trees : https://dystroy.org/broot rs 60.9% $1.57 58
95 yassinebridi/serpl A simple terminal UI for search and replace, ala VS Code. rs 60.8% $2.92 96
96 sayanarijit/xplr A hackable, minimal, fast TUI file explorer rs 60.5% $4.36 108
97 dundee/gdu Fast disk usage analyzer with console interface written in Go go 59.6% $2.35 69
98 TheZoraiz/ascii-image-converter A cross-platform command-line tool to convert images into ascii art and print them on the console. Now supports braille art! go 58.9% $7.97 178
99 kaushiksrini/parqeye Peek inside Parquet files right from your terminal rs 58.9% $1.25 40
100 skeema/skeema Declarative pure-SQL schema management for MySQL and MariaDB go 57.3% $1.47 63
101 elkowar/pipr A tool to interactively write shell pipelines. rs 57.1% $3.08 108
102 YS-L/flamelens Flamegraph viewer in the terminal rs 57.1% $1.38 62
103 kisielk/errcheck errcheck checks that you checked errors. go 56.9% $6.93 187
104 cslarsen/jp2a Converts jpg images to ASCII c 56.1% $16.11 239
105 facebook/zstd Zstandard - Fast real-time compression algorithm c 55.0% $3.68 104
106 XAMPPRocky/tokei Count your code, quickly. rs 54.8% $3.25 95
107 ariga/atlas Declarative schema migrations with schema-as-code workflows go 54.8% $8.11 173
108 sharkdp/hyperfine A command-line benchmarking tool rs 54.3% $1.55 41
109 quinn-rs/quinn Async-friendly QUIC implementation in Rust rs 53.8% $2.27 54
110 o2sh/onefetch Command-line Git information tool rs 53.6% $1.84 72
111 axodotdev/oranda 🎁 generate beautiful landing pages for your developer tools rs 53.6% $1.36 50
112 Canop/rhit A nginx log explorer rs 53.2% $1.18 34
113 foriequal0/git-trim Automatically trims your branches whose tracking remote refs are merged or stray rs 52.7% $2.67 82
114 naggie/dstask Git powered terminal-based todo/note manager -- markdown note page per task. Single binary! go 50.7% $3.06 96
115 robertdavidgraham/masscan TCP port scanner, spews SYN packets asynchronously, scanning entire Internet in under 5 minutes. c 50.6% $1.13 49
116 antonmedv/fx Terminal JSON viewer & processor go 49.3% $5.93 145
117 cheat/cheat cheat allows you to create and view interactive cheatsheets on the command-line. It was designed to help remind *nix system administrators of options for commands that they use frequently, but not frequently enough to remember. go 49.2% $3.11 86
118 ecumene/rust-sloth A 3D software rasterizer... for the terminal! rs 47.4% $2.46 58
119 codesnap-rs/codesnap 🦀️📸 Pure Rust tool to generate beautiful code snapshots, provide CLI and Library rs 47.1% $1.88 54
120 hatoo/oha Ohayou(おはよう), HTTP load generator, inspired by rakyll/hey with tui animation. rs 45.8% $1.40 39
121 Epistates/treemd A (TUI/CLI) markdown navigator with tree-based structural navigation. rs 45.4% $2.54 66
122 kyoheiu/felix tui file manager with vim-like key mapping rs 45.2% $1.13 52
123 ArthurSonzogni/json-tui A JSON terminal UI made in C++ cpp 45.0% $1.07 43
124 parcel-bundler/lightningcss An extremely fast CSS parser, transformer, bundler, and minifier written in Rust. rs 43.2% $1.26 46
125 lua/lua A copy of the Lua development repository, as seen by the Lua team. Mirrored irregularly. All communication should be through the Lua mailing list https://www.lua.org/lua-l.html c 43.1% $4.41 95
126 mgechev/revive 🔥 ~6x faster, stricter, configurable, extensible, and beautiful drop-in replacement for golint go 43.1% $2.52 62
127 paradigmxyz/solar Blazingly fast, modular and contributor friendly Solidity compiler, written in Rust rs 43.0% $3.30 98
128 oppiliappan/statix lints and suggestions for the nix programming language rs 42.8% $3.28 89
129 NikolaDucak/caps-log A small TUI journaling tool. 📖 cpp 42.6% $2.40 70
130 hairyhenderson/gomplate A flexible commandline tool for template rendering. Supports lots of local and remote datasources. go 41.1% $4.69 89
131 rhysd/kiro-editor A small terminal UTF-8 text editor written in Rust 📝🦀 rs 40.7% $0.71 46
132 BurntSushi/ripgrep ripgrep recursively searches directories for a regex pattern while respecting your gitignore rs 40.7% $2.47 75
133 mkj/dropbear Dropbear SSH c 40.6% $1.62 56
134 facebookresearch/fastText Library for fast text representation and classification. cpp 38.8% $1.59 57
135 rcoh/angle-grinder Slice and dice logs on the command line rs 38.0% $3.55 84
136 rust-lang/mdBook Create book from markdown files. Like Gitbook but implemented in Rust rs 37.9% $1.52 60
137 gabotechs/dep-tree Tool for helping developers keep their code bases clean and decoupled. It allows visualising a code base complexity using a 3d force-directed graph of files and the dependencies between them. go 37.1% $1.20 48
138 jesseduffield/lazygit simple terminal UI for git commands go 36.7% $0.93 49
139 tukaani-project/xz XZ Utils c 36.0% $3.27 94
140 tree-sitter/tree-sitter An incremental parsing system for programming tools rs 35.1% $8.38 139
141 doxygen/doxygen Official doxygen git repository c 34.5% $1.17 50
142 lfos/calcurse A text-based calendar and scheduling application c 33.5% $2.88 80
143 direnv/direnv unclutter your .profile go 32.2% $2.28 84
144 sharkdp/bat A cat(1) clone with wings. rs 31.9% $1.16 48
145 Isona/dirble Fast directory scanning and scraping tool rs 29.7% $2.28 71
146 jhspetersson/fselect Find files with SQL-like queries rs 29.3% $2.52 74
147 go-critic/go-critic The most opinionated Go source code linter for code audit. go 28.2% $4.00 134
148 tomarrell/wrapcheck A Go linter to check that errors from external packages are wrapped go 24.6% $6.25 148
149 OSGeo/PROJ PROJ - Cartographic Projections and Coordinate Transformations Library cpp 24.2% $1.45 35
150 pls-rs/pls pls is a prettier and powerful ls(1) for the pros. rs 24.1% $1.86 75
151 svenstaro/genact 🌀 A nonsense activity generator rs 23.3% $1.70 49
152 ivanceras/svgbob Convert your ascii diagram scribbles into happy little SVG rs 23.1% $0.75 36
153 dandavison/delta A syntax-highlighting pager for git, diff, grep, rg --json, and blame output rs 23.1% $0.35 22
154 rochacbruno/marmite Markdown makes sites - A Static Site Generator for Blogs rs 21.4% $0.74 28
155 boyter/scc Sloc, Cloc and Code: scc is a very fast accurate code counter with complexity calculations and COCOMO estimates written in pure Go go 19.6% $1.69 54
156 eliukblau/pixterm Draw images in your ANSI terminal with true color go 19.3% $5.80 92
157 johnkerl/miller Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON go 19.0% $2.86 62
158 hpjansson/chafa 📺🗿 Terminal graphics for the 21st century. c 16.1% $1.45 42
159 hush-shell/hush Hush is a unix shell based on the Lua programming language rs 15.7% $0.75 28
160 ducaale/xh Friendly and fast tool for sending HTTP requests rs 15.5% $1.24 43
161 rvben/rumdl Fast Markdown linter and formatter written in Rust rs 14.7% $1.36 41
162 rust-embedded/svd2rust Generate Rust register maps (`struct`s) from SVD files rs 14.7% $0.61 27
163 zk-org/zk Plain text note-taking assistant go 14.0% $1.52 59
164 FiloSottile/age A simple, modern and secure encryption tool (and Go library) with small explicit keys, no config options, and UNIX-style composability. go 13.9% $1.05 37
165 Nukesor/pueue :stars: Manage your shell commands. rs 12.4% $1.93 68
166 typst/typst A markup-based typesetting system that is powerful and easy to learn. rs 11.7% $1.51 50
167 mikefarah/yq yq is a portable command-line YAML, JSON, XML, CSV, TOML, HCL and properties processor go 11.5% $1.28 38
168 stacked-git/stgit Stacked Git rs 10.1% $0.56 25
169 htop-dev/htop htop - an interactive process viewer c 9.8% $1.55 59
170 segmentio/chamber CLI for managing secrets go 9.4% $3.95 92
171 tstack/lnav Log file navigator cpp 8.8% $1.07 43
172 sigoden/argc A Bash CLI framework, also a Bash command runner. rs 7.9% $0.61 34
173 eudoxia0/hashcards A plain text-based spaced repetition system. rs 6.1% $1.55 65
174 ninja-build/ninja a small build system with a focus on speed cpp 4.8% $1.69 69
175 jgm/pandoc Universal markup converter hs 4.7% $1.04 46
176 alecthomas/chroma A general purpose syntax highlighter in pure Go go 4.5% $0.48 20
177 gromacs/gromacs Public/backup repository of the GROMACS molecular simulation toolkit. Please do not mine the metadata blindly; we use https://gitlab.com/gromacs/gromacs for code review and issue tracking. cpp 4.4% $6.17 153
178 duckdb/duckdb DuckDB is an analytical in-process SQL database management system cpp 4.0% $1.41 62
179 chirlu/sox SoX, Swiss Army knife of sound processing c 3.9% $1.25 49
180 ast-grep/ast-grep ⚡A CLI tool for code structural search, lint and rewriting. Written in Rust rs 3.9% $1.45 46
181 samtools/samtools Tools (written in C using htslib) for manipulating next-generation sequencing data c 3.7% $0.81 34
182 OSGeo/gdal GDAL is an open source MIT licensed translator library for raster and vector geospatial data formats. cpp 3.7% $0.47 22
183 git-bahn/git-graph Command line tool to show clear git graphs arranged for your branching model rs 3.3% $7.75 160
184 FFmpeg/FFmpeg Mirror of https://git.ffmpeg.org/ffmpeg.git c 3.3% $1.07 35
185 tinycc/tinycc Unofficial mirror of mob development branch c 3.3% $0.45 22
186 LuaJIT/LuaJIT Mirror of the LuaJIT git repository c 2.9% $0.33 18
187 danmar/cppcheck static analysis of C/C++ code cpp 2.8% $0.62 27
188 sibprogrammer/xq Command-line XML and HTML beautifier and content extractor go 2.5% $11.86 227
189 Y2Z/monolith ⬛️ CLI tool and library for saving complete web pages as a single HTML file rs 2.4% $3.80 118
190 alexpovel/srgn A grep-like tool which understands source code syntax and allows for manipulation in addition to search rs 2.4% $1.57 64
191 arq5x/bedtools2 bedtools - the swiss army knife for genome arithmetic c 2.1% $1.67 60
192 ggreer/the_silver_searcher A code-searching tool similar to ack, but faster. c 1.5% $3.72 107
193 ip7z/7zip 7-Zip cpp 1.2% $0.60 35
194 bellard/quickjs Public repository of the QuickJS Javascript Engine. c 1.2% $0.52 18
195 php/php-src The PHP Interpreter c 0.9% $0.25 14
196 crowdagger/crowbook Converts books written in Markdown to HTML, LaTeX/PDF and EPUB rs 0.9% $2.01 69
197 stathissideris/ditaa ditaa is a small command-line utility that can convert diagrams drawn using ascii art ('drawings' that contain characters that resemble lines like | / - ), into proper bitmap graphics. java 0.7% $2.54 76
198 universal-ctags/ctags A maintained ctags implementation c 0.5% $0.29 22
199 nachoparker/dutree a tool to analyze file system usage written in Rust rs 0.3% $19.26 164
200 Stranger6667/jsonschema A high-performance JSON Schema validator for Rust rs 0.2% $2.18 61

Click row to see task details