← Back to detailed results

Claude Opus 5 (xhigh)

Anthropic · mini-SWE-agent · Rank #1

4.5%
Resolved help_outline Percentage of instances fully solved as measured by hidden behavioral tests.
37.0%
Almost Resolved help_outline Instances where the agent's solution passes ≥ 95% of all hidden behavioral tests.
$10107
Total Cost help_outline Total API cost in USD across all task instances.
51,359
Total Calls help_outline Total number of LLM calls across all task instances.

Score (Behavioral Test Pass Rate) Distribution

Per-Instance Results

198 instances
# Repository Lang Score Cost Calls
1 abishekvashok/cmatrix Terminal based "The Matrix" like implementation c 100.0% $15.89 131 trace →
2 agourlay/zip-password-finder Find the password of protected ZIP files. rs 100.0% $50.06 211 trace →
3 clog-tool/clog-cli Generate beautiful changelogs from your Git commit history rs 100.0% $31.23 254 trace →
4 ekzhang/bore 🕳 bore is a simple CLI tool for making tunnels to localhost rs 100.0% $19.96 173 trace →
5 ismaelgv/rnr A command-line tool to batch rename files and directories rs 100.0% $36.10 235 trace →
6 psampaz/go-mod-outdated Find outdated dependencies of your Go projects. go-mod-outdated provides a table view of the go list -u -m -json all command which lists all dependencies of a Go project and their available minor and patch updates. It also provides a way to filter indirect dependencies and dependencies without updates. go 100.0% $11.96 110 trace →
7 rbakbashev/elfcat ELF visualizer. Generates HTML files from ELF binaries. rs 100.0% $25.02 202 trace →
8 simeg/eureka 💡 CLI tool to input and store your ideas without leaving the terminal rs 100.0% $19.05 171 trace →
9 sitkevij/hex 🔮 Futuristic take on hexdump, made in Rust. rs 100.0% $6.02 119 trace →
10 riquito/tuc When cut doesn't cut it rs 99.8% $56.86 260 trace →
11 shashwatah/jot ⚡Rapid note management for the terminal. rs 99.7% $62.09 393 trace →
12 wfxr/csview 📠 Pretty and fast csv viewer for cli with cjk/emoji support. rs 99.7% $25.22 208 trace →
13 wfxr/code-minimap 🛰 A high performance code minimap render. rs 99.7% $22.99 145 trace →
14 sharkdp/hexyl A command-line hex viewer rs 99.7% $37.26 242 trace →
15 KSXGitHub/parallel-disk-usage Highly parallelized, blazing fast directory tree analyzer rs 99.6% $35.38 213 trace →
16 ogham/dog A command-line DNS client. rs 99.6% $63.51 350 trace →
17 jrnxf/thokr ✨ sleek typing tui with visualized results and historical logging rs 99.5% $41.93 202 trace →
18 astro/deadnix Scan Nix files for dead code rs 99.5% $101.73 400 trace →
19 tarka/xcp An extended `cp` rs 99.5% $50.85 289 trace →
20 chmln/sd Intuitive find & replace CLI (sed alternative) rs 99.4% $19.17 174 trace →
21 sharkdp/fd A simple, fast and user-friendly alternative to 'find' rs 99.4% $89.62 407 trace →
22 raviqqe/muffet Fast website link checker in Go go 99.3% $56.61 335 trace →
23 Miserlou/Loop UNIX's missing `loop` command rs 99.3% $26.22 195 trace →
24 altdesktop/i3-style 🎨 Make your i3 config a little more stylish. rs 99.3% $39.54 216 trace →
25 oppiliappan/eva a calculator REPL, similar to bc(1) rs 99.2% $74.48 306 trace →
26 chmln/handlr A better xdg-utils rs 99.2% $33.71 213 trace →
27 rhysd/kiro-editor A small terminal UTF-8 text editor written in Rust 📝🦀 rs 99.2% $101.86 375 trace →
28 kisielk/errcheck errcheck checks that you checked errors. go 99.1% $13.69 154 trace →
29 sstadick/hck A sharp cut(1) clone. rs 99.1% $65.89 332 trace →
30 eudoxia0/hashcards A plain text-based spaced repetition system. rs 99.0% $61.96 373 trace →
31 Byron/dua-cli View disk space usage and delete unwanted data, fast. rs 99.0% $98.08 391 trace →
32 kaushiksrini/parqeye Peek inside Parquet files right from your terminal rs 99.0% $155.70 486 trace →
33 BLAKE3-team/BLAKE3 the official Rust and C implementations of the BLAKE3 cryptographic hash function rs 98.9% $36.57 205 trace →
34 nachoparker/dutree a tool to analyze file system usage written in Rust rs 98.9% $47.52 234 trace →
35 WGUNDERWOOD/tex-fmt An extremely fast LaTeX formatter written in Rust rs 98.9% $100.09 442 trace →
36 eliukblau/pixterm Draw images in your ANSI terminal with true color go 98.8% $25.36 147 trace →
37 wintermute-cell/ngrrram A TUI tool to help you type faster and learn new layouts. Includes a free cat. rs 98.7% $42.91 217 trace →
38 sharkdp/pastel A command-line tool to generate, analyze, convert and manipulate colors rs 98.7% $87.06 352 trace →
39 sclevine/yj CLI - Convert between YAML, TOML, JSON, and HCL. Preserves map order. go 98.6% $46.20 238 trace →
40 madler/pigz A parallel implementation of gzip for modern multi-processor, multi-core machines. c 98.6% $24.31 181 trace →
41 jarun/nnn n³ The unorthodox terminal file manager c 98.5% $78.92 381 trace →
42 BurntSushi/xsv A fast CSV command line toolkit written in Rust. rs 98.5% $101.89 334 trace →
43 eradman/entr Run arbitrary commands when files change c 98.3% $22.46 186 trace →
44 facebookresearch/fastText Library for fast text representation and classification. cpp 98.1% $23.54 149 trace →
45 svenstaro/miniserve 🌟 For when you really just want to serve some files over HTTP right now! rs 98.0% $95.37 426 trace →
46 ajeetdsouza/zoxide A smarter cd command. Supports all major shells. rs 97.9% $83.64 311 trace →
47 git-bahn/git-graph Command line tool to show clear git graphs arranged for your branching model rs 97.9% $102.01 358 trace →
48 xorg62/tty-clock Clock using lib ncurses c 97.9% $20.66 161 trace →
49 brocode/fblog Small command-line JSON Log viewer rs 97.9% $70.40 298 trace →
50 BurntSushi/ripgrep ripgrep recursively searches directories for a regex pattern while respecting your gitignore rs 97.7% $126.57 413 trace →
51 pier-cli/pier A CLI to organize and run short Unix shell scripts rs 97.5% $50.56 286 trace →
52 JohannesKaufmann/html-to-markdown ⚙️ Convert HTML to Markdown. Even works with entire websites and can be extended through rules. go 97.5% $24.08 175 trace →
53 tomarrell/wrapcheck A Go linter to check that errors from external packages are wrapped go 97.5% $16.09 127 trace →
54 kyoheiu/felix tui file manager with vim-like key mapping rs 97.4% $85.95 384 trace →
55 orf/gping Ping, but with a graph rs 97.3% $58.88 294 trace →
56 tomnomnom/gron Make JSON greppable! go 97.3% $14.54 111 trace →
57 sayanarijit/xplr A hackable, minimal, fast TUI file explorer rs 97.1% $78.47 344 trace →
58 ggreer/the_silver_searcher A code-searching tool similar to ack, but faster. c 97.0% $52.77 247 trace →
59 nikolassv/bartib A simple timetracker for the command line. It saves a log of all tracked activities as a plaintext file and allows you to create flexible reports. rs 96.9% $18.41 146 trace →
60 sharkdp/hyperfine A command-line benchmarking tool rs 96.9% $42.53 261 trace →
61 o2sh/onefetch Command-line Git information tool rs 96.7% $96.04 398 trace →
62 guumaster/hostctl Your dev tool to manage /etc/hosts like a pro! go 96.7% $32.35 259 trace →
63 hush-shell/hush Hush is a unix shell based on the Lua programming language rs 96.6% $71.83 422 trace →
64 Lymphatus/caesium-clt Caesium Command Line Tools - Lossy/lossless image compression tool rs 96.5% $32.05 212 trace →
65 hooklift/gowsdl WSDL2Go code generation as well as its SOAP proxy go 96.2% $35.79 215 trace →
66 TheZoraiz/ascii-image-converter A cross-platform command-line tool to convert images into ascii art and print them on the console. Now supports braille art! go 96.1% $51.76 267 trace →
67 naggie/dstask Git powered terminal-based todo/note manager -- markdown note page per task. Single binary! go 96.1% $97.14 455 trace →
68 antonmedv/walk Terminal file manager go 96.0% $53.96 241 trace →
69 blacknon/hwatch A modern alternative to the watch command, records the differences in execution results and can check this differences at after. rs 95.9% $78.94 300 trace →
70 oppiliappan/statix lints and suggestions for the nix programming language rs 95.8% $98.62 382 trace →
71 rs/curlie The power of curl, the ease of use of httpie. go 95.8% $18.53 146 trace →
72 XAMPPRocky/tokei Count your code, quickly. rs 95.5% $203.20 617 trace →
73 cordx56/rustowl Visualize Ownership and Lifetimes in Rust rs 95.4% $38.72 242 trace →
74 bensadeh/tailspin 🌀 A log file highlighter rs 95.3% $52.38 298 trace →
75 sheepla/pingu 🐧ping command but with pingu go 95.0% $8.03 74 trace →
76 yassinebridi/serpl A simple terminal UI for search and replace, ala VS Code. rs 95.0% $84.56 440 trace →
77 dalance/amber A code search / replace tool rs 94.9% $43.90 280 trace →
78 pls-rs/pls pls is a prettier and powerful ls(1) for the pros. rs 94.9% $53.59 297 trace →
79 elkowar/pipr A tool to interactively write shell pipelines. rs 94.8% $84.89 431 trace →
80 Isona/dirble Fast directory scanning and scraping tool rs 94.8% $59.78 338 trace →
81 jqlang/jq Command-line JSON processor c 94.7% $100.84 341 trace →
82 noborus/ov 🎑Feature-rich terminal-based text viewer. It is a so-called terminal pager. go 94.7% $21.33 174 trace →
83 lua/lua A copy of the Lua development repository, as seen by the Lua team. Mirrored irregularly. All communication should be through the Lua mailing list https://www.lua.org/lua-l.html c 94.7% $50.75 204 trace →
84 cweill/gotests Automatically generate Go test boilerplate from your source code. go 94.7% $59.14 366 trace →
85 kyoh86/richgo Enrich `go test` outputs with text decorations. go 94.7% $25.73 179 trace →
86 YS-L/flamelens Flamegraph viewer in the terminal rs 94.2% $84.97 330 trace →
87 rcoh/angle-grinder Slice and dice logs on the command line rs 94.1% $76.50 385 trace →
88 lfos/calcurse A text-based calendar and scheduling application c 94.0% $53.57 339 trace →
89 rust-lang/mdBook Create book from markdown files. Like Gitbook but implemented in Rust rs 94.0% $119.20 481 trace →
90 sibprogrammer/xq Command-line XML and HTML beautifier and content extractor go 93.8% $38.91 253 trace →
91 antonmedv/fx Terminal JSON viewer & processor go 93.8% $54.53 295 trace →
92 junegunn/fzf :cherry_blossom: A command-line fuzzy finder go 93.7% $51.90 254 trace →
93 rust-embedded/svd2rust Generate Rust register maps (`struct`s) from SVD files rs 93.2% $93.27 429 trace →
94 yoav-lavi/melody Melody is a language that compiles to regular expressions and aims to be more readable and maintainable rs 93.2% $22.60 175 trace →
95 cslarsen/jp2a Converts jpg images to ASCII c 93.2% $105.34 269 trace →
96 segmentio/chamber CLI for managing secrets go 93.1% $35.48 216 trace →
97 Nukesor/pueue :stars: Manage your shell commands. rs 93.1% $54.76 334 trace →
98 direnv/direnv unclutter your .profile go 93.1% $42.94 303 trace →
99 Esubaalew/run Universal multi-language runner and smart REPL written in Rust. rs 92.8% $45.41 334 trace →
100 mookid/diffr Yet another diff highlighting tool rs 92.7% $80.33 261 trace →
101 lz4/lz4 Extremely Fast Compression algorithm c 92.6% $30.91 198 trace →
102 noborus/trdsql CLI tool that can execute SQL queries on CSV, LTSV, JSON, YAML and TBLN. Can output to various formats. go 92.5% $50.60 307 trace →
103 yaa110/nomino Batch rename utility for developers rs 92.3% $24.36 204 trace →
104 ArthurSonzogni/json-tui A JSON terminal UI made in C++ cpp 92.2% $74.35 208 trace →
105 FiloSottile/age A simple, modern and secure encryption tool (and Go library) with small explicit keys, no config options, and UNIX-style composability. go 92.0% $46.45 218 trace →
106 codesnap-rs/codesnap 🦀️📸 Pure Rust tool to generate beautiful code snapshots, provide CLI and Library rs 91.9% $46.91 322 trace →
107 bootandy/dust A more intuitive version of du in rust rs 91.8% $71.18 297 trace →
108 mfridman/tparse CLI tool for summarizing go test output. Pipe friendly. CI/CD friendly. go 91.8% $36.01 222 trace →
109 hatoo/oha Ohayou(おはよう), HTTP load generator, inspired by rakyll/hey with tui animation. rs 91.5% $52.16 300 trace →
110 hairyhenderson/gomplate A flexible commandline tool for template rendering. Supports lots of local and remote datasources. go 91.2% $42.53 246 trace →
111 multiprocessio/dsq Commandline tool for running SQL queries against JSON, CSV, Excel, Parquet, and more. go 90.8% $41.46 268 trace →
112 robertdavidgraham/masscan TCP port scanner, spews SYN packets asynchronously, scanning entire Internet in under 5 minutes. c 90.2% $50.41 302 trace →
113 dundee/gdu Fast disk usage analyzer with console interface written in Go go 89.8% $79.04 383 trace →
114 HaliteChallenge/Halite @twosigma's first artificial intelligence programming challenge cpp 89.8% $42.45 238 trace →
115 peco/peco Simplistic interactive filtering tool go 89.6% $54.28 389 trace →
116 astaxie/bat Go implement CLI, cURL-like tool for humans go 89.3% $35.99 209 trace →
117 lh3/seqtk Toolkit for processing sequences in FASTA/Q formats c 88.3% $141.73 402 trace →
118 skeema/skeema Declarative pure-SQL schema management for MySQL and MariaDB go 88.3% $32.25 249 trace →
119 alexpovel/srgn A grep-like tool which understands source code syntax and allows for manipulation in addition to search rs 87.8% $81.76 292 trace →
120 konradsz/igrep Interactive Grep rs 87.8% $30.15 204 trace →
121 jhspetersson/fselect Find files with SQL-like queries rs 87.0% $98.31 469 trace →
122 foriequal0/git-trim Automatically trims your branches whose tracking remote refs are merged or stray rs 86.8% $34.76 260 trace →
123 jonas/tig Text-mode interface for git c 86.8% $52.79 269 trace →
124 sharkdp/bat A cat(1) clone with wings. rs 86.7% $89.82 356 trace →
125 svenstaro/genact 🌀 A nonsense activity generator rs 86.6% $67.92 355 trace →
126 Drew-Alleman/DataSurgeon Quickly Extracts IP's, Email Addresses, Hashes, Files, Credit Cards, Social Security Numbers and a lot More From Text rs 86.5% $39.23 300 trace →
127 cheat/cheat cheat allows you to create and view interactive cheatsheets on the command-line. It was designed to help remind *nix system administrators of options for commands that they use frequently, but not frequently enough to remember. go 86.2% $27.42 243 trace →
128 crowdagger/crowbook Converts books written in Markdown to HTML, LaTeX/PDF and EPUB rs 85.9% $118.23 503 trace →
129 sigoden/argc A Bash CLI framework, also a Bash command runner. rs 85.4% $119.80 534 trace →
130 Epistates/treemd A (TUI/CLI) markdown navigator with tree-based structural navigation. rs 85.1% $51.59 294 trace →
131 ducaale/xh Friendly and fast tool for sending HTTP requests rs 84.8% $109.61 482 trace →
132 stacked-git/stgit Stacked Git rs 82.8% $108.71 470 trace →
133 ariga/atlas Declarative schema migrations with schema-as-code workflows go 82.5% $46.17 242 trace →
134 gabotechs/dep-tree Tool for helping developers keep their code bases clean and decoupled. It allows visualising a code base complexity using a 3d force-directed graph of files and the dependencies between them. go 81.5% $56.43 337 trace →
135 sirwart/ripsecrets A command-line tool to prevent committing secret keys into your source code rs 79.7% $63.35 234 trace →
136 NikolaDucak/caps-log A small TUI journaling tool. 📖 cpp 79.7% $58.77 281 trace →
137 rochacbruno/marmite Markdown makes sites - A Static Site Generator for Blogs rs 76.8% $88.96 423 trace →
138 ecumene/rust-sloth A 3D software rasterizer... for the terminal! rs 75.5% $77.19 277 trace →
139 mkj/dropbear Dropbear SSH c 75.3% $49.32 264 trace →
140 incu6us/goimports-reviser Right imports sorting & code formatting tool (goimports alternative) go 74.9% $42.42 324 trace →
141 Canop/broot A new way to see and navigate directory trees : https://dystroy.org/broot rs 74.3% $44.01 191 trace →
142 mikefarah/yq yq is a portable command-line YAML, JSON, XML, CSV, TOML, HCL and properties processor go 73.7% $102.58 372 trace →
143 boyter/scc Sloc, Cloc and Code: scc is a very fast accurate code counter with complexity calculations and COCOMO estimates written in pure Go go 72.8% $87.44 346 trace →
144 unhappychoice/gittype A CLI code-typing game that turns your source code into typing challenges rs 70.3% $78.23 382 trace →
145 ip7z/7zip 7-Zip cpp 68.8% $22.59 164 trace →
146 dandavison/delta A syntax-highlighting pager for git, diff, grep, rg --json, and blame output rs 66.5% $92.02 371 trace →
147 jesseduffield/lazygit simple terminal UI for git commands go 66.2% $47.64 260 trace →
148 mgechev/revive 🔥 ~6x faster, stricter, configurable, extensible, and beautiful drop-in replacement for golint go 65.3% $40.71 237 trace →
149 rvben/rumdl Fast Markdown linter and formatter written in Rust rs 64.7% $119.42 480 trace →
150 ivanceras/svgbob Convert your ascii diagram scribbles into happy little SVG rs 64.6% $35.35 168 trace →
151 zk-org/zk Plain text note-taking assistant go 64.1% $24.42 187 trace →
152 arq5x/bedtools2 bedtools - the swiss army knife for genome arithmetic c 60.9% $22.67 176 trace →
153 parcel-bundler/lightningcss An extremely fast CSS parser, transformer, bundler, and minifier written in Rust. rs 60.3% $15.28 137 trace →
154 tree-sitter/tree-sitter An incremental parsing system for programming tools rs 58.7% $57.53 355 trace →
155 zevv/duc Dude, where are my bytes: Duc, a library and suite of tools for inspecting disk usage c 57.8% $28.43 216 trace →
156 ast-grep/ast-grep ⚡A CLI tool for code structural search, lint and rewriting. Written in Rust rs 57.2% $42.34 228 trace →
157 hpjansson/chafa 📺🗿 Terminal graphics for the 21st century. c 55.9% $24.34 132 trace →
158 typst/typst A markup-based typesetting system that is powerful and easy to learn. rs 52.8% $23.63 190 trace →
159 anordal/shellharden The corrective bash syntax highlighter rs 51.3% $112.85 403 trace →
160 rs/jplot iTerm2 expvar/JSON monitoring tool go 50.8% $50.73 235 trace →
161 samtools/samtools Tools (written in C using htslib) for manipulating next-generation sequencing data c 49.8% $25.84 156 trace →
162 chirlu/sox SoX, Swiss Army knife of sound processing c 49.2% $60.63 253 trace →
163 tukaani-project/xz XZ Utils c 46.5% $45.32 235 trace →
164 alecthomas/chroma A general purpose syntax highlighter in pure Go go 46.5% $40.55 212 trace →
165 axodotdev/oranda 🎁 generate beautiful landing pages for your developer tools rs 46.2% $60.82 333 trace →
166 stathissideris/ditaa ditaa is a small command-line utility that can convert diagrams drawn using ascii art ('drawings' that contain characters that resemble lines like | / - ), into proper bitmap graphics. java 36.8% $66.82 278 trace →
167 doxygen/doxygen Official doxygen git repository c 36.7% $25.33 205 trace →
168 jgm/pandoc Universal markup converter hs 29.1% $143.77 521 trace →
169 OSGeo/PROJ PROJ - Cartographic Projections and Coordinate Transformations Library cpp 27.6% $13.97 119 trace →
170 duckdb/duckdb DuckDB is an analytical in-process SQL database management system cpp 27.1% $45.12 243 trace →
171 danmar/cppcheck static analysis of C/C++ code cpp 24.8% $14.91 151 trace →
172 go-critic/go-critic The most opinionated Go source code linter for code audit. go 22.3% $16.62 141 trace →
173 tstack/lnav Log file navigator cpp 19.2% $30.56 264 trace →
174 OSGeo/gdal GDAL is an open source MIT licensed translator library for raster and vector geospatial data formats. cpp 19.2% $39.61 252 trace →
175 gromacs/gromacs Public/backup repository of the GROMACS molecular simulation toolkit. Please do not mine the metadata blindly; we use https://gitlab.com/gromacs/gromacs for code review and issue tracking. cpp 11.3% $12.02 129 trace →
176 google/brotli Brotli compression format c 1.1% $49.72 221 trace →
177 AmmarAbouZor/tui-journal Your journal app if you live in a terminal rs 0.0% $22.81 231 trace →
178 bellard/quickjs Public repository of the QuickJS Javascript Engine. c 0.0% $1.59 25 trace →
179 Canop/rhit A nginx log explorer rs 0.0% $8.30 63 trace →
180 cmatsuoka/figlet Claudio's FIGlet tree c 0.0% $14.67 153 trace →
181 facebook/zstd Zstandard - Fast real-time compression algorithm c 0.0% $12.66 106 trace →
182 FFmpeg/FFmpeg Mirror of https://git.ffmpeg.org/ffmpeg.git c 0.0% $6.33 53 trace →
183 htop-dev/htop htop - an interactive process viewer c 0.0% $5.52 73 trace →
184 johnkerl/miller Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON go 0.0% $7.60 104 trace →
185 LuaJIT/LuaJIT Mirror of the LuaJIT git repository c 0.0% $3.84 56 trace →
186 mgdm/htmlq Like jq, but for HTML. rs 0.0% $4.32 67 trace →
187 mibk/dupl a tool for code clone detection go 0.0% $1.91 30 trace →
188 ninja-build/ninja a small build system with a focus on speed cpp 0.0% $19.49 136 trace →
189 nuta/nsh A command-line shell like fish, but POSIX compatible. rs 0.0% $7.97 90 trace →
190 paradigmxyz/solar Blazingly fast, modular and contributor friendly Solidity compiler, written in Rust rs 0.0% $7.15 106 trace →
191 pemistahl/grex A command-line tool and Rust library with Python bindings for generating regular expressions from user-provided test cases rs 0.0% $17.74 116 trace →
192 php/php-src The PHP Interpreter c 0.0% $1.41 24 trace →
193 rust-ethereum/ethabi Encode and decode smart contract invocations rs 0.0% $3.07 46 trace →
194 sqlite/sqlite Official Git mirror of the SQLite source tree c 0.0% $7.13 70 trace →
195 Stranger6667/jsonschema A high-performance JSON Schema validator for Rust rs 0.0% $9.01 85 trace →
196 trasta298/keifu Git genealogy, untangled. A TUI for navigating commit graphs with color and clarity. rs 0.0% $57.50 296 trace →
197 universal-ctags/ctags A maintained ctags implementation c 0.0% $4.37 75 trace →
198 Y2Z/monolith ⬛️ CLI tool and library for saving complete web pages as a single HTML file rs 0.0% $11.60 127 trace →

Click a row to replay this run on that task, or the repository name to open the task