← Back to detailed results

Claude Sonnet 4.6

Anthropic · mini-SWE-agent · Rank #7

0%
Resolved help_outline Percentage of instances fully solved as measured by hidden behavioral tests.
1.0%
Almost Resolved help_outline Instances where the agent's solution passes ≥ 95% of all hidden behavioral tests.
$5347
Total Cost help_outline Total API cost in USD across all task instances.
94,373
Total Calls help_outline Total number of LLM calls across all task instances.

Score (Behavioral Test Pass Rate) Distribution

Per-Instance Results

200 instances
# Repository Lang Score Cost Calls
1 jarun/nnn nยณ The unorthodox terminal file manager c 96.6% $10.47 347
2 abishekvashok/cmatrix Terminal based "The Matrix" like implementation c 95.9% $13.49 292
3 clog-tool/clog-cli Generate beautiful changelogs from your Git commit history rs 93.0% $18.61 453
4 wfxr/csview ๐Ÿ“  Pretty and fast csv viewer for cli with cjk/emoji support. rs 92.5% $7.72 285
5 BLAKE3-team/BLAKE3 the official Rust and C implementations of the BLAKE3 cryptographic hash function rs 92.3% $4.51 213
6 sheepla/pingu ๐Ÿงping command but with pingu go 92.2% $3.78 175
7 tarka/xcp An extended `cp` rs 91.7% $8.99 330
8 google/brotli Brotli compression format c 90.7% $19.93 394
9 rust-ethereum/ethabi Encode and decode smart contract invocations rs 89.9% $12.55 407
10 eradman/entr Run arbitrary commands when files change c 88.6% $12.14 383
11 rs/curlie The power of curl, the ease of use of httpie. go 88.4% $25.25 518
12 riquito/tuc When cut doesn't cut it rs 88.1% $16.19 506
13 raviqqe/muffet Fast website link checker in Go go 88.1% $11.78 290
14 mgdm/htmlq Like jq, but for HTML. rs 88.0% $22.96 627
15 sstadick/hck A sharp cut(1) clone. rs 87.6% $15.93 374
16 noborus/ov ๐ŸŽ‘Feature-rich terminal-based text viewer. It is a so-called terminal pager. go 87.2% $13.13 389
17 rhysd/kiro-editor A small terminal UTF-8 text editor written in Rust ๐Ÿ“๐Ÿฆ€ rs 86.1% $33.62 628
18 Esubaalew/run Universal multi-language runner and smart REPL written in Rust. rs 85.2% $32.29 669
19 KSXGitHub/parallel-disk-usage Highly parallelized, blazing fast directory tree analyzer rs 85.1% $29.37 456
20 chmln/sd Intuitive find & replace CLI (sed alternative) rs 85.1% $3.76 181
21 tomnomnom/gron Make JSON greppable! go 84.4% $14.17 459
22 nikolassv/bartib A simple timetracker for the command line. It saves a log of all tracked activities as a plaintext file and allows you to create flexible reports. rs 84.3% $13.63 283
23 Byron/dua-cli View disk space usage and delete unwanted data, fast. rs 83.9% $22.21 502
24 oppiliappan/eva a calculator REPL, similar to bc(1) rs 83.9% $12.84 393
25 sharkdp/hexyl A command-line hex viewer rs 82.8% $32.57 443
26 guumaster/hostctl Your dev tool to manage /etc/hosts like a pro! go 82.8% $15.89 416
27 lz4/lz4 Extremely Fast Compression algorithm c 82.7% $25.44 501
28 JohannesKaufmann/html-to-markdown โš™๏ธ Convert HTML to Markdown. Even works with entire websites and can be extended through rules. go 81.9% $18.69 503
29 anordal/shellharden The corrective bash syntax highlighter rs 81.7% $74.50 840
30 rbakbashev/elfcat ELF visualizer. Generates HTML files from ELF binaries. rs 81.6% $23.39 403
31 astro/deadnix Scan Nix files for dead code rs 81.4% $12.78 294
32 junegunn/fzf :cherry_blossom: A command-line fuzzy finder go 81.1% $29.33 607
33 chmln/handlr A better xdg-utils rs 81.0% $19.64 522
34 mookid/diffr Yet another diff highlighting tool rs 80.7% $27.33 384
35 nuta/nsh A command-line shell like fish, but POSIX compatible. rs 80.6% $27.07 496
36 BurntSushi/xsv A fast CSV command line toolkit written in Rust. rs 80.6% $15.53 367
37 multiprocessio/dsq Commandline tool for running SQL queries against JSON, CSV, Excel, Parquet, and more. go 80.3% $32.92 610
38 yaa110/nomino Batch rename utility for developers rs 79.9% $19.28 518
39 BurntSushi/ripgrep ripgrep recursively searches directories for a regex pattern while respecting your gitignore rs 79.7% $19.39 508
40 git-bahn/git-graph Command line tool to show clear git graphs arranged for your branching model rs 79.6% $49.86 658
41 agourlay/zip-password-finder Find the password of protected ZIP files. rs 79.1% $8.63 295
42 nachoparker/dutree a tool to analyze file system usage written in Rust rs 78.3% $17.62 335
43 ismaelgv/rnr A command-line tool to batch rename files and directories rs 78.0% $20.12 374
44 altdesktop/i3-style ๐ŸŽจ Make your i3 config a little more stylish. rs 77.9% $16.07 322
45 kyoh86/richgo Enrich `go test` outputs with text decorations. go 77.7% $8.23 313
46 svenstaro/miniserve ๐ŸŒŸ For when you really just want to serve some files over HTTP right now! rs 76.6% $25.03 420
47 hush-shell/hush Hush is a unix shell based on the Lua programming language rs 76.6% $67.34 1,000
48 skeema/skeema Declarative pure-SQL schema management for MySQL and MariaDB go 76.5% $16.73 416
49 ogham/dog A command-line DNS client. rs 76.5% $7.18 249
50 mfridman/tparse CLI tool for summarizing go test output. Pipe friendly. CI/CD friendly. go 76.0% $21.05 361
51 bensadeh/tailspin ๐ŸŒ€ A log file highlighter rs 75.8% $58.91 840
52 cordx56/rustowl Visualize Ownership and Lifetimes in Rust rs 75.2% $10.43 237
53 sibprogrammer/xq Command-line XML and HTML beautifier and content extractor go 75.0% $26.84 625
54 eliukblau/pixterm Draw images in your ANSI terminal with true color go 74.9% $24.61 335
55 madler/pigz A parallel implementation of gzip for modern multi-processor, multi-core machines. c 74.8% $11.64 343
56 sharkdp/fd A simple, fast and user-friendly alternative to 'find' rs 74.8% $17.57 384
57 hairyhenderson/gomplate A flexible commandline tool for template rendering. Supports lots of local and remote datasources. go 74.7% $22.13 450
58 peco/peco Simplistic interactive filtering tool go 74.6% $15.96 351
59 rust-embedded/svd2rust Generate Rust register maps (`struct`s) from SVD files rs 72.9% $25.43 389
60 hatoo/oha Ohayou(ใŠใฏใ‚ˆใ†), HTTP load generator, inspired by rakyll/hey with tui animation. rs 72.5% $19.74 435
61 incu6us/goimports-reviser Right imports sorting & code formatting tool (goimports alternative) go 72.3% $17.06 441
62 sitkevij/hex ๐Ÿ”ฎ Futuristic take on hexdump, made in Rust. rs 72.3% $11.60 392
63 mibk/dupl a tool for code clone detection go 71.6% $45.63 514
64 psampaz/go-mod-outdated Find outdated dependencies of your Go projects. go-mod-outdated provides a table view of the go list -u -m -json all command which lists all dependencies of a Go project and their available minor and patch updates. It also provides a way to filter indirect dependencies and dependencies without updates. go 71.6% $1.13 100
65 wfxr/code-minimap ๐Ÿ›ฐ A high performance code minimap render. rs 71.6% $14.48 348
66 LuaJIT/LuaJIT Mirror of the LuaJIT git repository c 71.5% $31.45 520
67 dalance/amber A code search / replace tool rs 71.1% $23.27 507
68 dundee/gdu Fast disk usage analyzer with console interface written in Go go 70.1% $21.13 532
69 ajeetdsouza/zoxide A smarter cd command. Supports all major shells. rs 69.9% $14.61 368
70 XAMPPRocky/tokei Count your code, quickly. rs 69.5% $21.30 409
71 alexpovel/srgn A grep-like tool which understands source code syntax and allows for manipulation in addition to search rs 69.5% $19.30 565
72 Drew-Alleman/DataSurgeon Quickly Extracts IP's, Email Addresses, Hashes, Files, Credit Cards, Social Security Numbers and a lot More From Text rs 69.1% $13.76 462
73 facebook/zstd Zstandard - Fast real-time compression algorithm c 68.8% $15.29 375
74 bootandy/dust A more intuitive version of du in rust rs 68.7% $45.15 499
75 facebookresearch/fastText Library for fast text representation and classification. cpp 68.6% $13.78 294
76 shashwatah/jot โšกRapid note management for the terminal. rs 68.4% $9.27 374
77 ninja-build/ninja a small build system with a focus on speed cpp 67.5% $18.29 400
78 cmatsuoka/figlet Claudio's FIGlet tree c 67.0% $44.94 645
79 gabotechs/dep-tree Tool for helping developers keep their code bases clean and decoupled. It allows visualising a code base complexity using a 3d force-directed graph of files and the dependencies between them. go 65.2% $38.29 585
80 lh3/seqtk Toolkit for processing sequences in FASTA/Q formats c 64.8% $19.13 482
81 astaxie/bat Go implement CLI, cURL-like tool for humans go 64.5% $18.12 365
82 xorg62/tty-clock Clock using lib ncurses c 64.4% $12.01 192
83 FiloSottile/age A simple, modern and secure encryption tool (and Go library) with small explicit keys, no config options, and UNIX-style composability. go 63.5% $43.00 547
84 hooklift/gowsdl WSDL2Go code generation as well as its SOAP proxy go 62.4% $60.18 801
85 segmentio/chamber CLI for managing secrets go 62.1% $14.17 359
86 konradsz/igrep Interactive Grep rs 60.5% $10.26 279
87 sharkdp/bat A cat(1) clone with wings. rs 60.5% $21.25 514
88 crowdagger/crowbook Converts books written in Markdown to HTML, LaTeX/PDF and EPUB rs 60.3% $85.27 937
89 ggreer/the_silver_searcher A code-searching tool similar to ack, but faster. c 59.3% $13.76 443
90 svenstaro/genact ๐ŸŒ€ A nonsense activity generator rs 59.1% $17.93 298
91 orf/gping Ping, but with a graph rs 58.7% $11.38 271
92 pls-rs/pls pls is a prettier and powerful ls(1) for the pros. rs 58.4% $40.54 680
93 hpjansson/chafa ๐Ÿ“บ๐Ÿ—ฟ Terminal graphics for the 21st century. c 58.4% $50.80 532
94 naggie/dstask Git powered terminal-based todo/note manager -- markdown note page per task. Single binary! go 58.2% $31.15 632
95 wintermute-cell/ngrrram A TUI tool to help you type faster and learn new layouts. Includes a free cat. rs 58.1% $39.89 576
96 direnv/direnv unclutter your .profile go 57.6% $20.85 417
97 YS-L/flamelens Flamegraph viewer in the terminal rs 57.6% $43.26 490
98 quinn-rs/quinn Async-friendly QUIC implementation in Rust rs 57.3% $16.65 375
99 foriequal0/git-trim Automatically trims your branches whose tracking remote refs are merged or stray rs 57.0% $13.30 334
100 kisielk/errcheck errcheck checks that you checked errors. go 56.6% $17.09 426
101 Canop/broot A new way to see and navigate directory trees : https://dystroy.org/broot rs 56.4% $23.30 406
102 pemistahl/grex A command-line tool and Rust library with Python bindings for generating regular expressions from user-provided test cases rs 56.3% $48.82 743
103 rust-lang/mdBook Create book from markdown files. Like Gitbook but implemented in Rust rs 55.5% $50.89 644
104 TheZoraiz/ascii-image-converter A cross-platform command-line tool to convert images into ascii art and print them on the console. Now supports braille art! go 53.8% $36.37 584
105 axodotdev/oranda ๐ŸŽ generate beautiful landing pages for your developer tools rs 53.6% $21.15 501
106 Epistates/treemd A (TUI/CLI) markdown navigator with tree-based structural navigation. rs 53.3% $29.34 585
107 Canop/rhit A nginx log explorer rs 52.5% $40.64 458
108 ArthurSonzogni/json-tui A JSON terminal UI made in C++ cpp 52.3% $27.61 444
109 cweill/gotests Automatically generate Go test boilerplate from your source code. go 52.2% $31.36 542
110 Isona/dirble Fast directory scanning and scraping tool rs 51.8% $15.98 345
111 jesseduffield/lazygit simple terminal UI for git commands go 51.2% $8.11 206
112 cheat/cheat cheat allows you to create and view interactive cheatsheets on the command-line. It was designed to help remind *nix system administrators of options for commands that they use frequently, but not frequently enough to remember. go 50.5% $14.36 373
113 parcel-bundler/lightningcss An extremely fast CSS parser, transformer, bundler, and minifier written in Rust. rs 49.9% $45.82 705
114 robertdavidgraham/masscan TCP port scanner, spews SYN packets asynchronously, scanning entire Internet in under 5 minutes. c 48.8% $14.79 500
115 antonmedv/walk Terminal file manager go 48.3% $23.52 407
116 ekzhang/bore ๐Ÿ•ณ bore is a simple CLI tool for making tunnels to localhost rs 48.2% $8.25 225
117 rs/jplot iTerm2 expvar/JSON monitoring tool go 47.7% $31.83 344
118 Miserlou/Loop UNIX's missing `loop` command rs 45.8% $7.56 370
119 ecumene/rust-sloth A 3D software rasterizer... for the terminal! rs 45.5% $83.70 578
120 sigoden/argc A Bash CLI framework, also a Bash command runner. rs 44.1% $79.14 919
121 zk-org/zk Plain text note-taking assistant go 43.1% $24.25 494
122 paradigmxyz/solar Blazingly fast, modular and contributor friendly Solidity compiler, written in Rust rs 42.9% $15.75 367
123 simeg/eureka ๐Ÿ’ก CLI tool to input and store your ideas without leaving the terminal rs 42.7% $10.77 364
124 cslarsen/jp2a Converts jpg images to ASCII c 42.2% $45.93 495
125 mkj/dropbear Dropbear SSH c 41.6% $67.81 600
126 go-critic/go-critic The most opinionated Go source code linter for code audit. go 41.6% $34.12 677
127 ivanceras/svgbob Convert your ascii diagram scribbles into happy little SVG rs 41.3% $43.75 744
128 mikefarah/yq yq is a portable command-line YAML, JSON, XML, CSV, TOML, HCL and properties processor go 39.5% $35.51 532
129 boyter/scc Sloc, Cloc and Code: scc is a very fast accurate code counter with complexity calculations and COCOMO estimates written in pure Go go 37.7% $46.35 593
130 WGUNDERWOOD/tex-fmt An extremely fast LaTeX formatter written in Rust rs 37.4% $21.46 460
131 dandavison/delta A syntax-highlighting pager for git, diff, grep, rg --json, and blame output rs 37.3% $34.08 470
132 tree-sitter/tree-sitter An incremental parsing system for programming tools rs 37.2% $15.00 402
133 tomarrell/wrapcheck A Go linter to check that errors from external packages are wrapped go 36.0% $11.82 325
134 lua/lua A copy of the Lua development repository, as seen by the Lua team. Mirrored irregularly. All communication should be through the Lua mailing list https://www.lua.org/lua-l.html c 34.7% $138.99 993
135 mgechev/revive ๐Ÿ”ฅ ~6x faster, stricter, configurable, extensible, and beautiful drop-in replacement for golint go 34.1% $17.26 476
136 ip7z/7zip 7-Zip cpp 33.9% $19.38 343
137 ducaale/xh Friendly and fast tool for sending HTTP requests rs 33.6% $45.79 702
138 chirlu/sox SoX, Swiss Army knife of sound processing c 29.2% $13.13 287
139 OSGeo/gdal GDAL is an open source MIT licensed translator library for raster and vector geospatial data formats. cpp 25.4% $48.10 684
140 OSGeo/PROJ PROJ - Cartographic Projections and Coordinate Transformations Library cpp 22.3% $19.26 427
141 sharkdp/hyperfine A command-line benchmarking tool rs 19.2% $31.21 546
142 stathissideris/ditaa ditaa is a small command-line utility that can convert diagrams drawn using ascii art ('drawings' that contain characters that resemble lines like | / - ), into proper bitmap graphics. java 16.9% $38.31 461
143 alecthomas/chroma A general purpose syntax highlighter in pure Go go 16.1% $37.36 565
144 HaliteChallenge/Halite @twosigma's first artificial intelligence programming challenge cpp 14.2% $38.69 494
145 jgm/pandoc Universal markup converter hs 14.1% $35.83 568
146 sayanarijit/xplr A hackable, minimal, fast TUI file explorer rs 13.8% $19.67 407
147 universal-ctags/ctags A maintained ctags implementation c 13.3% $58.28 659
148 kaushiksrini/parqeye Peek inside Parquet files right from your terminal rs 13.2% $91.59 720
149 zevv/duc Dude, where are my bytes: Duc, a library and suite of tools for inspecting disk usage c 11.8% $30.03 441
150 oppiliappan/statix lints and suggestions for the nix programming language rs 11.3% $24.17 391
151 rochacbruno/marmite Markdown makes sites - A Static Site Generator for Blogs rs 11.2% $57.18 790
152 NikolaDucak/caps-log A small TUI journaling tool. ๐Ÿ“– cpp 10.0% $23.74 425
153 ariga/atlas Declarative schema migrations with schema-as-code workflows go 9.3% $35.07 626
154 tinycc/tinycc Unofficial mirror of mob development branch c 9.3% $100.12 879
155 tukaani-project/xz XZ Utils c 8.8% $24.28 507
156 AmmarAbouZor/tui-journal Your journal app if you live in a terminal rs 8.6% $35.70 579
157 ast-grep/ast-grep โšกA CLI tool for code structural search, lint and rewriting. Written in Rust rs 8.0% $28.64 621
158 codesnap-rs/codesnap ๐Ÿฆ€๏ธ๐Ÿ“ธ Pure Rust tool to generate beautiful code snapshots, provide CLI and Library rs 7.4% $20.92 395
159 sirwart/ripsecrets A command-line tool to prevent committing secret keys into your source code rs 7.4% $65.81 845
160 htop-dev/htop htop - an interactive process viewer c 7.2% $11.57 259
161 lfos/calcurse A text-based calendar and scheduling application c 7.1% $31.57 528
162 yassinebridi/serpl A simple terminal UI for search and replace, ala VS Code. rs 6.5% $17.28 310
163 eudoxia0/hashcards A plain text-based spaced repetition system. rs 6.1% $51.19 537
164 Lymphatus/caesium-clt Caesium Command Line Tools - Lossy/lossless image compression tool rs 5.7% $8.73 350
165 gromacs/gromacs Public/backup repository of the GROMACS molecular simulation toolkit. Please do not mine the metadata blindly; we use https://gitlab.com/gromacs/gromacs for code review and issue tracking. cpp 5.0% $32.36 562
166 FFmpeg/FFmpeg Mirror of https://git.ffmpeg.org/ffmpeg.git c 4.5% $12.51 273
167 antonmedv/fx Terminal JSON viewer & processor go 4.3% $25.98 621
168 stacked-git/stgit Stacked Git rs 4.0% $31.22 581
169 yoav-lavi/melody Melody is a language that compiles to regular expressions and aims to be more readable and maintainable rs 3.4% $16.67 502
170 danmar/cppcheck static analysis of C/C++ code cpp 3.1% $15.02 370
171 noborus/trdsql CLI tool that can execute SQL queries on CSV, LTSV, JSON, YAML and TBLN. Can output to various formats. go 3.0% $12.60 413
172 pier-cli/pier A CLI to organize and run short Unix shell scripts rs 2.9% $4.77 211
173 rvben/rumdl Fast Markdown linter and formatter written in Rust rs 2.8% $63.87 785
174 elkowar/pipr A tool to interactively write shell pipelines. rs 2.7% $22.65 354
175 jhspetersson/fselect Find files with SQL-like queries rs 2.5% $20.11 479
176 Y2Z/monolith โฌ›๏ธ CLI tool and library for saving complete web pages as a single HTML file rs 2.4% $14.72 406
177 o2sh/onefetch Command-line Git information tool rs 2.3% $33.45 604
178 sclevine/yj CLI - Convert between YAML, TOML, JSON, and HCL. Preserves map order. go 2.0% $25.56 730
179 blacknon/hwatch A modern alternative to the watch command, records the differences in execution results and can check this differences at after. rs 1.9% $14.13 378
180 Nukesor/pueue :stars: Manage your shell commands. rs 1.6% $15.46 231
181 sqlite/sqlite Official Git mirror of the SQLite source tree c 1.3% $28.86 573
182 samtools/samtools Tools (written in C using htslib) for manipulating next-generation sequencing data c 1.3% $26.62 457
183 brocode/fblog Small command-line JSON Log viewer rs 1.3% $13.91 400
184 doxygen/doxygen Official doxygen git repository c 1.3% $28.02 525
185 jqlang/jq Command-line JSON processor c 1.0% $4.40 289
186 unhappychoice/gittype A CLI code-typing game that turns your source code into typing challenges rs 1.0% $18.17 396
187 rcoh/angle-grinder Slice and dice logs on the command line rs 0.4% $37.01 660
188 Stranger6667/jsonschema A high-performance JSON Schema validator for Rust rs 0.2% $15.32 406
189 arq5x/bedtools2 bedtools - the swiss army knife for genome arithmetic c 0.2% $24.91 426
190 bellard/quickjs Public repository of the QuickJS Javascript Engine. c 0.0% $82.98 995
191 duckdb/duckdb DuckDB is an analytical in-process SQL database management system cpp 0.0% $8.24 288
192 johnkerl/miller Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON go 0.0% $5.77 286
193 jonas/tig Text-mode interface for git c 0.0% $14.93 382
194 jrnxf/thokr โœจ sleek typing tui with visualized results and historical logging rs 0.0% $44.83 668
195 kyoheiu/felix tui file manager with vim-like key mapping rs 0.0% $4.16 360
196 php/php-src The PHP Interpreter c 0.0% $7.38 326
197 sharkdp/pastel A command-line tool to generate, analyze, convert and manipulate colors rs 0.0% $6.72 321
198 trasta298/keifu Git genealogy, untangled. A TUI for navigating commit graphs with color and clarity. rs 0.0% $5.25 270
199 tstack/lnav Log file navigator cpp 0.0% $3.96 395
200 typst/typst A markup-based typesetting system that is powerful and easy to learn. rs 0.0% $52.50 855

Click row to see task details