Check out our newest benchmark: SWE-sweep (<10% solved!)

Claude Fable 5.1 (xhigh)

Anthropic · mini-SWE-agent · Rank #2

9.0%
Resolved help_outline Percentage of instances fully solved as measured by hidden behavioral tests.
55.5%
Almost Resolved help_outline Instances where the agent's solution passes ≥ 95% of all hidden behavioral tests.
$11369
Total Cost help_outline Total API cost in USD across all task instances.
51,915
Total Calls help_outline Total number of LLM calls across all task instances.
196 instances
# Repository Lang Score Cost Calls
1 Byron/dua-cli View disk space usage and delete unwanted data, fast. rs 100.0% $76.36 353 trace →
2 ekzhang/bore ๐Ÿ•ณ bore is a simple CLI tool for making tunnels to localhost rs 100.0% $21.29 185 trace →
3 facebookresearch/fastText Library for fast text representation and classification. cpp 100.0% $15.60 85 trace →
4 ismaelgv/rnr A command-line tool to batch rename files and directories rs 100.0% $22.40 191 trace →
5 jrnxf/thokr โœจ sleek typing tui with visualized results and historical logging rs 100.0% $42.55 234 trace →
6 KSXGitHub/parallel-disk-usage Highly parallelized, blazing fast directory tree analyzer rs 100.0% $35.97 250 trace →
7 mgdm/htmlq Like jq, but for HTML. rs 100.0% $44.61 192 trace →
8 oppiliappan/eva a calculator REPL, similar to bc(1) rs 100.0% $65.40 262 trace →
9 psampaz/go-mod-outdated Find outdated dependencies of your Go projects. go-mod-outdated provides a table view of the go list -u -m -json all command which lists all dependencies of a Go project and their available minor and patch updates. It also provides a way to filter indirect dependencies and dependencies without updates. go 100.0% $10.57 80 trace →
10 raviqqe/muffet Fast website link checker in Go go 100.0% $26.08 198 trace →
11 rbakbashev/elfcat ELF visualizer. Generates HTML files from ELF binaries. rs 100.0% $20.69 171 trace →
12 shashwatah/jot โšกRapid note management for the terminal. rs 100.0% $38.66 272 trace →
13 sheepla/pingu ๐Ÿงping command but with pingu go 100.0% $7.58 69 trace →
14 simeg/eureka ๐Ÿ’ก CLI tool to input and store your ideas without leaving the terminal rs 100.0% $13.21 132 trace →
15 sitkevij/hex ๐Ÿ”ฎ Futuristic take on hexdump, made in Rust. rs 100.0% $15.90 121 trace →
16 sstadick/hck A sharp cut(1) clone. rs 100.0% $93.16 277 trace →
17 wintermute-cell/ngrrram A TUI tool to help you type faster and learn new layouts. Includes a free cat. rs 100.0% $22.54 177 trace →
18 yaa110/nomino Batch rename utility for developers rs 100.0% $14.94 172 trace →
19 ArthurSonzogni/json-tui A JSON terminal UI made in C++ cpp 99.9% $74.96 194 trace →
20 BurntSushi/ripgrep ripgrep recursively searches directories for a regex pattern while respecting your gitignore rs 99.8% $117.62 284 trace →
21 sharkdp/fd A simple, fast and user-friendly alternative to 'find' rs 99.8% $48.01 290 trace →
22 riquito/tuc When cut doesn't cut it rs 99.8% $43.20 243 trace →
23 clog-tool/clog-cli Generate beautiful changelogs from your Git commit history rs 99.8% $41.30 207 trace →
24 sharkdp/pastel A command-line tool to generate, analyze, convert and manipulate colors rs 99.8% $94.90 404 trace →
25 anordal/shellharden The corrective bash syntax highlighter rs 99.8% $110.24 381 trace →
26 abishekvashok/cmatrix Terminal based "The Matrix" like implementation c 99.8% $28.95 173 trace →
27 cmatsuoka/figlet Claudio's FIGlet tree c 99.8% $41.35 195 trace →
28 Stranger6667/jsonschema A high-performance JSON Schema validator for Rust rs 99.8% $102.76 402 trace →
29 htop-dev/htop htop - an interactive process viewer c 99.7% $55.77 255 trace →
30 wfxr/csview ๐Ÿ“  Pretty and fast csv viewer for cli with cjk/emoji support. rs 99.7% $19.04 166 trace →
31 wfxr/code-minimap ๐Ÿ›ฐ A high performance code minimap render. rs 99.7% $16.48 142 trace →
32 svenstaro/miniserve ๐ŸŒŸ For when you really just want to serve some files over HTTP right now! rs 99.7% $83.37 311 trace →
33 BurntSushi/xsv A fast CSV command line toolkit written in Rust. rs 99.7% $83.43 272 trace →
34 HaliteChallenge/Halite @twosigma's first artificial intelligence programming challenge cpp 99.6% $27.28 217 trace →
35 altdesktop/i3-style ๐ŸŽจ Make your i3 config a little more stylish. rs 99.6% $70.38 347 trace →
36 trasta298/keifu Git genealogy, untangled. A TUI for navigating commit graphs with color and clarity. rs 99.6% $87.16 379 trace →
37 pier-cli/pier A CLI to organize and run short Unix shell scripts rs 99.6% $44.28 230 trace →
38 BLAKE3-team/BLAKE3 the official Rust and C implementations of the BLAKE3 cryptographic hash function rs 99.5% $22.65 170 trace →
39 eradman/entr Run arbitrary commands when files change c 99.5% $24.17 177 trace →
40 cslarsen/jp2a Converts jpg images to ASCII c 99.4% $47.05 206 trace →
41 astro/deadnix Scan Nix files for dead code rs 99.3% $48.99 243 trace →
42 ninja-build/ninja a small build system with a focus on speed cpp 99.3% $54.04 245 trace →
43 kyoh86/richgo Enrich `go test` outputs with text decorations. go 99.3% $22.90 129 trace →
44 tarka/xcp An extended `cp` rs 99.2% $51.94 229 trace →
45 XAMPPRocky/tokei Count your code, quickly. rs 99.2% $145.12 468 trace →
46 kaushiksrini/parqeye Peek inside Parquet files right from your terminal rs 99.2% $85.08 352 trace →
47 pemistahl/grex A command-line tool and Rust library with Python bindings for generating regular expressions from user-provided test cases rs 99.2% $82.15 285 trace →
48 tomnomnom/gron Make JSON greppable! go 99.1% $22.22 159 trace →
49 ogham/dog A command-line DNS client. rs 99.1% $33.31 219 trace →
50 sayanarijit/xplr A hackable, minimal, fast TUI file explorer rs 99.0% $100.65 442 trace →
51 sharkdp/hexyl A command-line hex viewer rs 99.0% $32.37 233 trace →
52 kyoheiu/felix tui file manager with vim-like key mapping rs 99.0% $78.97 416 trace →
53 Lymphatus/caesium-clt Caesium Command Line Tools - Lossy/lossless image compression tool rs 99.0% $44.68 275 trace →
54 xorg62/tty-clock Clock using lib ncurses c 98.9% $14.38 158 trace →
55 rust-lang/mdBook Create book from markdown files. Like Gitbook but implemented in Rust rs 98.9% $102.67 457 trace →
56 nachoparker/dutree a tool to analyze file system usage written in Rust rs 98.9% $32.87 207 trace →
57 oppiliappan/statix lints and suggestions for the nix programming language rs 98.9% $69.24 318 trace →
58 Miserlou/Loop UNIX's missing `loop` command rs 98.9% $15.66 143 trace →
59 rhysd/kiro-editor A small terminal UTF-8 text editor written in Rust ๐Ÿ“๐Ÿฆ€ rs 98.8% $80.39 417 trace →
60 brocode/fblog Small command-line JSON Log viewer rs 98.8% $44.97 201 trace →
61 hooklift/gowsdl WSDL2Go code generation as well as its SOAP proxy go 98.7% $30.40 219 trace →
62 o2sh/onefetch Command-line Git information tool rs 98.6% $82.65 407 trace →
63 quinn-rs/quinn Async-friendly QUIC implementation in Rust rs 98.5% $26.80 193 trace →
64 jqlang/jq Command-line JSON processor c 98.4% $78.04 259 trace →
65 hush-shell/hush Hush is a unix shell based on the Lua programming language rs 98.3% $65.26 341 trace →
66 tomarrell/wrapcheck A Go linter to check that errors from external packages are wrapped go 98.3% $19.69 113 trace →
67 eudoxia0/hashcards A plain text-based spaced repetition system. rs 98.3% $49.62 303 trace →
68 ggreer/the_silver_searcher A code-searching tool similar to ack, but faster. c 98.3% $61.60 280 trace →
69 TheZoraiz/ascii-image-converter A cross-platform command-line tool to convert images into ascii art and print them on the console. Now supports braille art! go 98.3% $26.52 178 trace →
70 blacknon/hwatch A modern alternative to the watch command, records the differences in execution results and can check this differences at after. rs 98.2% $30.03 176 trace →
71 eliukblau/pixterm Draw images in your ANSI terminal with true color go 98.1% $25.39 143 trace →
72 lua/lua A copy of the Lua development repository, as seen by the Lua team. Mirrored irregularly. All communication should be through the Lua mailing list https://www.lua.org/lua-l.html c 98.1% $57.18 187 trace →
73 ajeetdsouza/zoxide A smarter cd command. Supports all major shells. rs 98.1% $22.96 175 trace →
74 rust-embedded/svd2rust Generate Rust register maps (`struct`s) from SVD files rs 98.0% $114.63 467 trace →
75 guumaster/hostctl Your dev tool to manage /etc/hosts like a pro! go 98.0% $28.05 224 trace →
76 kisielk/errcheck errcheck checks that you checked errors. go 97.9% $16.00 151 trace →
77 Y2Z/monolith โฌ›๏ธ CLI tool and library for saving complete web pages as a single HTML file rs 97.6% $84.51 379 trace →
78 yassinebridi/serpl A simple terminal UI for search and replace, ala VS Code. rs 97.6% $59.36 364 trace →
79 antonmedv/walk Terminal file manager go 97.4% $96.35 376 trace →
80 antonmedv/fx Terminal JSON viewer & processor go 97.4% $52.18 270 trace →
81 orf/gping Ping, but with a graph rs 97.3% $36.97 278 trace →
82 segmentio/chamber CLI for managing secrets go 97.3% $31.96 214 trace →
83 junegunn/fzf :cherry_blossom: A command-line fuzzy finder go 97.3% $60.97 263 trace →
84 sclevine/yj CLI - Convert between YAML, TOML, JSON, and HCL. Preserves map order. go 97.1% $48.95 151 trace →
85 rs/jplot iTerm2 expvar/JSON monitoring tool go 96.9% $46.78 235 trace →
86 bensadeh/tailspin ๐ŸŒ€ A log file highlighter rs 96.9% $51.14 282 trace →
87 rust-ethereum/ethabi Encode and decode smart contract invocations rs 96.7% $40.19 176 trace →
88 rs/curlie The power of curl, the ease of use of httpie. go 96.7% $20.74 147 trace →
89 nikolassv/bartib A simple timetracker for the command line. It saves a log of all tracked activities as a plaintext file and allows you to create flexible reports. rs 96.7% $25.69 194 trace →
90 git-bahn/git-graph Command line tool to show clear git graphs arranged for your branching model rs 96.7% $85.50 256 trace →
91 zevv/duc Dude, where are my bytes: Duc, a library and suite of tools for inspecting disk usage c 96.6% $55.85 324 trace →
92 sharkdp/hyperfine A command-line benchmarking tool rs 96.6% $30.15 218 trace →
93 cordx56/rustowl Visualize Ownership and Lifetimes in Rust rs 96.4% $52.27 273 trace →
94 dundee/gdu Fast disk usage analyzer with console interface written in Go go 96.4% $70.26 430 trace →
95 direnv/direnv unclutter your .profile go 96.3% $41.68 283 trace →
96 hairyhenderson/gomplate A flexible commandline tool for template rendering. Supports lots of local and remote datasources. go 96.3% $60.44 269 trace →
97 chmln/sd Intuitive find & replace CLI (sed alternative) rs 96.3% $9.17 113 trace →
98 WGUNDERWOOD/tex-fmt An extremely fast LaTeX formatter written in Rust rs 96.3% $67.43 321 trace →
99 Nukesor/pueue :stars: Manage your shell commands. rs 96.2% $64.65 389 trace →
100 ecumene/rust-sloth A 3D software rasterizer... for the terminal! rs 96.1% $72.31 309 trace →
101 alexpovel/srgn A grep-like tool which understands source code syntax and allows for manipulation in addition to search rs 96.0% $89.32 333 trace →
102 hatoo/oha Ohayou(ใŠใฏใ‚ˆใ†), HTTP load generator, inspired by rakyll/hey with tui animation. rs 95.9% $39.96 279 trace →
103 nuta/nsh A command-line shell like fish, but POSIX compatible. rs 95.7% $104.12 432 trace →
104 incu6us/goimports-reviser Right imports sorting & code formatting tool (goimports alternative) go 95.7% $27.29 222 trace →
105 svenstaro/genact ๐ŸŒ€ A nonsense activity generator rs 95.7% $96.23 392 trace →
106 multiprocessio/dsq Commandline tool for running SQL queries against JSON, CSV, Excel, Parquet, and more. go 95.6% $32.31 227 trace →
107 noborus/ov ๐ŸŽ‘Feature-rich terminal-based text viewer. It is a so-called terminal pager. go 95.5% $37.84 287 trace →
108 lfos/calcurse A text-based calendar and scheduling application c 95.3% $102.50 461 trace →
109 sibprogrammer/xq Command-line XML and HTML beautifier and content extractor go 95.3% $54.90 242 trace →
110 naggie/dstask Git powered terminal-based todo/note manager -- markdown note page per task. Single binary! go 95.2% $52.78 363 trace →
111 Canop/rhit A nginx log explorer rs 95.2% $126.49 292 trace →
112 jarun/nnn nยณ The unorthodox terminal file manager c 95.0% $42.67 337 trace →
113 chmln/handlr A better xdg-utils rs 94.9% $43.93 228 trace →
114 rcoh/angle-grinder Slice and dice logs on the command line rs 94.9% $64.28 293 trace →
115 noborus/trdsql CLI tool that can execute SQL queries on CSV, LTSV, JSON, YAML and TBLN. Can output to various formats. go 94.8% $33.87 220 trace →
116 konradsz/igrep Interactive Grep rs 94.8% $63.22 398 trace →
117 YS-L/flamelens Flamegraph viewer in the terminal rs 94.6% $82.64 347 trace →
118 skeema/skeema Declarative pure-SQL schema management for MySQL and MariaDB go 94.6% $45.51 269 trace →
119 mfridman/tparse CLI tool for summarizing go test output. Pipe friendly. CI/CD friendly. go 94.4% $26.54 195 trace →
120 dalance/amber A code search / replace tool rs 94.3% $41.99 226 trace →
121 sirwart/ripsecrets A command-line tool to prevent committing secret keys into your source code rs 94.3% $33.19 171 trace →
122 stathissideris/ditaa ditaa is a small command-line utility that can convert diagrams drawn using ascii art ('drawings' that contain characters that resemble lines like | / - ), into proper bitmap graphics. java 94.1% $111.75 389 trace →
123 Epistates/treemd A (TUI/CLI) markdown navigator with tree-based structural navigation. rs 94.0% $44.78 273 trace →
124 pls-rs/pls pls is a prettier and powerful ls(1) for the pros. rs 94.0% $56.85 299 trace →
125 mookid/diffr Yet another diff highlighting tool rs 93.7% $65.00 230 trace →
126 elkowar/pipr A tool to interactively write shell pipelines. rs 93.3% $40.56 332 trace →
127 yoav-lavi/melody Melody is a language that compiles to regular expressions and aims to be more readable and maintainable rs 93.2% $27.34 212 trace →
128 lz4/lz4 Extremely Fast Compression algorithm c 92.7% $55.99 253 trace →
129 peco/peco Simplistic interactive filtering tool go 92.3% $39.22 333 trace →
130 cheat/cheat cheat allows you to create and view interactive cheatsheets on the command-line. It was designed to help remind *nix system administrators of options for commands that they use frequently, but not frequently enough to remember. go 91.6% $33.00 174 trace →
131 bellard/quickjs Public repository of the QuickJS Javascript Engine. c 91.1% $106.74 358 trace →
132 jhspetersson/fselect Find files with SQL-like queries rs 90.5% $91.50 379 trace →
133 foriequal0/git-trim Automatically trims your branches whose tracking remote refs are merged or stray rs 90.4% $30.98 281 trace →
134 lh3/seqtk Toolkit for processing sequences in FASTA/Q formats c 90.2% $69.88 324 trace →
135 NikolaDucak/caps-log A small TUI journaling tool. ๐Ÿ“– cpp 89.5% $84.58 415 trace →
136 stacked-git/stgit Stacked Git rs 89.1% $122.75 468 trace →
137 sigoden/argc A Bash CLI framework, also a Bash command runner. rs 89.0% $77.86 419 trace →
138 astaxie/bat Go implement CLI, cURL-like tool for humans go 89.0% $25.71 174 trace →
139 jonas/tig Text-mode interface for git c 88.8% $82.05 360 trace →
140 bootandy/dust A more intuitive version of du in rust rs 88.4% $50.29 246 trace →
141 Canop/broot A new way to see and navigate directory trees : https://dystroy.org/broot rs 88.1% $108.94 366 trace →
142 gabotechs/dep-tree Tool for helping developers keep their code bases clean and decoupled. It allows visualising a code base complexity using a 3d force-directed graph of files and the dependencies between them. go 88.0% $51.36 294 trace →
143 FiloSottile/age A simple, modern and secure encryption tool (and Go library) with small explicit keys, no config options, and UNIX-style composability. go 87.9% $51.26 232 trace →
144 crowdagger/crowbook Converts books written in Markdown to HTML, LaTeX/PDF and EPUB rs 87.9% $101.91 404 trace →
145 sharkdp/bat A cat(1) clone with wings. rs 87.5% $82.80 359 trace →
146 LuaJIT/LuaJIT Mirror of the LuaJIT git repository c 87.3% $65.26 265 trace →
147 OSGeo/PROJ PROJ - Cartographic Projections and Coordinate Transformations Library cpp 87.1% $102.71 209 trace →
148 Drew-Alleman/DataSurgeon Quickly Extracts IP's, Email Addresses, Hashes, Files, Credit Cards, Social Security Numbers and a lot More From Text rs 86.7% $25.48 214 trace →
149 zk-org/zk Plain text note-taking assistant go 85.5% $52.89 290 trace →
150 ip7z/7zip 7-Zip cpp 84.8% $69.16 320 trace →
151 ariga/atlas Declarative schema migrations with schema-as-code workflows go 82.9% $35.22 151 trace →
152 chirlu/sox SoX, Swiss Army knife of sound processing c 80.3% $117.06 330 trace →
153 AmmarAbouZor/tui-journal Your journal app if you live in a terminal rs 80.1% $146.11 553 trace →
154 ducaale/xh Friendly and fast tool for sending HTTP requests rs 79.5% $69.99 366 trace →
155 rochacbruno/marmite Markdown makes sites - A Static Site Generator for Blogs rs 78.9% $75.27 330 trace →
156 mikefarah/yq yq is a portable command-line YAML, JSON, XML, CSV, TOML, HCL and properties processor go 78.3% $59.00 247 trace →
157 ivanceras/svgbob Convert your ascii diagram scribbles into happy little SVG rs 77.5% $75.43 266 trace →
158 typst/typst A markup-based typesetting system that is powerful and easy to learn. rs 77.3% $113.75 295 trace →
159 jesseduffield/lazygit simple terminal UI for git commands go 77.0% $87.36 472 trace →
160 dandavison/delta A syntax-highlighting pager for git, diff, grep, rg --json, and blame output rs 76.2% $89.32 333 trace →
161 parcel-bundler/lightningcss An extremely fast CSS parser, transformer, bundler, and minifier written in Rust. rs 75.2% $105.58 256 trace →
162 sqlite/sqlite Official Git mirror of the SQLite source tree c 74.2% $74.14 234 trace →
163 rvben/rumdl Fast Markdown linter and formatter written in Rust rs 73.9% $124.91 620 trace →
164 paradigmxyz/solar Blazingly fast, modular and contributor friendly Solidity compiler, written in Rust rs 73.3% $98.06 383 trace →
165 ast-grep/ast-grep โšกA CLI tool for code structural search, lint and rewriting. Written in Rust rs 71.4% $57.15 274 trace →
166 cweill/gotests Automatically generate Go test boilerplate from your source code. go 70.8% $37.24 233 trace →
167 johnkerl/miller Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON go 69.0% $64.51 283 trace →
168 codesnap-rs/codesnap ๐Ÿฆ€๏ธ๐Ÿ“ธ Pure Rust tool to generate beautiful code snapshots, provide CLI and Library rs 69.0% $47.85 287 trace →
169 samtools/samtools Tools (written in C using htslib) for manipulating next-generation sequencing data c 60.8% $84.79 286 trace →
170 duckdb/duckdb DuckDB is an analytical in-process SQL database management system cpp 52.0% $102.08 316 trace →
171 OSGeo/gdal GDAL is an open source MIT licensed translator library for raster and vector geospatial data formats. cpp 50.2% $46.08 193 trace →
172 boyter/scc Sloc, Cloc and Code: scc is a very fast accurate code counter with complexity calculations and COCOMO estimates written in pure Go go 48.3% $99.11 342 trace →
173 tukaani-project/xz XZ Utils c 47.4% $92.49 299 trace →
174 mgechev/revive ๐Ÿ”ฅ ~6x faster, stricter, configurable, extensible, and beautiful drop-in replacement for golint go 46.8% $97.86 359 trace →
175 tree-sitter/tree-sitter An incremental parsing system for programming tools rs 45.5% $167.83 390 trace →
176 tstack/lnav Log file navigator cpp 44.9% $79.83 249 trace →
177 axodotdev/oranda ๐ŸŽ generate beautiful landing pages for your developer tools rs 44.3% $40.46 234 trace →
178 danmar/cppcheck static analysis of C/C++ code cpp 44.3% $70.42 261 trace →
179 alecthomas/chroma A general purpose syntax highlighter in pure Go go 41.4% $33.02 161 trace →
180 doxygen/doxygen Official doxygen git repository c 38.0% $75.19 270 trace →
181 php/php-src The PHP Interpreter c 33.3% $98.42 316 trace →
182 tinycc/tinycc Unofficial mirror of mob development branch c 18.8% $93.11 288 trace →
183 universal-ctags/ctags A maintained ctags implementation c 14.2% $67.21 220 trace →
184 gromacs/gromacs Public/backup repository of the GROMACS molecular simulation toolkit. Please do not mine the metadata blindly; we use https://gitlab.com/gromacs/gromacs for code review and issue tracking. cpp 14.1% $21.19 210 trace →
185 go-critic/go-critic The most opinionated Go source code linter for code audit. go 13.8% $6.20 88 trace →
186 FFmpeg/FFmpeg Mirror of https://git.ffmpeg.org/ffmpeg.git c 10.5% $36.68 178 trace →
187 jgm/pandoc Universal markup converter hs 3.9% $82.02 210 trace →
188 agourlay/zip-password-finder Find the password of protected ZIP files. rs 0.0% $0.05 4 trace →
189 arq5x/bedtools2 bedtools - the swiss army knife for genome arithmetic c 0.0% $25.03 149 trace →
190 google/brotli Brotli compression format c 0.0% $59.72 127 trace →
191 hpjansson/chafa ๐Ÿ“บ๐Ÿ—ฟ Terminal graphics for the 21st century. c 0.0% $85.65 317 trace →
192 Isona/dirble Fast directory scanning and scraping tool rs 0.0% $15.01 144 trace →
193 JohannesKaufmann/html-to-markdown โš™๏ธ Convert HTML to Markdown. Even works with entire websites and can be extended through rules. go 0.0% $0.05 5 trace →
194 mibk/dupl a tool for code clone detection go 0.0% $97.76 213 trace →
195 mkj/dropbear Dropbear SSH c 0.0% $8.53 90 trace →
196 robertdavidgraham/masscan TCP port scanner, spews SYN packets asynchronously, scanning entire Internet in under 5 minutes. c 0.0% $0.15 5 trace →

Click a row to replay this run on that task, or the repository name to open the task