← Back to detailed results

GPT 5.5

OpenAI · mini-SWE-agent · Rank #6

0%
Resolved help_outline Percentage of instances fully solved as measured by hidden behavioral tests.
1.5%
Almost Resolved help_outline Instances where the agent's solution passes ≥ 95% of all hidden behavioral tests.
$241
Total Cost help_outline Total API cost in USD across all task instances.
3,723
Total Calls help_outline Total number of LLM calls across all task instances.

Score (Behavioral Test Pass Rate) Distribution

Per-Instance Results

200 instances
# Repository Lang Score Cost Calls
1 abishekvashok/cmatrix Terminal based "The Matrix" like implementation c 99.2% $1.04 17
2 wintermute-cell/ngrrram A TUI tool to help you type faster and learn new layouts. Includes a free cat. rs 96.7% $1.51 25
3 jarun/nnn nยณ The unorthodox terminal file manager c 96.4% $1.22 17
4 wfxr/csview ๐Ÿ“  Pretty and fast csv viewer for cli with cjk/emoji support. rs 93.1% $0.75 12
5 clog-tool/clog-cli Generate beautiful changelogs from your Git commit history rs 92.7% $1.90 31
6 BLAKE3-team/BLAKE3 the official Rust and C implementations of the BLAKE3 cryptographic hash function rs 92.4% $1.06 15
7 sstadick/hck A sharp cut(1) clone. rs 91.8% $0.73 13
8 agourlay/zip-password-finder Find the password of protected ZIP files. rs 90.3% $1.19 22
9 sirwart/ripsecrets A command-line tool to prevent committing secret keys into your source code rs 88.7% $0.74 16
10 kyoheiu/felix tui file manager with vim-like key mapping rs 88.0% $1.12 22
11 sheepla/pingu ๐Ÿงping command but with pingu go 88.0% $0.93 19
12 altdesktop/i3-style ๐ŸŽจ Make your i3 config a little more stylish. rs 87.2% $2.21 28
13 kyoh86/richgo Enrich `go test` outputs with text decorations. go 87.2% $1.25 20
14 shashwatah/jot โšกRapid note management for the terminal. rs 86.4% $0.94 15
15 chmln/sd Intuitive find & replace CLI (sed alternative) rs 86.0% $0.87 17
16 mgdm/htmlq Like jq, but for HTML. rs 84.3% $0.99 17
17 jonas/tig Text-mode interface for git c 84.2% $0.82 16
18 madler/pigz A parallel implementation of gzip for modern multi-processor, multi-core machines. c 84.2% $1.03 17
19 mibk/dupl a tool for code clone detection go 84.2% $1.02 15
20 simeg/eureka ๐Ÿ’ก CLI tool to input and store your ideas without leaving the terminal rs 84.0% $1.10 20
21 yaa110/nomino Batch rename utility for developers rs 83.4% $1.30 27
22 jrnxf/thokr โœจ sleek typing tui with visualized results and historical logging rs 83.4% $1.04 19
23 sitkevij/hex ๐Ÿ”ฎ Futuristic take on hexdump, made in Rust. rs 82.7% $1.00 15
24 psampaz/go-mod-outdated Find outdated dependencies of your Go projects. go-mod-outdated provides a table view of the go list -u -m -json all command which lists all dependencies of a Go project and their available minor and patch updates. It also provides a way to filter indirect dependencies and dependencies without updates. go 82.5% $0.85 15
25 chmln/handlr A better xdg-utils rs 82.4% $1.20 22
26 rs/curlie The power of curl, the ease of use of httpie. go 82.3% $1.21 23
27 ismaelgv/rnr A command-line tool to batch rename files and directories rs 81.7% $1.10 19
28 hooklift/gowsdl WSDL2Go code generation as well as its SOAP proxy go 80.6% $1.60 28
29 rhysd/kiro-editor A small terminal UTF-8 text editor written in Rust ๐Ÿ“๐Ÿฆ€ rs 80.5% $1.09 19
30 antonmedv/walk Terminal file manager go 80.4% $1.30 20
31 svenstaro/miniserve ๐ŸŒŸ For when you really just want to serve some files over HTTP right now! rs 80.3% $1.24 16
32 astro/deadnix Scan Nix files for dead code rs 80.1% $1.74 20
33 blacknon/hwatch A modern alternative to the watch command, records the differences in execution results and can check this differences at after. rs 80.0% $1.67 23
34 HaliteChallenge/Halite @twosigma's first artificial intelligence programming challenge cpp 80.0% $1.06 17
35 anordal/shellharden The corrective bash syntax highlighter rs 79.7% $1.16 18
36 astaxie/bat Go implement CLI, cURL-like tool for humans go 79.4% $1.16 17
37 nachoparker/dutree a tool to analyze file system usage written in Rust rs 79.1% $1.14 17
38 raviqqe/muffet Fast website link checker in Go go 78.8% $1.37 19
39 Byron/dua-cli View disk space usage and delete unwanted data, fast. rs 78.3% $1.28 25
40 sharkdp/pastel A command-line tool to generate, analyze, convert and manipulate colors rs 77.8% $1.84 21
41 JohannesKaufmann/html-to-markdown โš™๏ธ Convert HTML to Markdown. Even works with entire websites and can be extended through rules. go 77.7% $0.78 15
42 tomnomnom/gron Make JSON greppable! go 77.7% $1.19 25
43 eudoxia0/hashcards A plain text-based spaced repetition system. rs 77.6% $2.18 28
44 xorg62/tty-clock Clock using lib ncurses c 77.6% $1.24 16
45 junegunn/fzf :cherry_blossom: A command-line fuzzy finder go 77.6% $0.97 17
46 BurntSushi/xsv A fast CSV command line toolkit written in Rust. rs 77.2% $1.18 21
47 Lymphatus/caesium-clt Caesium Command Line Tools - Lossy/lossless image compression tool rs 76.3% $1.35 23
48 pier-cli/pier A CLI to organize and run short Unix shell scripts rs 76.3% $1.20 18
49 eradman/entr Run arbitrary commands when files change c 75.8% $0.86 19
50 wfxr/code-minimap ๐Ÿ›ฐ A high performance code minimap render. rs 75.7% $0.88 13
51 htop-dev/htop htop - an interactive process viewer c 75.6% $0.80 13
52 ogham/dog A command-line DNS client. rs 75.4% $1.32 20
53 oppiliappan/eva a calculator REPL, similar to bc(1) rs 74.9% $1.18 22
54 git-bahn/git-graph Command line tool to show clear git graphs arranged for your branching model rs 74.8% $1.29 21
55 mookid/diffr Yet another diff highlighting tool rs 74.8% $0.89 15
56 lz4/lz4 Extremely Fast Compression algorithm c 74.5% $0.88 15
57 rust-ethereum/ethabi Encode and decode smart contract invocations rs 74.3% $0.98 15
58 konradsz/igrep Interactive Grep rs 74.0% $1.02 20
59 KSXGitHub/parallel-disk-usage Highly parallelized, blazing fast directory tree analyzer rs 73.6% $1.01 14
60 sibprogrammer/xq Command-line XML and HTML beautifier and content extractor go 72.7% $0.87 16
61 Esubaalew/run Universal multi-language runner and smart REPL written in Rust. rs 72.6% $0.82 14
62 dalance/amber A code search / replace tool rs 72.6% $0.78 20
63 sharkdp/fd A simple, fast and user-friendly alternative to 'find' rs 72.6% $1.04 15
64 noborus/ov ๐ŸŽ‘Feature-rich terminal-based text viewer. It is a so-called terminal pager. go 72.5% $1.55 22
65 segmentio/chamber CLI for managing secrets go 71.3% $1.20 18
66 zevv/duc Dude, where are my bytes: Duc, a library and suite of tools for inspecting disk usage c 71.1% $1.19 17
67 Drew-Alleman/DataSurgeon Quickly Extracts IP's, Email Addresses, Hashes, Files, Credit Cards, Social Security Numbers and a lot More From Text rs 70.1% $0.91 14
68 mfridman/tparse CLI tool for summarizing go test output. Pipe friendly. CI/CD friendly. go 70.1% $1.50 23
69 AmmarAbouZor/tui-journal Your journal app if you live in a terminal rs 70.0% $1.26 21
70 brocode/fblog Small command-line JSON Log viewer rs 70.0% $0.83 12
71 o2sh/onefetch Command-line Git information tool rs 69.0% $1.42 16
72 rs/jplot iTerm2 expvar/JSON monitoring tool go 69.0% $1.90 28
73 alexpovel/srgn A grep-like tool which understands source code syntax and allows for manipulation in addition to search rs 68.7% $1.63 22
74 orf/gping Ping, but with a graph rs 68.7% $0.82 16
75 ArthurSonzogni/json-tui A JSON terminal UI made in C++ cpp 68.6% $0.96 14
76 bensadeh/tailspin ๐ŸŒ€ A log file highlighter rs 68.5% $1.45 24
77 hatoo/oha Ohayou(ใŠใฏใ‚ˆใ†), HTTP load generator, inspired by rakyll/hey with tui animation. rs 68.3% $1.16 13
78 cordx56/rustowl Visualize Ownership and Lifetimes in Rust rs 66.9% $0.67 14
79 sclevine/yj CLI - Convert between YAML, TOML, JSON, and HCL. Preserves map order. go 66.5% $0.79 15
80 trasta298/keifu Git genealogy, untangled. A TUI for navigating commit graphs with color and clarity. rs 66.4% $1.02 18
81 BurntSushi/ripgrep ripgrep recursively searches directories for a regex pattern while respecting your gitignore rs 65.9% $1.27 18
82 ekzhang/bore ๐Ÿ•ณ bore is a simple CLI tool for making tunnels to localhost rs 65.5% $1.79 28
83 rbakbashev/elfcat ELF visualizer. Generates HTML files from ELF binaries. rs 65.4% $0.96 15
84 peco/peco Simplistic interactive filtering tool go 65.0% $1.13 16
85 ajeetdsouza/zoxide A smarter cd command. Supports all major shells. rs 65.0% $0.95 16
86 nikolassv/bartib A simple timetracker for the command line. It saves a log of all tracked activities as a plaintext file and allows you to create flexible reports. rs 64.5% $0.94 14
87 dundee/gdu Fast disk usage analyzer with console interface written in Go go 64.2% $1.02 18
88 Isona/dirble Fast directory scanning and scraping tool rs 63.9% $0.91 14
89 sqlite/sqlite Official Git mirror of the SQLite source tree c 63.7% $1.69 30
90 guumaster/hostctl Your dev tool to manage /etc/hosts like a pro! go 62.4% $1.19 17
91 Canop/broot A new way to see and navigate directory trees : https://dystroy.org/broot rs 62.3% $1.89 24
92 yoav-lavi/melody Melody is a language that compiles to regular expressions and aims to be more readable and maintainable rs 62.3% $1.25 21
93 quinn-rs/quinn Async-friendly QUIC implementation in Rust rs 62.3% $1.31 18
94 oppiliappan/statix lints and suggestions for the nix programming language rs 62.1% $1.19 18
95 bootandy/dust A more intuitive version of du in rust rs 61.8% $1.19 14
96 WGUNDERWOOD/tex-fmt An extremely fast LaTeX formatter written in Rust rs 61.8% $0.78 15
97 rust-embedded/svd2rust Generate Rust register maps (`struct`s) from SVD files rs 61.7% $1.83 28
98 facebookresearch/fastText Library for fast text representation and classification. cpp 61.5% $1.02 14
99 skeema/skeema Declarative pure-SQL schema management for MySQL and MariaDB go 61.2% $1.42 21
100 unhappychoice/gittype A CLI code-typing game that turns your source code into typing challenges rs 61.1% $0.74 16
101 riquito/tuc When cut doesn't cut it rs 60.7% $0.89 13
102 kaushiksrini/parqeye Peek inside Parquet files right from your terminal rs 60.3% $1.66 24
103 yassinebridi/serpl A simple terminal UI for search and replace, ala VS Code. rs 60.3% $0.91 22
104 incu6us/goimports-reviser Right imports sorting & code formatting tool (goimports alternative) go 59.8% $1.27 24
105 ggreer/the_silver_searcher A code-searching tool similar to ack, but faster. c 59.6% $1.54 20
106 codesnap-rs/codesnap ๐Ÿฆ€๏ธ๐Ÿ“ธ Pure Rust tool to generate beautiful code snapshots, provide CLI and Library rs 59.4% $0.69 15
107 tomarrell/wrapcheck A Go linter to check that errors from external packages are wrapped go 58.8% $1.07 19
108 facebook/zstd Zstandard - Fast real-time compression algorithm c 58.4% $1.24 22
109 pemistahl/grex A command-line tool and Rust library with Python bindings for generating regular expressions from user-provided test cases rs 58.1% $1.56 22
110 ecumene/rust-sloth A 3D software rasterizer... for the terminal! rs 57.9% $1.46 20
111 cheat/cheat cheat allows you to create and view interactive cheatsheets on the command-line. It was designed to help remind *nix system administrators of options for commands that they use frequently, but not frequently enough to remember. go 57.6% $0.95 14
112 jhspetersson/fselect Find files with SQL-like queries rs 57.3% $1.57 18
113 ninja-build/ninja a small build system with a focus on speed cpp 57.2% $0.90 15
114 antonmedv/fx Terminal JSON viewer & processor go 56.5% $1.21 24
115 TheZoraiz/ascii-image-converter A cross-platform command-line tool to convert images into ascii art and print them on the console. Now supports braille art! go 56.3% $1.11 16
116 YS-L/flamelens Flamegraph viewer in the terminal rs 55.8% $0.95 14
117 naggie/dstask Git powered terminal-based todo/note manager -- markdown note page per task. Single binary! go 55.6% $1.25 16
118 Miserlou/Loop UNIX's missing `loop` command rs 55.4% $1.07 18
119 axodotdev/oranda ๐ŸŽ generate beautiful landing pages for your developer tools rs 55.1% $1.15 23
120 NikolaDucak/caps-log A small TUI journaling tool. ๐Ÿ“– cpp 55.0% $0.96 17
121 lfos/calcurse A text-based calendar and scheduling application c 54.8% $1.85 27
122 multiprocessio/dsq Commandline tool for running SQL queries against JSON, CSV, Excel, Parquet, and more. go 54.2% $1.27 23
123 noborus/trdsql CLI tool that can execute SQL queries on CSV, LTSV, JSON, YAML and TBLN. Can output to various formats. go 54.0% $0.74 13
124 elkowar/pipr A tool to interactively write shell pipelines. rs 53.1% $0.98 19
125 nuta/nsh A command-line shell like fish, but POSIX compatible. rs 52.9% $1.33 23
126 hairyhenderson/gomplate A flexible commandline tool for template rendering. Supports lots of local and remote datasources. go 52.1% $1.56 22
127 Y2Z/monolith โฌ›๏ธ CLI tool and library for saving complete web pages as a single HTML file rs 51.8% $1.00 19
128 gabotechs/dep-tree Tool for helping developers keep their code bases clean and decoupled. It allows visualising a code base complexity using a 3d force-directed graph of files and the dependencies between them. go 51.4% $1.29 21
129 lh3/seqtk Toolkit for processing sequences in FASTA/Q formats c 51.3% $0.94 18
130 XAMPPRocky/tokei Count your code, quickly. rs 51.0% $1.57 19
131 cweill/gotests Automatically generate Go test boilerplate from your source code. go 50.9% $1.57 25
132 foriequal0/git-trim Automatically trims your branches whose tracking remote refs are merged or stray rs 50.7% $0.91 16
133 rochacbruno/marmite Markdown makes sites - A Static Site Generator for Blogs rs 50.3% $1.29 14
134 sharkdp/hyperfine A command-line benchmarking tool rs 49.1% $1.37 18
135 rust-lang/mdBook Create book from markdown files. Like Gitbook but implemented in Rust rs 48.8% $1.10 15
136 direnv/direnv unclutter your .profile go 48.8% $1.46 17
137 kisielk/errcheck errcheck checks that you checked errors. go 47.8% $1.55 22
138 Stranger6667/jsonschema A high-performance JSON Schema validator for Rust rs 47.6% $1.07 20
139 mgechev/revive ๐Ÿ”ฅ ~6x faster, stricter, configurable, extensible, and beautiful drop-in replacement for golint go 47.3% $1.24 22
140 mkj/dropbear Dropbear SSH c 46.5% $0.96 18
141 robertdavidgraham/masscan TCP port scanner, spews SYN packets asynchronously, scanning entire Internet in under 5 minutes. c 46.3% $1.30 19
142 ariga/atlas Declarative schema migrations with schema-as-code workflows go 45.7% $1.58 31
143 cmatsuoka/figlet Claudio's FIGlet tree c 45.5% $2.94 37
144 Epistates/treemd A (TUI/CLI) markdown navigator with tree-based structural navigation. rs 45.3% $1.62 20
145 sharkdp/hexyl A command-line hex viewer rs 45.1% $1.07 14
146 cslarsen/jp2a Converts jpg images to ASCII c 45.0% $1.50 28
147 parcel-bundler/lightningcss An extremely fast CSS parser, transformer, bundler, and minifier written in Rust. rs 44.9% $1.23 20
148 Canop/rhit A nginx log explorer rs 44.8% $1.74 17
149 rcoh/angle-grinder Slice and dice logs on the command line rs 44.2% $1.23 20
150 crowdagger/crowbook Converts books written in Markdown to HTML, LaTeX/PDF and EPUB rs 43.2% $1.04 15
151 lua/lua A copy of the Lua development repository, as seen by the Lua team. Mirrored irregularly. All communication should be through the Lua mailing list https://www.lua.org/lua-l.html c 43.0% $1.02 14
152 ducaale/xh Friendly and fast tool for sending HTTP requests rs 42.2% $1.18 17
153 tukaani-project/xz XZ Utils c 41.4% $1.30 20
154 sharkdp/bat A cat(1) clone with wings. rs 40.6% $1.25 18
155 paradigmxyz/solar Blazingly fast, modular and contributor friendly Solidity compiler, written in Rust rs 40.3% $1.50 24
156 tarka/xcp An extended `cp` rs 38.7% $1.33 18
157 FiloSottile/age A simple, modern and secure encryption tool (and Go library) with small explicit keys, no config options, and UNIX-style composability. go 38.5% $1.07 15
158 rvben/rumdl Fast Markdown linter and formatter written in Rust rs 37.9% $1.37 16
159 stacked-git/stgit Stacked Git rs 37.7% $1.13 18
160 sayanarijit/xplr A hackable, minimal, fast TUI file explorer rs 36.8% $1.47 22
161 ivanceras/svgbob Convert your ascii diagram scribbles into happy little SVG rs 35.2% $1.00 17
162 tree-sitter/tree-sitter An incremental parsing system for programming tools rs 34.2% $1.04 19
163 go-critic/go-critic The most opinionated Go source code linter for code audit. go 34.1% $1.19 21
164 LuaJIT/LuaJIT Mirror of the LuaJIT git repository c 33.9% $1.10 15
165 typst/typst A markup-based typesetting system that is powerful and easy to learn. rs 32.7% $0.75 13
166 jqlang/jq Command-line JSON processor c 31.5% $0.67 13
167 dandavison/delta A syntax-highlighting pager for git, diff, grep, rg --json, and blame output rs 30.1% $0.96 14
168 pls-rs/pls pls is a prettier and powerful ls(1) for the pros. rs 29.8% $0.89 11
169 chirlu/sox SoX, Swiss Army knife of sound processing c 29.7% $1.30 16
170 arq5x/bedtools2 bedtools - the swiss army knife for genome arithmetic c 28.8% $2.08 22
171 ip7z/7zip 7-Zip cpp 28.8% $1.01 13
172 alecthomas/chroma A general purpose syntax highlighter in pure Go go 27.2% $1.51 22
173 eliukblau/pixterm Draw images in your ANSI terminal with true color go 24.7% $1.15 16
174 svenstaro/genact ๐ŸŒ€ A nonsense activity generator rs 23.3% $0.94 13
175 doxygen/doxygen Official doxygen git repository c 21.0% $1.45 20
176 boyter/scc Sloc, Cloc and Code: scc is a very fast accurate code counter with complexity calculations and COCOMO estimates written in pure Go go 20.7% $0.83 11
177 stathissideris/ditaa ditaa is a small command-line utility that can convert diagrams drawn using ascii art ('drawings' that contain characters that resemble lines like | / - ), into proper bitmap graphics. java 19.2% $1.27 16
178 sigoden/argc A Bash CLI framework, also a Bash command runner. rs 18.4% $2.18 29
179 johnkerl/miller Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON go 16.9% $1.02 15
180 hpjansson/chafa ๐Ÿ“บ๐Ÿ—ฟ Terminal graphics for the 21st century. c 16.6% $1.74 22
181 tinycc/tinycc Unofficial mirror of mob development branch c 16.0% $1.29 17
182 samtools/samtools Tools (written in C using htslib) for manipulating next-generation sequencing data c 15.6% $1.33 15
183 zk-org/zk Plain text note-taking assistant go 15.3% $1.30 22
184 mikefarah/yq yq is a portable command-line YAML, JSON, XML, CSV, TOML, HCL and properties processor go 14.5% $1.00 13
185 Nukesor/pueue :stars: Manage your shell commands. rs 13.6% $1.09 14
186 hush-shell/hush Hush is a unix shell based on the Lua programming language rs 13.1% $1.83 33
187 ast-grep/ast-grep โšกA CLI tool for code structural search, lint and rewriting. Written in Rust rs 12.7% $1.48 21
188 duckdb/duckdb DuckDB is an analytical in-process SQL database management system cpp 11.9% $0.99 15
189 OSGeo/gdal GDAL is an open source MIT licensed translator library for raster and vector geospatial data formats. cpp 11.9% $0.94 14
190 jgm/pandoc Universal markup converter hs 10.1% $1.63 21
191 universal-ctags/ctags A maintained ctags implementation c 9.3% $0.92 13
192 tstack/lnav Log file navigator cpp 7.2% $0.83 13
193 FFmpeg/FFmpeg Mirror of https://git.ffmpeg.org/ffmpeg.git c 6.1% $1.16 15
194 OSGeo/PROJ PROJ - Cartographic Projections and Coordinate Transformations Library cpp 5.3% $1.00 15
195 gromacs/gromacs Public/backup repository of the GROMACS molecular simulation toolkit. Please do not mine the metadata blindly; we use https://gitlab.com/gromacs/gromacs for code review and issue tracking. cpp 4.3% $0.80 11
196 bellard/quickjs Public repository of the QuickJS Javascript Engine. c 4.0% $1.67 26
197 jesseduffield/lazygit simple terminal UI for git commands go 3.3% $0.92 15
198 danmar/cppcheck static analysis of C/C++ code cpp 2.3% $0.73 13
199 google/brotli Brotli compression format c 1.1% $1.13 22
200 php/php-src The PHP Interpreter c n/a $1.47 16

Click row to see task details