← Back to detailed results

GPT 5.5 (high)

OpenAI · mini-SWE-agent · Rank #2

0.5%
Resolved help_outline Percentage of instances fully solved as measured by hidden behavioral tests.
5.0%
Almost Resolved help_outline Instances where the agent's solution passes ≥ 95% of all hidden behavioral tests.
$731
Total Cost help_outline Total API cost in USD across all task instances.
8,184
Total Calls help_outline Total number of LLM calls across all task instances.

Score (Behavioral Test Pass Rate) Distribution

Per-Instance Results

200 instances
# Repository Lang Score Cost Calls
1 abishekvashok/cmatrix Terminal based "The Matrix" like implementation c 100.0% $3.17 34
2 sitkevij/hex ๐Ÿ”ฎ Futuristic take on hexdump, made in Rust. rs 99.6% $1.84 28
3 jarun/nnn nยณ The unorthodox terminal file manager c 98.1% $3.95 36
4 agourlay/zip-password-finder Find the password of protected ZIP files. rs 97.4% $1.90 29
5 wfxr/csview ๐Ÿ“  Pretty and fast csv viewer for cli with cjk/emoji support. rs 97.3% $2.55 35
6 mgdm/htmlq Like jq, but for HTML. rs 96.4% $3.62 52
7 sheepla/pingu ๐Ÿงping command but with pingu go 96.1% $2.73 35
8 sstadick/hck A sharp cut(1) clone. rs 95.9% $2.63 36
9 clog-tool/clog-cli Generate beautiful changelogs from your Git commit history rs 95.5% $2.73 41
10 BLAKE3-team/BLAKE3 the official Rust and C implementations of the BLAKE3 cryptographic hash function rs 95.1% $2.65 34
11 nachoparker/dutree a tool to analyze file system usage written in Rust rs 94.4% $3.96 36
12 shashwatah/jot โšกRapid note management for the terminal. rs 94.1% $3.55 46
13 oppiliappan/eva a calculator REPL, similar to bc(1) rs 94.1% $3.40 40
14 simeg/eureka ๐Ÿ’ก CLI tool to input and store your ideas without leaving the terminal rs 93.6% $2.56 36
15 HaliteChallenge/Halite @twosigma's first artificial intelligence programming challenge cpp 92.7% $2.90 40
16 ismaelgv/rnr A command-line tool to batch rename files and directories rs 92.7% $2.75 50
17 Lymphatus/caesium-clt Caesium Command Line Tools - Lossy/lossless image compression tool rs 92.5% $5.06 60
18 ekzhang/bore ๐Ÿ•ณ bore is a simple CLI tool for making tunnels to localhost rs 92.4% $3.71 39
19 rs/jplot iTerm2 expvar/JSON monitoring tool go 91.3% $3.76 43
20 ogham/dog A command-line DNS client. rs 91.2% $3.43 41
21 sirwart/ripsecrets A command-line tool to prevent committing secret keys into your source code rs 91.2% $4.05 52
22 psampaz/go-mod-outdated Find outdated dependencies of your Go projects. go-mod-outdated provides a table view of the go list -u -m -json all command which lists all dependencies of a Go project and their available minor and patch updates. It also provides a way to filter indirect dependencies and dependencies without updates. go 90.5% $1.93 28
23 nikolassv/bartib A simple timetracker for the command line. It saves a log of all tracked activities as a plaintext file and allows you to create flexible reports. rs 90.4% $4.12 39
24 rhysd/kiro-editor A small terminal UTF-8 text editor written in Rust ๐Ÿ“๐Ÿฆ€ rs 90.1% $3.54 36
25 pier-cli/pier A CLI to organize and run short Unix shell scripts rs 90.0% $4.17 59
26 chmln/sd Intuitive find & replace CLI (sed alternative) rs 89.9% $3.30 37
27 ArthurSonzogni/json-tui A JSON terminal UI made in C++ cpp 89.5% $3.69 34
28 riquito/tuc When cut doesn't cut it rs 89.5% $4.67 47
29 madler/pigz A parallel implementation of gzip for modern multi-processor, multi-core machines. c 89.4% $2.86 38
30 chmln/handlr A better xdg-utils rs 89.3% $3.01 45
31 eradman/entr Run arbitrary commands when files change c 88.9% $1.64 23
32 pemistahl/grex A command-line tool and Rust library with Python bindings for generating regular expressions from user-provided test cases rs 88.7% $6.81 57
33 cordx56/rustowl Visualize Ownership and Lifetimes in Rust rs 88.5% $2.86 38
34 mookid/diffr Yet another diff highlighting tool rs 88.4% $5.85 51
35 JohannesKaufmann/html-to-markdown โš™๏ธ Convert HTML to Markdown. Even works with entire websites and can be extended through rules. go 88.2% $2.38 29
36 kyoheiu/felix tui file manager with vim-like key mapping rs 88.2% $3.14 51
37 svenstaro/miniserve ๐ŸŒŸ For when you really just want to serve some files over HTTP right now! rs 88.2% $3.94 31
38 kyoh86/richgo Enrich `go test` outputs with text decorations. go 88.1% $3.00 54
39 git-bahn/git-graph Command line tool to show clear git graphs arranged for your branching model rs 88.0% $3.35 42
40 brocode/fblog Small command-line JSON Log viewer rs 87.8% $2.71 39
41 BurntSushi/xsv A fast CSV command line toolkit written in Rust. rs 87.1% $2.70 40
42 anordal/shellharden The corrective bash syntax highlighter rs 87.1% $4.26 42
43 tomnomnom/gron Make JSON greppable! go 87.1% $2.70 44
44 rs/curlie The power of curl, the ease of use of httpie. go 87.0% $3.25 38
45 altdesktop/i3-style ๐ŸŽจ Make your i3 config a little more stylish. rs 87.0% $4.41 43
46 mibk/dupl a tool for code clone detection go 86.9% $2.56 34
47 eudoxia0/hashcards A plain text-based spaced repetition system. rs 86.8% $5.14 63
48 rust-ethereum/ethabi Encode and decode smart contract invocations rs 86.1% $4.62 44
49 wintermute-cell/ngrrram A TUI tool to help you type faster and learn new layouts. Includes a free cat. rs 85.8% $2.88 32
50 hooklift/gowsdl WSDL2Go code generation as well as its SOAP proxy go 85.7% $7.43 73
51 sharkdp/pastel A command-line tool to generate, analyze, convert and manipulate colors rs 85.3% $5.06 48
52 jonas/tig Text-mode interface for git c 85.0% $2.06 32
53 yaa110/nomino Batch rename utility for developers rs 85.0% $2.16 35
54 orf/gping Ping, but with a graph rs 85.0% $3.77 49
55 htop-dev/htop htop - an interactive process viewer c 84.7% $2.63 28
56 Byron/dua-cli View disk space usage and delete unwanted data, fast. rs 84.6% $2.81 29
57 noborus/ov ๐ŸŽ‘Feature-rich terminal-based text viewer. It is a so-called terminal pager. go 84.6% $3.23 41
58 raviqqe/muffet Fast website link checker in Go go 84.0% $2.24 26
59 antonmedv/walk Terminal file manager go 83.8% $4.11 45
60 jrnxf/thokr โœจ sleek typing tui with visualized results and historical logging rs 83.8% $2.42 29
61 Miserlou/Loop UNIX's missing `loop` command rs 83.0% $4.57 50
62 xorg62/tty-clock Clock using lib ncurses c 82.9% $4.43 50
63 rbakbashev/elfcat ELF visualizer. Generates HTML files from ELF binaries. rs 82.8% $9.37 65
64 wfxr/code-minimap ๐Ÿ›ฐ A high performance code minimap render. rs 82.7% $3.01 36
65 lz4/lz4 Extremely Fast Compression algorithm c 82.7% $2.92 42
66 KSXGitHub/parallel-disk-usage Highly parallelized, blazing fast directory tree analyzer rs 82.7% $3.38 32
67 blacknon/hwatch A modern alternative to the watch command, records the differences in execution results and can check this differences at after. rs 82.6% $4.53 59
68 mfridman/tparse CLI tool for summarizing go test output. Pipe friendly. CI/CD friendly. go 82.4% $4.88 48
69 google/brotli Brotli compression format c 82.1% $4.86 59
70 o2sh/onefetch Command-line Git information tool rs 81.9% $4.06 45
71 tomarrell/wrapcheck A Go linter to check that errors from external packages are wrapped go 81.9% $2.12 27
72 Esubaalew/run Universal multi-language runner and smart REPL written in Rust. rs 80.8% $3.33 44
73 bootandy/dust A more intuitive version of du in rust rs 80.5% $3.25 28
74 sharkdp/fd A simple, fast and user-friendly alternative to 'find' rs 80.2% $3.69 55
75 kisielk/errcheck errcheck checks that you checked errors. go 80.1% $3.59 53
76 zevv/duc Dude, where are my bytes: Duc, a library and suite of tools for inspecting disk usage c 80.0% $3.81 40
77 ajeetdsouza/zoxide A smarter cd command. Supports all major shells. rs 79.8% $4.39 47
78 alexpovel/srgn A grep-like tool which understands source code syntax and allows for manipulation in addition to search rs 79.8% $3.89 40
79 tukaani-project/xz XZ Utils c 79.7% $4.26 43
80 junegunn/fzf :cherry_blossom: A command-line fuzzy finder go 79.2% $3.76 52
81 segmentio/chamber CLI for managing secrets go 79.0% $3.86 46
82 codesnap-rs/codesnap ๐Ÿฆ€๏ธ๐Ÿ“ธ Pure Rust tool to generate beautiful code snapshots, provide CLI and Library rs 79.0% $3.04 34
83 skeema/skeema Declarative pure-SQL schema management for MySQL and MariaDB go 78.5% $4.82 55
84 astaxie/bat Go implement CLI, cURL-like tool for humans go 78.2% $2.19 21
85 bensadeh/tailspin ๐ŸŒ€ A log file highlighter rs 77.9% $3.64 33
86 TheZoraiz/ascii-image-converter A cross-platform command-line tool to convert images into ascii art and print them on the console. Now supports braille art! go 77.2% $4.32 48
87 Drew-Alleman/DataSurgeon Quickly Extracts IP's, Email Addresses, Hashes, Files, Credit Cards, Social Security Numbers and a lot More From Text rs 77.1% $2.24 31
88 sharkdp/hyperfine A command-line benchmarking tool rs 77.0% $2.48 25
89 naggie/dstask Git powered terminal-based todo/note manager -- markdown note page per task. Single binary! go 76.9% $4.37 45
90 ggreer/the_silver_searcher A code-searching tool similar to ack, but faster. c 76.6% $4.66 52
91 WGUNDERWOOD/tex-fmt An extremely fast LaTeX formatter written in Rust rs 76.5% $3.81 48
92 konradsz/igrep Interactive Grep rs 75.8% $2.19 32
93 dundee/gdu Fast disk usage analyzer with console interface written in Go go 75.8% $3.88 60
94 sibprogrammer/xq Command-line XML and HTML beautifier and content extractor go 75.8% $3.52 37
95 trasta298/keifu Git genealogy, untangled. A TUI for navigating commit graphs with color and clarity. rs 75.2% $3.94 50
96 antonmedv/fx Terminal JSON viewer & processor go 74.4% $3.29 50
97 eliukblau/pixterm Draw images in your ANSI terminal with true color go 74.2% $4.15 42
98 Isona/dirble Fast directory scanning and scraping tool rs 73.8% $3.20 38
99 sclevine/yj CLI - Convert between YAML, TOML, JSON, and HCL. Preserves map order. go 73.5% $2.48 34
100 direnv/direnv unclutter your .profile go 73.3% $3.77 35
101 quinn-rs/quinn Async-friendly QUIC implementation in Rust rs 73.0% $3.09 34
102 hairyhenderson/gomplate A flexible commandline tool for template rendering. Supports lots of local and remote datasources. go 71.8% $5.18 46
103 yoav-lavi/melody Melody is a language that compiles to regular expressions and aims to be more readable and maintainable rs 71.5% $3.79 54
104 cweill/gotests Automatically generate Go test boilerplate from your source code. go 71.0% $4.40 48
105 noborus/trdsql CLI tool that can execute SQL queries on CSV, LTSV, JSON, YAML and TBLN. Can output to various formats. go 71.0% $2.11 22
106 hatoo/oha Ohayou(ใŠใฏใ‚ˆใ†), HTTP load generator, inspired by rakyll/hey with tui animation. rs 70.6% $2.55 28
107 BurntSushi/ripgrep ripgrep recursively searches directories for a regex pattern while respecting your gitignore rs 70.5% $3.00 28
108 Canop/rhit A nginx log explorer rs 70.1% $4.62 43
109 cmatsuoka/figlet Claudio's FIGlet tree c 69.6% $6.70 74
110 peco/peco Simplistic interactive filtering tool go 69.4% $4.35 46
111 incu6us/goimports-reviser Right imports sorting & code formatting tool (goimports alternative) go 69.4% $1.91 21
112 rust-embedded/svd2rust Generate Rust register maps (`struct`s) from SVD files rs 69.0% $4.94 39
113 lh3/seqtk Toolkit for processing sequences in FASTA/Q formats c 68.5% $3.38 46
114 sqlite/sqlite Official Git mirror of the SQLite source tree c 68.4% $3.06 45
115 sayanarijit/xplr A hackable, minimal, fast TUI file explorer rs 68.3% $3.51 37
116 hush-shell/hush Hush is a unix shell based on the Lua programming language rs 68.2% $5.33 56
117 guumaster/hostctl Your dev tool to manage /etc/hosts like a pro! go 68.0% $2.92 30
118 lfos/calcurse A text-based calendar and scheduling application c 68.0% $4.46 35
119 pls-rs/pls pls is a prettier and powerful ls(1) for the pros. rs 67.2% $3.10 43
120 cheat/cheat cheat allows you to create and view interactive cheatsheets on the command-line. It was designed to help remind *nix system administrators of options for commands that they use frequently, but not frequently enough to remember. go 66.7% $4.69 60
121 lua/lua A copy of the Lua development repository, as seen by the Lua team. Mirrored irregularly. All communication should be through the Lua mailing list https://www.lua.org/lua-l.html c 66.1% $4.34 50
122 NikolaDucak/caps-log A small TUI journaling tool. ๐Ÿ“– cpp 65.5% $5.81 53
123 ninja-build/ninja a small build system with a focus on speed cpp 65.5% $3.50 45
124 LuaJIT/LuaJIT Mirror of the LuaJIT git repository c 65.5% $2.54 26
125 ecumene/rust-sloth A 3D software rasterizer... for the terminal! rs 65.3% $3.62 38
126 oppiliappan/statix lints and suggestions for the nix programming language rs 65.2% $4.29 48
127 foriequal0/git-trim Automatically trims your branches whose tracking remote refs are merged or stray rs 65.0% $2.95 41
128 jhspetersson/fselect Find files with SQL-like queries rs 64.9% $3.56 39
129 rcoh/angle-grinder Slice and dice logs on the command line rs 64.8% $4.46 44
130 kaushiksrini/parqeye Peek inside Parquet files right from your terminal rs 64.1% $4.43 39
131 jesseduffield/lazygit simple terminal UI for git commands go 63.4% $3.21 51
132 unhappychoice/gittype A CLI code-typing game that turns your source code into typing challenges rs 63.2% $3.70 51
133 facebookresearch/fastText Library for fast text representation and classification. cpp 62.8% $2.49 27
134 multiprocessio/dsq Commandline tool for running SQL queries against JSON, CSV, Excel, Parquet, and more. go 62.5% $2.97 44
135 facebook/zstd Zstandard - Fast real-time compression algorithm c 62.4% $2.54 34
136 YS-L/flamelens Flamegraph viewer in the terminal rs 62.1% $2.47 49
137 yassinebridi/serpl A simple terminal UI for search and replace, ala VS Code. rs 61.9% $4.18 61
138 rust-lang/mdBook Create book from markdown files. Like Gitbook but implemented in Rust rs 61.8% $3.88 33
139 XAMPPRocky/tokei Count your code, quickly. rs 60.9% $2.96 27
140 Y2Z/monolith โฌ›๏ธ CLI tool and library for saving complete web pages as a single HTML file rs 60.6% $4.38 57
141 FiloSottile/age A simple, modern and secure encryption tool (and Go library) with small explicit keys, no config options, and UNIX-style composability. go 60.5% $6.36 60
142 jqlang/jq Command-line JSON processor c 59.9% $2.38 26
143 axodotdev/oranda ๐ŸŽ generate beautiful landing pages for your developer tools rs 59.7% $3.58 39
144 gabotechs/dep-tree Tool for helping developers keep their code bases clean and decoupled. It allows visualising a code base complexity using a 3d force-directed graph of files and the dependencies between them. go 59.1% $4.51 55
145 elkowar/pipr A tool to interactively write shell pipelines. rs 57.9% $3.22 34
146 Stranger6667/jsonschema A high-performance JSON Schema validator for Rust rs 55.1% $2.99 37
147 ariga/atlas Declarative schema migrations with schema-as-code workflows go 54.6% $3.23 28
148 rochacbruno/marmite Markdown makes sites - A Static Site Generator for Blogs rs 53.7% $2.80 29
149 robertdavidgraham/masscan TCP port scanner, spews SYN packets asynchronously, scanning entire Internet in under 5 minutes. c 53.7% $5.02 40
150 parcel-bundler/lightningcss An extremely fast CSS parser, transformer, bundler, and minifier written in Rust. rs 52.7% $3.53 40
151 Canop/broot A new way to see and navigate directory trees : https://dystroy.org/broot rs 51.9% $4.81 46
152 mkj/dropbear Dropbear SSH c 50.1% $2.08 30
153 go-critic/go-critic The most opinionated Go source code linter for code audit. go 49.7% $3.64 43
154 sharkdp/bat A cat(1) clone with wings. rs 49.6% $5.73 54
155 Epistates/treemd A (TUI/CLI) markdown navigator with tree-based structural navigation. rs 49.1% $3.31 33
156 crowdagger/crowbook Converts books written in Markdown to HTML, LaTeX/PDF and EPUB rs 48.8% $3.32 38
157 stacked-git/stgit Stacked Git rs 48.7% $4.62 44
158 rvben/rumdl Fast Markdown linter and formatter written in Rust rs 48.6% $4.29 32
159 ducaale/xh Friendly and fast tool for sending HTTP requests rs 48.5% $2.92 27
160 mgechev/revive ๐Ÿ”ฅ ~6x faster, stricter, configurable, extensible, and beautiful drop-in replacement for golint go 48.3% $3.70 56
161 boyter/scc Sloc, Cloc and Code: scc is a very fast accurate code counter with complexity calculations and COCOMO estimates written in pure Go go 47.8% $5.71 67
162 ip7z/7zip 7-Zip cpp 46.8% $4.19 46
163 paradigmxyz/solar Blazingly fast, modular and contributor friendly Solidity compiler, written in Rust rs 46.4% $3.03 36
164 ivanceras/svgbob Convert your ascii diagram scribbles into happy little SVG rs 46.0% $3.58 40
165 cslarsen/jp2a Converts jpg images to ASCII c 44.4% $5.11 46
166 alecthomas/chroma A general purpose syntax highlighter in pure Go go 41.7% $4.27 54
167 chirlu/sox SoX, Swiss Army knife of sound processing c 38.9% $4.14 39
168 tree-sitter/tree-sitter An incremental parsing system for programming tools rs 38.4% $4.10 39
169 arq5x/bedtools2 bedtools - the swiss army knife for genome arithmetic c 38.4% $4.38 41
170 svenstaro/genact ๐ŸŒ€ A nonsense activity generator rs 36.6% $2.91 24
171 dandavison/delta A syntax-highlighting pager for git, diff, grep, rg --json, and blame output rs 31.8% $6.94 57
172 sigoden/argc A Bash CLI framework, also a Bash command runner. rs 31.5% $5.08 46
173 OSGeo/PROJ PROJ - Cartographic Projections and Coordinate Transformations Library cpp 29.8% $3.79 33
174 mikefarah/yq yq is a portable command-line YAML, JSON, XML, CSV, TOML, HCL and properties processor go 29.6% $2.60 32
175 stathissideris/ditaa ditaa is a small command-line utility that can convert diagrams drawn using ascii art ('drawings' that contain characters that resemble lines like | / - ), into proper bitmap graphics. java 29.4% $2.75 27
176 johnkerl/miller Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON go 23.4% $3.02 26
177 dalance/amber A code search / replace tool rs 22.3% $2.07 44
178 samtools/samtools Tools (written in C using htslib) for manipulating next-generation sequencing data c 21.5% $5.82 35
179 hpjansson/chafa ๐Ÿ“บ๐Ÿ—ฟ Terminal graphics for the 21st century. c 21.4% $3.78 44
180 tstack/lnav Log file navigator cpp 20.9% $3.57 39
181 doxygen/doxygen Official doxygen git repository c 20.5% $2.41 29
182 ast-grep/ast-grep โšกA CLI tool for code structural search, lint and rewriting. Written in Rust rs 20.2% $3.93 35
183 tinycc/tinycc Unofficial mirror of mob development branch c 17.8% $3.43 36
184 OSGeo/gdal GDAL is an open source MIT licensed translator library for raster and vector geospatial data formats. cpp 17.2% $3.46 36
185 zk-org/zk Plain text note-taking assistant go 16.5% $4.05 51
186 jgm/pandoc Universal markup converter hs 14.7% $2.59 24
187 duckdb/duckdb DuckDB is an analytical in-process SQL database management system cpp 12.8% $3.92 35
188 bellard/quickjs Public repository of the QuickJS Javascript Engine. c 10.9% $3.51 30
189 Nukesor/pueue :stars: Manage your shell commands. rs 8.6% $3.36 45
190 php/php-src The PHP Interpreter c 8.0% $3.23 36
191 gromacs/gromacs Public/backup repository of the GROMACS molecular simulation toolkit. Please do not mine the metadata blindly; we use https://gitlab.com/gromacs/gromacs for code review and issue tracking. cpp 7.1% $5.07 51
192 astro/deadnix Scan Nix files for dead code rs 6.5% $4.79 43
193 universal-ctags/ctags A maintained ctags implementation c 4.4% $3.65 31
194 FFmpeg/FFmpeg Mirror of https://git.ffmpeg.org/ffmpeg.git c 4.2% $2.60 28
195 danmar/cppcheck static analysis of C/C++ code cpp 2.1% $2.02 32
196 typst/typst A markup-based typesetting system that is powerful and easy to learn. rs 1.3% $3.71 32
197 AmmarAbouZor/tui-journal Your journal app if you live in a terminal rs n/a $4.48 45
198 nuta/nsh A command-line shell like fish, but POSIX compatible. rs n/a $2.79 42
199 sharkdp/hexyl A command-line hex viewer rs n/a $3.22 33
200 tarka/xcp An extended `cp` rs n/a $1.95 25

Click row to see task details