← Back to detailed results

GPT 5.5 (xhigh)

OpenAI · mini-SWE-agent · Rank #1

0.5%
Resolved help_outline Percentage of instances fully solved as measured by hidden behavioral tests.
13.5%
Almost Resolved help_outline Instances where the agent's solution passes ≥ 95% of all hidden behavioral tests.
$1770
Total Cost help_outline Total API cost in USD across all task instances.
16,320
Total Calls help_outline Total number of LLM calls across all task instances.

Score (Behavioral Test Pass Rate) Distribution

Per-Instance Results

200 instances
# Repository Lang Score Cost Calls
1 abishekvashok/cmatrix Terminal based "The Matrix" like implementation c 100.0% $4.84 40
2 wfxr/csview ๐Ÿ“  Pretty and fast csv viewer for cli with cjk/emoji support. rs 99.7% $4.82 62
3 agourlay/zip-password-finder Find the password of protected ZIP files. rs 98.7% $4.94 59
4 clog-tool/clog-cli Generate beautiful changelogs from your Git commit history rs 98.4% $11.10 97
5 sitkevij/hex ๐Ÿ”ฎ Futuristic take on hexdump, made in Rust. rs 98.4% $7.97 87
6 oppiliappan/eva a calculator REPL, similar to bc(1) rs 98.4% $7.02 69
7 htop-dev/htop htop - an interactive process viewer c 98.1% $4.18 47
8 mgdm/htmlq Like jq, but for HTML. rs 98.0% $5.09 69
9 BLAKE3-team/BLAKE3 the official Rust and C implementations of the BLAKE3 cryptographic hash function rs 97.8% $5.97 49
10 chmln/sd Intuitive find & replace CLI (sed alternative) rs 97.4% $7.94 89
11 Miserlou/Loop UNIX's missing `loop` command rs 97.3% $4.91 66
12 sstadick/hck A sharp cut(1) clone. rs 97.2% $7.85 94
13 pemistahl/grex A command-line tool and Rust library with Python bindings for generating regular expressions from user-provided test cases rs 97.2% $9.20 71
14 shashwatah/jot โšกRapid note management for the terminal. rs 97.1% $9.55 73
15 wintermute-cell/ngrrram A TUI tool to help you type faster and learn new layouts. Includes a free cat. rs 97.0% $8.86 68
16 sheepla/pingu ๐Ÿงping command but with pingu go 96.3% $4.39 45
17 Lymphatus/caesium-clt Caesium Command Line Tools - Lossy/lossless image compression tool rs 96.2% $7.95 71
18 nachoparker/dutree a tool to analyze file system usage written in Rust rs 96.1% $6.19 65
19 riquito/tuc When cut doesn't cut it rs 96.1% $12.77 105
20 nikolassv/bartib A simple timetracker for the command line. It saves a log of all tracked activities as a plaintext file and allows you to create flexible reports. rs 96.0% $9.37 89
21 wfxr/code-minimap ๐Ÿ›ฐ A high performance code minimap render. rs 95.8% $4.65 48
22 tarka/xcp An extended `cp` rs 95.8% $6.37 62
23 KSXGitHub/parallel-disk-usage Highly parallelized, blazing fast directory tree analyzer rs 95.7% $6.67 57
24 HaliteChallenge/Halite @twosigma's first artificial intelligence programming challenge cpp 95.6% $7.37 59
25 google/brotli Brotli compression format c 95.5% $14.46 116
26 sharkdp/hexyl A command-line hex viewer rs 95.4% $13.44 87
27 rhysd/kiro-editor A small terminal UTF-8 text editor written in Rust ๐Ÿ“๐Ÿฆ€ rs 95.3% $9.89 82
28 madler/pigz A parallel implementation of gzip for modern multi-processor, multi-core machines. c 94.9% $10.57 91
29 yaa110/nomino Batch rename utility for developers rs 94.2% $5.15 70
30 pier-cli/pier A CLI to organize and run short Unix shell scripts rs 94.2% $8.76 101
31 ismaelgv/rnr A command-line tool to batch rename files and directories rs 94.0% $6.29 73
32 ogham/dog A command-line DNS client. rs 93.9% $8.10 68
33 git-bahn/git-graph Command line tool to show clear git graphs arranged for your branching model rs 93.7% $12.72 109
34 altdesktop/i3-style ๐ŸŽจ Make your i3 config a little more stylish. rs 93.3% $6.85 67
35 Byron/dua-cli View disk space usage and delete unwanted data, fast. rs 93.1% $11.00 74
36 sharkdp/pastel A command-line tool to generate, analyze, convert and manipulate colors rs 93.1% $10.61 87
37 zevv/duc Dude, where are my bytes: Duc, a library and suite of tools for inspecting disk usage c 93.0% $9.70 86
38 rs/curlie The power of curl, the ease of use of httpie. go 92.9% $7.88 81
39 jrnxf/thokr โœจ sleek typing tui with visualized results and historical logging rs 92.8% $6.84 60
40 JohannesKaufmann/html-to-markdown โš™๏ธ Convert HTML to Markdown. Even works with entire websites and can be extended through rules. go 92.8% $7.12 72
41 mibk/dupl a tool for code clone detection go 92.8% $6.26 67
42 simeg/eureka ๐Ÿ’ก CLI tool to input and store your ideas without leaving the terminal rs 92.7% $5.08 71
43 svenstaro/miniserve ๐ŸŒŸ For when you really just want to serve some files over HTTP right now! rs 92.1% $8.11 57
44 eradman/entr Run arbitrary commands when files change c 91.8% $6.62 83
45 astro/deadnix Scan Nix files for dead code rs 91.7% $9.41 58
46 chmln/handlr A better xdg-utils rs 91.4% $7.47 68
47 hooklift/gowsdl WSDL2Go code generation as well as its SOAP proxy go 90.8% $17.46 117
48 BurntSushi/xsv A fast CSV command line toolkit written in Rust. rs 90.7% $11.17 93
49 mookid/diffr Yet another diff highlighting tool rs 90.6% $9.34 74
50 ArthurSonzogni/json-tui A JSON terminal UI made in C++ cpp 90.2% $5.22 43
51 incu6us/goimports-reviser Right imports sorting & code formatting tool (goimports alternative) go 89.7% $9.03 101
52 antonmedv/walk Terminal file manager go 89.6% $7.96 55
53 raviqqe/muffet Fast website link checker in Go go 89.4% $10.53 90
54 rust-ethereum/ethabi Encode and decode smart contract invocations rs 88.7% $6.65 73
55 anordal/shellharden The corrective bash syntax highlighter rs 88.2% $11.50 93
56 orf/gping Ping, but with a graph rs 88.2% $8.13 76
57 segmentio/chamber CLI for managing secrets go 88.0% $15.51 99
58 bensadeh/tailspin ๐ŸŒ€ A log file highlighter rs 88.0% $15.26 97
59 lz4/lz4 Extremely Fast Compression algorithm c 87.9% $8.10 84
60 sirwart/ripsecrets A command-line tool to prevent committing secret keys into your source code rs 87.7% $6.58 77
61 rbakbashev/elfcat ELF visualizer. Generates HTML files from ELF binaries. rs 87.6% $7.57 73
62 bootandy/dust A more intuitive version of du in rust rs 87.3% $12.40 89
63 trasta298/keifu Git genealogy, untangled. A TUI for navigating commit graphs with color and clarity. rs 87.0% $7.34 70
64 rs/jplot iTerm2 expvar/JSON monitoring tool go 86.6% $3.95 38
65 sibprogrammer/xq Command-line XML and HTML beautifier and content extractor go 86.5% $10.18 99
66 konradsz/igrep Interactive Grep rs 86.2% $4.92 51
67 brocode/fblog Small command-line JSON Log viewer rs 86.2% $5.98 53
68 ekzhang/bore ๐Ÿ•ณ bore is a simple CLI tool for making tunnels to localhost rs 86.2% $4.88 60
69 eliukblau/pixterm Draw images in your ANSI terminal with true color go 85.8% $7.86 63
70 tomnomnom/gron Make JSON greppable! go 85.7% $4.82 46
71 ggreer/the_silver_searcher A code-searching tool similar to ack, but faster. c 85.7% $9.59 98
72 blacknon/hwatch A modern alternative to the watch command, records the differences in execution results and can check this differences at after. rs 85.3% $5.31 65
73 jonas/tig Text-mode interface for git c 85.2% $4.82 39
74 o2sh/onefetch Command-line Git information tool rs 85.1% $12.76 109
75 yoav-lavi/melody Melody is a language that compiles to regular expressions and aims to be more readable and maintainable rs 84.9% $4.22 56
76 quinn-rs/quinn Async-friendly QUIC implementation in Rust rs 84.5% $3.83 40
77 Esubaalew/run Universal multi-language runner and smart REPL written in Rust. rs 84.4% $6.28 78
78 BurntSushi/ripgrep ripgrep recursively searches directories for a regex pattern while respecting your gitignore rs 84.1% $17.56 121
79 xorg62/tty-clock Clock using lib ncurses c 83.6% $7.83 74
80 ajeetdsouza/zoxide A smarter cd command. Supports all major shells. rs 83.4% $10.70 98
81 kisielk/errcheck errcheck checks that you checked errors. go 83.3% $8.89 113
82 sharkdp/fd A simple, fast and user-friendly alternative to 'find' rs 82.8% $8.84 94
83 codesnap-rs/codesnap ๐Ÿฆ€๏ธ๐Ÿ“ธ Pure Rust tool to generate beautiful code snapshots, provide CLI and Library rs 82.7% $7.25 63
84 eudoxia0/hashcards A plain text-based spaced repetition system. rs 82.5% $9.67 100
85 psampaz/go-mod-outdated Find outdated dependencies of your Go projects. go-mod-outdated provides a table view of the go list -u -m -json all command which lists all dependencies of a Go project and their available minor and patch updates. It also provides a way to filter indirect dependencies and dependencies without updates. go 82.5% $2.08 32
86 junegunn/fzf :cherry_blossom: A command-line fuzzy finder go 82.4% $8.19 91
87 ninja-build/ninja a small build system with a focus on speed cpp 82.0% $15.17 144
88 rust-embedded/svd2rust Generate Rust register maps (`struct`s) from SVD files rs 82.0% $21.57 127
89 sclevine/yj CLI - Convert between YAML, TOML, JSON, and HCL. Preserves map order. go 81.7% $5.69 52
90 mfridman/tparse CLI tool for summarizing go test output. Pipe friendly. CI/CD friendly. go 81.6% $7.81 81
91 kaushiksrini/parqeye Peek inside Parquet files right from your terminal rs 81.6% $6.37 55
92 Isona/dirble Fast directory scanning and scraping tool rs 81.5% $7.31 54
93 nuta/nsh A command-line shell like fish, but POSIX compatible. rs 81.0% $9.98 81
94 direnv/direnv unclutter your .profile go 80.9% $6.28 45
95 TheZoraiz/ascii-image-converter A cross-platform command-line tool to convert images into ascii art and print them on the console. Now supports braille art! go 80.9% $10.29 95
96 Drew-Alleman/DataSurgeon Quickly Extracts IP's, Email Addresses, Hashes, Files, Credit Cards, Social Security Numbers and a lot More From Text rs 80.7% $6.08 69
97 facebookresearch/fastText Library for fast text representation and classification. cpp 80.4% $8.25 80
98 alexpovel/srgn A grep-like tool which understands source code syntax and allows for manipulation in addition to search rs 80.1% $10.26 91
99 noborus/ov ๐ŸŽ‘Feature-rich terminal-based text viewer. It is a so-called terminal pager. go 79.8% $10.99 88
100 skeema/skeema Declarative pure-SQL schema management for MySQL and MariaDB go 79.7% $9.34 94
101 astaxie/bat Go implement CLI, cURL-like tool for humans go 79.5% $5.83 49
102 multiprocessio/dsq Commandline tool for running SQL queries against JSON, CSV, Excel, Parquet, and more. go 79.3% $5.95 60
103 foriequal0/git-trim Automatically trims your branches whose tracking remote refs are merged or stray rs 79.0% $7.04 59
104 dundee/gdu Fast disk usage analyzer with console interface written in Go go 78.9% $7.44 85
105 hatoo/oha Ohayou(ใŠใฏใ‚ˆใ†), HTTP load generator, inspired by rakyll/hey with tui animation. rs 78.6% $5.02 41
106 sayanarijit/xplr A hackable, minimal, fast TUI file explorer rs 78.5% $9.61 90
107 cordx56/rustowl Visualize Ownership and Lifetimes in Rust rs 78.3% $5.00 49
108 LuaJIT/LuaJIT Mirror of the LuaJIT git repository c 78.0% $8.42 68
109 gabotechs/dep-tree Tool for helping developers keep their code bases clean and decoupled. It allows visualising a code base complexity using a 3d force-directed graph of files and the dependencies between them. go 77.8% $9.65 99
110 unhappychoice/gittype A CLI code-typing game that turns your source code into typing challenges rs 76.7% $11.11 61
111 pls-rs/pls pls is a prettier and powerful ls(1) for the pros. rs 76.5% $10.30 119
112 noborus/trdsql CLI tool that can execute SQL queries on CSV, LTSV, JSON, YAML and TBLN. Can output to various formats. go 76.4% $7.07 70
113 jhspetersson/fselect Find files with SQL-like queries rs 76.4% $11.81 82
114 lua/lua A copy of the Lua development repository, as seen by the Lua team. Mirrored irregularly. All communication should be through the Lua mailing list https://www.lua.org/lua-l.html c 76.2% $5.54 63
115 lfos/calcurse A text-based calendar and scheduling application c 75.8% $10.93 86
116 jqlang/jq Command-line JSON processor c 75.3% $15.55 148
117 NikolaDucak/caps-log A small TUI journaling tool. ๐Ÿ“– cpp 75.3% $8.89 102
118 lh3/seqtk Toolkit for processing sequences in FASTA/Q formats c 74.6% $8.12 77
119 rcoh/angle-grinder Slice and dice logs on the command line rs 73.3% $10.07 111
120 Canop/rhit A nginx log explorer rs 73.2% $12.36 78
121 cmatsuoka/figlet Claudio's FIGlet tree c 72.6% $15.89 137
122 tinycc/tinycc Unofficial mirror of mob development branch c 72.5% $6.30 65
123 rust-lang/mdBook Create book from markdown files. Like Gitbook but implemented in Rust rs 72.5% $11.95 87
124 ariga/atlas Declarative schema migrations with schema-as-code workflows go 72.5% $9.62 80
125 cheat/cheat cheat allows you to create and view interactive cheatsheets on the command-line. It was designed to help remind *nix system administrators of options for commands that they use frequently, but not frequently enough to remember. go 71.7% $9.93 81
126 sqlite/sqlite Official Git mirror of the SQLite source tree c 71.6% $14.62 155
127 naggie/dstask Git powered terminal-based todo/note manager -- markdown note page per task. Single binary! go 71.3% $11.41 107
128 svenstaro/genact ๐ŸŒ€ A nonsense activity generator rs 71.1% $5.22 42
129 guumaster/hostctl Your dev tool to manage /etc/hosts like a pro! go 71.1% $7.05 66
130 oppiliappan/statix lints and suggestions for the nix programming language rs 69.0% $9.28 83
131 facebook/zstd Zstandard - Fast real-time compression algorithm c 68.7% $5.13 64
132 peco/peco Simplistic interactive filtering tool go 68.6% $8.02 84
133 rochacbruno/marmite Markdown makes sites - A Static Site Generator for Blogs rs 68.4% $12.42 97
134 Y2Z/monolith โฌ›๏ธ CLI tool and library for saving complete web pages as a single HTML file rs 67.7% $6.59 61
135 ecumene/rust-sloth A 3D software rasterizer... for the terminal! rs 66.8% $7.18 57
136 Canop/broot A new way to see and navigate directory trees : https://dystroy.org/broot rs 66.4% $11.09 83
137 robertdavidgraham/masscan TCP port scanner, spews SYN packets asynchronously, scanning entire Internet in under 5 minutes. c 65.8% $8.94 74
138 mkj/dropbear Dropbear SSH c 65.5% $5.49 64
139 tomarrell/wrapcheck A Go linter to check that errors from external packages are wrapped go 65.0% $6.65 85
140 axodotdev/oranda ๐ŸŽ generate beautiful landing pages for your developer tools rs 64.9% $8.72 70
141 jarun/nnn nยณ The unorthodox terminal file manager c 64.8% $7.36 53
142 elkowar/pipr A tool to interactively write shell pipelines. rs 64.4% $7.60 62
143 jesseduffield/lazygit simple terminal UI for git commands go 62.2% $7.85 87
144 cweill/gotests Automatically generate Go test boilerplate from your source code. go 62.2% $7.99 102
145 yassinebridi/serpl A simple terminal UI for search and replace, ala VS Code. rs 62.1% $6.46 83
146 sharkdp/bat A cat(1) clone with wings. rs 61.5% $7.87 82
147 cslarsen/jp2a Converts jpg images to ASCII c 61.3% $8.75 97
148 Epistates/treemd A (TUI/CLI) markdown navigator with tree-based structural navigation. rs 58.9% $7.32 69
149 YS-L/flamelens Flamegraph viewer in the terminal rs 57.6% $4.30 48
150 Stranger6667/jsonschema A high-performance JSON Schema validator for Rust rs 57.1% $8.32 101
151 go-critic/go-critic The most opinionated Go source code linter for code audit. go 56.8% $9.11 82
152 kyoheiu/felix tui file manager with vim-like key mapping rs 56.8% $6.12 46
153 parcel-bundler/lightningcss An extremely fast CSS parser, transformer, bundler, and minifier written in Rust. rs 55.0% $8.05 68
154 FiloSottile/age A simple, modern and secure encryption tool (and Go library) with small explicit keys, no config options, and UNIX-style composability. go 54.9% $7.10 66
155 hairyhenderson/gomplate A flexible commandline tool for template rendering. Supports lots of local and remote datasources. go 54.7% $8.30 70
156 kyoh86/richgo Enrich `go test` outputs with text decorations. go 51.8% $4.11 56
157 rvben/rumdl Fast Markdown linter and formatter written in Rust rs 48.2% $9.73 63
158 ivanceras/svgbob Convert your ascii diagram scribbles into happy little SVG rs 47.7% $5.84 56
159 paradigmxyz/solar Blazingly fast, modular and contributor friendly Solidity compiler, written in Rust rs 47.4% $8.25 79
160 stacked-git/stgit Stacked Git rs 46.4% $7.28 80
161 tree-sitter/tree-sitter An incremental parsing system for programming tools rs 46.1% $10.62 88
162 arq5x/bedtools2 bedtools - the swiss army knife for genome arithmetic c 46.1% $7.07 60
163 mgechev/revive ๐Ÿ”ฅ ~6x faster, stricter, configurable, extensible, and beautiful drop-in replacement for golint go 45.9% $6.53 64
164 tukaani-project/xz XZ Utils c 44.7% $12.08 82
165 WGUNDERWOOD/tex-fmt An extremely fast LaTeX formatter written in Rust rs 44.0% $10.63 108
166 ducaale/xh Friendly and fast tool for sending HTTP requests rs 43.5% $10.20 89
167 antonmedv/fx Terminal JSON viewer & processor go 43.3% $7.63 71
168 sigoden/argc A Bash CLI framework, also a Bash command runner. rs 42.8% $13.46 111
169 ip7z/7zip 7-Zip cpp 41.7% $7.05 59
170 dandavison/delta A syntax-highlighting pager for git, diff, grep, rg --json, and blame output rs 38.9% $10.75 65
171 stathissideris/ditaa ditaa is a small command-line utility that can convert diagrams drawn using ascii art ('drawings' that contain characters that resemble lines like | / - ), into proper bitmap graphics. java 38.4% $10.67 99
172 mikefarah/yq yq is a portable command-line YAML, JSON, XML, CSV, TOML, HCL and properties processor go 37.5% $9.50 87
173 boyter/scc Sloc, Cloc and Code: scc is a very fast accurate code counter with complexity calculations and COCOMO estimates written in pure Go go 28.2% $17.09 107
174 hpjansson/chafa ๐Ÿ“บ๐Ÿ—ฟ Terminal graphics for the 21st century. c 28.0% $8.49 77
175 ast-grep/ast-grep โšกA CLI tool for code structural search, lint and rewriting. Written in Rust rs 23.6% $8.63 67
176 dalance/amber A code search / replace tool rs 23.2% $4.70 77
177 samtools/samtools Tools (written in C using htslib) for manipulating next-generation sequencing data c 22.6% $11.21 70
178 OSGeo/PROJ PROJ - Cartographic Projections and Coordinate Transformations Library cpp 22.3% $9.69 86
179 tstack/lnav Log file navigator cpp 21.7% $11.63 87
180 bellard/quickjs Public repository of the QuickJS Javascript Engine. c 21.3% $7.83 76
181 duckdb/duckdb DuckDB is an analytical in-process SQL database management system cpp 16.8% $7.51 77
182 zk-org/zk Plain text note-taking assistant go 16.2% $7.05 80
183 php/php-src The PHP Interpreter c 13.2% $12.89 115
184 alecthomas/chroma A general purpose syntax highlighter in pure Go go 13.1% $9.46 80
185 Nukesor/pueue :stars: Manage your shell commands. rs 8.3% $8.76 87
186 FFmpeg/FFmpeg Mirror of https://git.ffmpeg.org/ffmpeg.git c 7.0% $3.59 32
187 danmar/cppcheck static analysis of C/C++ code cpp 5.0% $5.35 63
188 typst/typst A markup-based typesetting system that is powerful and easy to learn. rs 3.7% $10.06 83
189 gromacs/gromacs Public/backup repository of the GROMACS molecular simulation toolkit. Please do not mine the metadata blindly; we use https://gitlab.com/gromacs/gromacs for code review and issue tracking. cpp 3.1% $7.86 62
190 crowdagger/crowbook Converts books written in Markdown to HTML, LaTeX/PDF and EPUB rs 2.9% $10.81 98
191 XAMPPRocky/tokei Count your code, quickly. rs 2.0% $10.01 98
192 doxygen/doxygen Official doxygen git repository c 1.7% $6.04 51
193 hush-shell/hush Hush is a unix shell based on the Lua programming language rs 0.8% $15.30 119
194 jgm/pandoc Universal markup converter hs 0.0% $3.56 41
195 johnkerl/miller Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON go 0.0% $5.15 60
196 OSGeo/gdal GDAL is an open source MIT licensed translator library for raster and vector geospatial data formats. cpp 0.0% $4.39 41
197 sharkdp/hyperfine A command-line benchmarking tool rs 0.0% $13.44 107
198 universal-ctags/ctags A maintained ctags implementation c 0.0% $3.75 34
199 AmmarAbouZor/tui-journal Your journal app if you live in a terminal rs n/a $6.96 63
200 chirlu/sox SoX, Swiss Army knife of sound processing c n/a $79.42 1,000

Click row to see task details