← Back to detailed results

Gemini 3.5 Flash

Google · mini-SWE-agent · Rank #7

0%
Resolved help_outline Percentage of instances fully solved as measured by hidden behavioral tests.
3.0%
Almost Resolved help_outline Instances where the agent's solution passes ≥ 95% of all hidden behavioral tests.
$1120
Total Cost help_outline Total API cost in USD across all task instances.
33,181
Total Calls help_outline Total number of LLM calls across all task instances.

Score (Behavioral Test Pass Rate) Distribution

Per-Instance Results

198 instances
# Repository Lang Score Cost Calls
1 BLAKE3-team/BLAKE3 the official Rust and C implementations of the BLAKE3 cryptographic hash function rs 98.1% $3.59 145
2 agourlay/zip-password-finder Find the password of protected ZIP files. rs 97.6% $4.35 192
3 simeg/eureka ๐Ÿ’ก CLI tool to input and store your ideas without leaving the terminal rs 97.1% $2.77 130
4 abishekvashok/cmatrix Terminal based "The Matrix" like implementation c 96.4% $2.34 76
5 mgdm/htmlq Like jq, but for HTML. rs 95.4% $5.29 149
6 htop-dev/htop htop - an interactive process viewer c 95.2% $2.89 84
7 sitkevij/hex ๐Ÿ”ฎ Futuristic take on hexdump, made in Rust. rs 94.0% $2.62 111
8 wfxr/csview ๐Ÿ“  Pretty and fast csv viewer for cli with cjk/emoji support. rs 92.2% $2.72 109
9 sheepla/pingu ๐Ÿงping command but with pingu go 91.3% $2.95 96
10 Miserlou/Loop UNIX's missing `loop` command rs 91.3% $4.35 174
11 sstadick/hck A sharp cut(1) clone. rs 91.2% $4.42 177
12 brocode/fblog Small command-line JSON Log viewer rs 89.7% $6.00 236
13 yaa110/nomino Batch rename utility for developers rs 88.8% $3.39 154
14 JohannesKaufmann/html-to-markdown โš™๏ธ Convert HTML to Markdown. Even works with entire websites and can be extended through rules. go 88.8% $4.75 262
15 riquito/tuc When cut doesn't cut it rs 88.8% $5.80 220
16 chmln/sd Intuitive find & replace CLI (sed alternative) rs 88.8% $1.50 118
17 mookid/diffr Yet another diff highlighting tool rs 88.6% $11.93 193
18 ismaelgv/rnr A command-line tool to batch rename files and directories rs 88.6% $3.69 147
19 BurntSushi/xsv A fast CSV command line toolkit written in Rust. rs 88.4% $7.21 198
20 rust-ethereum/ethabi Encode and decode smart contract invocations rs 87.9% $7.09 234
21 sharkdp/hexyl A command-line hex viewer rs 87.2% $10.51 188
22 raviqqe/muffet Fast website link checker in Go go 87.0% $4.01 169
23 xorg62/tty-clock Clock using lib ncurses c 86.5% $3.04 82
24 Byron/dua-cli View disk space usage and delete unwanted data, fast. rs 85.6% $3.76 149
25 pier-cli/pier A CLI to organize and run short Unix shell scripts rs 85.4% $3.85 183
26 wfxr/code-minimap ๐Ÿ›ฐ A high performance code minimap render. rs 85.3% $1.83 118
27 tomnomnom/gron Make JSON greppable! go 85.3% $3.63 153
28 madler/pigz A parallel implementation of gzip for modern multi-processor, multi-core machines. c 85.1% $3.72 161
29 ArthurSonzogni/json-tui A JSON terminal UI made in C++ cpp 84.5% $4.27 116
30 pemistahl/grex A command-line tool and Rust library with Python bindings for generating regular expressions from user-provided test cases rs 84.4% $6.38 205
31 noborus/ov ๐ŸŽ‘Feature-rich terminal-based text viewer. It is a so-called terminal pager. go 83.9% $4.04 133
32 clog-tool/clog-cli Generate beautiful changelogs from your Git commit history rs 83.7% $6.69 194
33 Lymphatus/caesium-clt Caesium Command Line Tools - Lossy/lossless image compression tool rs 83.5% $5.51 174
34 shashwatah/jot โšกRapid note management for the terminal. rs 83.1% $5.85 253
35 nachoparker/dutree a tool to analyze file system usage written in Rust rs 82.7% $5.00 134
36 svenstaro/miniserve ๐ŸŒŸ For when you really just want to serve some files over HTTP right now! rs 82.6% $5.74 153
37 psampaz/go-mod-outdated Find outdated dependencies of your Go projects. go-mod-outdated provides a table view of the go list -u -m -json all command which lists all dependencies of a Go project and their available minor and patch updates. It also provides a way to filter indirect dependencies and dependencies without updates. go 82.5% $0.91 66
38 sharkdp/pastel A command-line tool to generate, analyze, convert and manipulate colors rs 82.3% $10.77 199
39 ekzhang/bore ๐Ÿ•ณ bore is a simple CLI tool for making tunnels to localhost rs 82.2% $3.45 115
40 ajeetdsouza/zoxide A smarter cd command. Supports all major shells. rs 81.5% $5.28 204
41 tomarrell/wrapcheck A Go linter to check that errors from external packages are wrapped go 81.0% $2.81 198
42 mfridman/tparse CLI tool for summarizing go test output. Pipe friendly. CI/CD friendly. go 80.7% $5.45 176
43 kyoheiu/felix tui file manager with vim-like key mapping rs 80.4% $14.30 200
44 rs/curlie The power of curl, the ease of use of httpie. go 80.4% $2.41 99
45 eliukblau/pixterm Draw images in your ANSI terminal with true color go 80.0% $5.41 114
46 mibk/dupl a tool for code clone detection go 79.6% $2.77 105
47 rbakbashev/elfcat ELF visualizer. Generates HTML files from ELF binaries. rs 79.6% $6.96 180
48 git-bahn/git-graph Command line tool to show clear git graphs arranged for your branching model rs 79.6% $10.63 148
49 jarun/nnn nยณ The unorthodox terminal file manager c 79.0% $3.53 99
50 eradman/entr Run arbitrary commands when files change c 79.0% $2.45 134
51 zevv/duc Dude, where are my bytes: Duc, a library and suite of tools for inspecting disk usage c 78.9% $6.60 173
52 hooklift/gowsdl WSDL2Go code generation as well as its SOAP proxy go 78.8% $4.53 166
53 kyoh86/richgo Enrich `go test` outputs with text decorations. go 78.8% $4.64 193
54 astro/deadnix Scan Nix files for dead code rs 78.7% $4.35 98
55 anordal/shellharden The corrective bash syntax highlighter rs 78.4% $3.14 117
56 multiprocessio/dsq Commandline tool for running SQL queries against JSON, CSV, Excel, Parquet, and more. go 78.0% $8.37 231
57 Drew-Alleman/DataSurgeon Quickly Extracts IP's, Email Addresses, Hashes, Files, Credit Cards, Social Security Numbers and a lot More From Text rs 76.3% $7.15 268
58 peco/peco Simplistic interactive filtering tool go 76.1% $3.84 152
59 XAMPPRocky/tokei Count your code, quickly. rs 75.5% $7.17 215
60 incu6us/goimports-reviser Right imports sorting & code formatting tool (goimports alternative) go 75.4% $4.75 188
61 sclevine/yj CLI - Convert between YAML, TOML, JSON, and HCL. Preserves map order. go 75.0% $4.73 192
62 lz4/lz4 Extremely Fast Compression algorithm c 74.9% $3.79 169
63 nikolassv/bartib A simple timetracker for the command line. It saves a log of all tracked activities as a plaintext file and allows you to create flexible reports. rs 74.8% $7.01 195
64 trasta298/keifu Git genealogy, untangled. A TUI for navigating commit graphs with color and clarity. rs 74.4% $8.57 123
65 WGUNDERWOOD/tex-fmt An extremely fast LaTeX formatter written in Rust rs 74.3% $4.23 167
66 oppiliappan/eva a calculator REPL, similar to bc(1) rs 73.8% $4.93 212
67 sibprogrammer/xq Command-line XML and HTML beautifier and content extractor go 73.7% $5.92 163
68 noborus/trdsql CLI tool that can execute SQL queries on CSV, LTSV, JSON, YAML and TBLN. Can output to various formats. go 73.0% $3.64 147
69 skeema/skeema Declarative pure-SQL schema management for MySQL and MariaDB go 72.4% $4.08 156
70 konradsz/igrep Interactive Grep rs 72.2% $3.56 107
71 altdesktop/i3-style ๐ŸŽจ Make your i3 config a little more stylish. rs 72.0% $5.09 139
72 hatoo/oha Ohayou(ใŠใฏใ‚ˆใ†), HTTP load generator, inspired by rakyll/hey with tui animation. rs 71.3% $3.69 91
73 dalance/amber A code search / replace tool rs 71.2% $2.36 116
74 bensadeh/tailspin ๐ŸŒ€ A log file highlighter rs 70.8% $5.93 157
75 astaxie/bat Go implement CLI, cURL-like tool for humans go 69.9% $5.97 142
76 tukaani-project/xz XZ Utils c 69.9% $5.01 182
77 google/brotli Brotli compression format c 69.6% $6.04 199
78 svenstaro/genact ๐ŸŒ€ A nonsense activity generator rs 68.8% $5.23 115
79 junegunn/fzf :cherry_blossom: A command-line fuzzy finder go 68.7% $3.32 120
80 wintermute-cell/ngrrram A TUI tool to help you type faster and learn new layouts. Includes a free cat. rs 68.6% $4.27 108
81 blacknon/hwatch A modern alternative to the watch command, records the differences in execution results and can check this differences at after. rs 68.4% $6.05 145
82 Canop/rhit A nginx log explorer rs 67.9% $11.46 193
83 alexpovel/srgn A grep-like tool which understands source code syntax and allows for manipulation in addition to search rs 67.7% $6.42 237
84 chmln/handlr A better xdg-utils rs 66.6% $4.63 208
85 naggie/dstask Git powered terminal-based todo/note manager -- markdown note page per task. Single binary! go 66.5% $7.09 198
86 KSXGitHub/parallel-disk-usage Highly parallelized, blazing fast directory tree analyzer rs 66.5% $5.30 124
87 segmentio/chamber CLI for managing secrets go 65.8% $5.22 169
88 sirwart/ripsecrets A command-line tool to prevent committing secret keys into your source code rs 64.6% $6.24 147
89 cordx56/rustowl Visualize Ownership and Lifetimes in Rust rs 64.0% $8.41 196
90 lh3/seqtk Toolkit for processing sequences in FASTA/Q formats c 63.6% $11.52 270
91 bootandy/dust A more intuitive version of du in rust rs 63.2% $6.25 139
92 ggreer/the_silver_searcher A code-searching tool similar to ack, but faster. c 63.1% $7.35 218
93 guumaster/hostctl Your dev tool to manage /etc/hosts like a pro! go 62.8% $4.16 135
94 TheZoraiz/ascii-image-converter A cross-platform command-line tool to convert images into ascii art and print them on the console. Now supports braille art! go 62.8% $5.90 190
95 cheat/cheat cheat allows you to create and view interactive cheatsheets on the command-line. It was designed to help remind *nix system administrators of options for commands that they use frequently, but not frequently enough to remember. go 62.6% $6.83 275
96 dundee/gdu Fast disk usage analyzer with console interface written in Go go 62.6% $5.06 163
97 antonmedv/fx Terminal JSON viewer & processor go 62.5% $6.59 271
98 codesnap-rs/codesnap ๐Ÿฆ€๏ธ๐Ÿ“ธ Pure Rust tool to generate beautiful code snapshots, provide CLI and Library rs 62.0% $6.80 230
99 eudoxia0/hashcards A plain text-based spaced repetition system. rs 61.8% $9.93 235
100 jesseduffield/lazygit simple terminal UI for git commands go 61.1% $6.50 202
101 Isona/dirble Fast directory scanning and scraping tool rs 60.7% $3.88 106
102 axodotdev/oranda ๐ŸŽ generate beautiful landing pages for your developer tools rs 60.6% $3.92 150
103 NikolaDucak/caps-log A small TUI journaling tool. ๐Ÿ“– cpp 60.3% $16.34 251
104 Y2Z/monolith โฌ›๏ธ CLI tool and library for saving complete web pages as a single HTML file rs 60.0% $5.46 182
105 tinycc/tinycc Unofficial mirror of mob development branch c 59.7% $2.29 117
106 Esubaalew/run Universal multi-language runner and smart REPL written in Rust. rs 59.7% $4.26 156
107 direnv/direnv unclutter your .profile go 58.8% $7.43 283
108 antonmedv/walk Terminal file manager go 58.5% $8.08 190
109 cslarsen/jp2a Converts jpg images to ASCII c 57.8% $8.01 227
110 ecumene/rust-sloth A 3D software rasterizer... for the terminal! rs 57.4% $9.42 157
111 orf/gping Ping, but with a graph rs 56.5% $4.22 109
112 yassinebridi/serpl A simple terminal UI for search and replace, ala VS Code. rs 56.4% $7.57 168
113 kisielk/errcheck errcheck checks that you checked errors. go 56.2% $3.29 155
114 lfos/calcurse A text-based calendar and scheduling application c 56.2% $11.16 247
115 Canop/broot A new way to see and navigate directory trees : https://dystroy.org/broot rs 54.3% $2.51 86
116 elkowar/pipr A tool to interactively write shell pipelines. rs 54.2% $4.19 145
117 foriequal0/git-trim Automatically trims your branches whose tracking remote refs are merged or stray rs 53.4% $4.22 141
118 hairyhenderson/gomplate A flexible commandline tool for template rendering. Supports lots of local and remote datasources. go 52.1% $6.70 180
119 Stranger6667/jsonschema A high-performance JSON Schema validator for Rust rs 51.9% $4.95 150
120 YS-L/flamelens Flamegraph viewer in the terminal rs 51.6% $6.36 120
121 AmmarAbouZor/tui-journal Your journal app if you live in a terminal rs 50.8% $4.42 161
122 crowdagger/crowbook Converts books written in Markdown to HTML, LaTeX/PDF and EPUB rs 50.7% $7.78 244
123 BurntSushi/ripgrep ripgrep recursively searches directories for a regex pattern while respecting your gitignore rs 50.0% $4.23 146
124 parcel-bundler/lightningcss An extremely fast CSS parser, transformer, bundler, and minifier written in Rust. rs 49.7% $6.09 211
125 gabotechs/dep-tree Tool for helping developers keep their code bases clean and decoupled. It allows visualising a code base complexity using a 3d force-directed graph of files and the dependencies between them. go 49.2% $5.84 181
126 facebook/zstd Zstandard - Fast real-time compression algorithm c 48.9% $4.18 210
127 mkj/dropbear Dropbear SSH c 48.4% $3.33 121
128 rcoh/angle-grinder Slice and dice logs on the command line rs 46.8% $8.07 253
129 jrnxf/thokr โœจ sleek typing tui with visualized results and historical logging rs 46.4% $4.44 113
130 ducaale/xh Friendly and fast tool for sending HTTP requests rs 45.9% $4.74 187
131 go-critic/go-critic The most opinionated Go source code linter for code audit. go 45.2% $4.14 171
132 Epistates/treemd A (TUI/CLI) markdown navigator with tree-based structural navigation. rs 45.1% $6.72 243
133 rs/jplot iTerm2 expvar/JSON monitoring tool go 44.9% $3.88 80
134 cweill/gotests Automatically generate Go test boilerplate from your source code. go 44.6% $5.46 175
135 robertdavidgraham/masscan TCP port scanner, spews SYN packets asynchronously, scanning entire Internet in under 5 minutes. c 44.3% $4.90 227
136 rochacbruno/marmite Markdown makes sites - A Static Site Generator for Blogs rs 43.9% $8.94 216
137 jhspetersson/fselect Find files with SQL-like queries rs 42.4% $9.72 275
138 nuta/nsh A command-line shell like fish, but POSIX compatible. rs 41.7% $7.17 192
139 pls-rs/pls pls is a prettier and powerful ls(1) for the pros. rs 40.8% $5.98 150
140 boyter/scc Sloc, Cloc and Code: scc is a very fast accurate code counter with complexity calculations and COCOMO estimates written in pure Go go 40.5% $6.55 177
141 ivanceras/svgbob Convert your ascii diagram scribbles into happy little SVG rs 39.8% $5.65 147
142 sayanarijit/xplr A hackable, minimal, fast TUI file explorer rs 39.6% $4.19 154
143 cmatsuoka/figlet Claudio's FIGlet tree c 38.8% $3.26 141
144 ninja-build/ninja a small build system with a focus on speed cpp 37.8% $4.46 211
145 unhappychoice/gittype A CLI code-typing game that turns your source code into typing challenges rs 35.6% $8.13 207
146 hush-shell/hush Hush is a unix shell based on the Lua programming language rs 35.1% $53.40 626
147 rust-lang/mdBook Create book from markdown files. Like Gitbook but implemented in Rust rs 34.8% $2.12 74
148 ariga/atlas Declarative schema migrations with schema-as-code workflows go 32.3% $4.30 150
149 jqlang/jq Command-line JSON processor c 30.0% $4.38 192
150 oppiliappan/statix lints and suggestions for the nix programming language rs 29.2% $6.32 164
151 mgechev/revive ๐Ÿ”ฅ ~6x faster, stricter, configurable, extensible, and beautiful drop-in replacement for golint go 29.0% $5.82 220
152 arq5x/bedtools2 bedtools - the swiss army knife for genome arithmetic c 29.0% $7.55 221
153 ip7z/7zip 7-Zip cpp 28.4% $3.58 127
154 stacked-git/stgit Stacked Git rs 27.2% $4.06 171
155 doxygen/doxygen Official doxygen git repository c 27.1% $5.23 174
156 OSGeo/PROJ PROJ - Cartographic Projections and Coordinate Transformations Library cpp 25.9% $7.33 273
157 LuaJIT/LuaJIT Mirror of the LuaJIT git repository c 25.6% $4.40 129
158 rhysd/kiro-editor A small terminal UTF-8 text editor written in Rust ๐Ÿ“๐Ÿฆ€ rs 23.9% $4.96 97
159 sigoden/argc A Bash CLI framework, also a Bash command runner. rs 22.2% $5.78 213
160 HaliteChallenge/Halite @twosigma's first artificial intelligence programming challenge cpp 18.5% $5.29 172
161 danmar/cppcheck static analysis of C/C++ code cpp 18.3% $4.17 152
162 zk-org/zk Plain text note-taking assistant go 18.0% $6.31 234
163 rvben/rumdl Fast Markdown linter and formatter written in Rust rs 17.2% $9.57 228
164 FiloSottile/age A simple, modern and secure encryption tool (and Go library) with small explicit keys, no config options, and UNIX-style composability. go 14.8% $3.96 115
165 mikefarah/yq yq is a portable command-line YAML, JSON, XML, CSV, TOML, HCL and properties processor go 14.4% $2.45 76
166 kaushiksrini/parqeye Peek inside Parquet files right from your terminal rs 13.2% $17.60 262
167 tree-sitter/tree-sitter An incremental parsing system for programming tools rs 11.8% $1.81 87
168 johnkerl/miller Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON go 11.5% $5.31 174
169 hpjansson/chafa ๐Ÿ“บ๐Ÿ—ฟ Terminal graphics for the 21st century. c 11.4% $4.78 160
170 Nukesor/pueue :stars: Manage your shell commands. rs 10.8% $3.76 134
171 stathissideris/ditaa ditaa is a small command-line utility that can convert diagrams drawn using ascii art ('drawings' that contain characters that resemble lines like | / - ), into proper bitmap graphics. java 10.3% $3.77 91
172 duckdb/duckdb DuckDB is an analytical in-process SQL database management system cpp 9.4% $5.55 188
173 ogham/dog A command-line DNS client. rs 8.8% $5.66 164
174 FFmpeg/FFmpeg Mirror of https://git.ffmpeg.org/ffmpeg.git c 8.1% $1.21 77
175 jgm/pandoc Universal markup converter hs 7.8% $5.10 177
176 ast-grep/ast-grep โšกA CLI tool for code structural search, lint and rewriting. Written in Rust rs 7.8% $6.16 138
177 universal-ctags/ctags A maintained ctags implementation c 7.2% $4.40 111
178 samtools/samtools Tools (written in C using htslib) for manipulating next-generation sequencing data c 5.5% $3.29 100
179 facebookresearch/fastText Library for fast text representation and classification. cpp 5.4% $3.34 107
180 jonas/tig Text-mode interface for git c 3.6% $2.59 99
181 typst/typst A markup-based typesetting system that is powerful and easy to learn. rs 3.2% $2.50 93
182 sharkdp/bat A cat(1) clone with wings. rs 2.6% $6.37 164
183 o2sh/onefetch Command-line Git information tool rs 2.3% $8.52 220
184 lua/lua A copy of the Lua development repository, as seen by the Lua team. Mirrored irregularly. All communication should be through the Lua mailing list https://www.lua.org/lua-l.html c 1.6% $4.85 147
185 gromacs/gromacs Public/backup repository of the GROMACS molecular simulation toolkit. Please do not mine the metadata blindly; we use https://gitlab.com/gromacs/gromacs for code review and issue tracking. cpp 1.5% $0.83 63
186 chirlu/sox SoX, Swiss Army knife of sound processing c 1.3% $4.31 132
187 sqlite/sqlite Official Git mirror of the SQLite source tree c 1.0% $6.54 277
188 dandavison/delta A syntax-highlighting pager for git, diff, grep, rg --json, and blame output rs 0.7% $1.85 79
189 paradigmxyz/solar Blazingly fast, modular and contributor friendly Solidity compiler, written in Rust rs 0.5% $1.88 99
190 alecthomas/chroma A general purpose syntax highlighter in pure Go go 0.0% $14.88 283
191 bellard/quickjs Public repository of the QuickJS Javascript Engine. c 0.0% $3.24 160
192 OSGeo/gdal GDAL is an open source MIT licensed translator library for raster and vector geospatial data formats. cpp 0.0% $4.95 163
193 php/php-src The PHP Interpreter c 0.0% $3.13 124
194 quinn-rs/quinn Async-friendly QUIC implementation in Rust rs 0.0% $4.36 93
195 rust-embedded/svd2rust Generate Rust register maps (`struct`s) from SVD files rs 0.0% $11.97 149
196 sharkdp/fd A simple, fast and user-friendly alternative to 'find' rs 0.0% $3.92 134
197 tstack/lnav Log file navigator cpp 0.0% $5.04 178
198 yoav-lavi/melody Melody is a language that compiles to regular expressions and aims to be more readable and maintainable rs 0.0% $5.11 280

Click row to see task details