← Back to detailed results

Gemini 3.6 Flash

Google · mini-SWE-agent · Rank #3

0.5%
Resolved help_outline Percentage of instances fully solved as measured by hidden behavioral tests.
4.0%
Almost Resolved help_outline Instances where the agent's solution passes ≥ 95% of all hidden behavioral tests.
$966
Total Cost help_outline Total API cost in USD across all task instances.
29,991
Total Calls help_outline Total number of LLM calls across all task instances.

Score (Behavioral Test Pass Rate) Distribution

Per-Instance Results

198 instances
# Repository Lang Score Cost Calls
1 abishekvashok/cmatrix Terminal based "The Matrix" like implementation c 100.0% $2.47 96
2 psampaz/go-mod-outdated Find outdated dependencies of your Go projects. go-mod-outdated provides a table view of the go list -u -m -json all command which lists all dependencies of a Go project and their available minor and patch updates. It also provides a way to filter indirect dependencies and dependencies without updates. go 98.6% $1.34 63
3 jarun/nnn nยณ The unorthodox terminal file manager c 97.7% $2.43 89
4 sitkevij/hex ๐Ÿ”ฎ Futuristic take on hexdump, made in Rust. rs 96.5% $2.27 90
5 agourlay/zip-password-finder Find the password of protected ZIP files. rs 96.5% $3.61 156
6 htop-dev/htop htop - an interactive process viewer c 96.2% $3.14 106
7 riquito/tuc When cut doesn't cut it rs 95.5% $4.35 155
8 nachoparker/dutree a tool to analyze file system usage written in Rust rs 95.5% $6.70 162
9 wfxr/csview ๐Ÿ“  Pretty and fast csv viewer for cli with cjk/emoji support. rs 94.6% $3.23 119
10 BLAKE3-team/BLAKE3 the official Rust and C implementations of the BLAKE3 cryptographic hash function rs 93.7% $2.17 111
11 sheepla/pingu ๐Ÿงping command but with pingu go 93.1% $3.32 101
12 shashwatah/jot โšกRapid note management for the terminal. rs 93.0% $4.14 138
13 mgdm/htmlq Like jq, but for HTML. rs 92.3% $4.14 213
14 wintermute-cell/ngrrram A TUI tool to help you type faster and learn new layouts. Includes a free cat. rs 92.1% $6.41 163
15 Miserlou/Loop UNIX's missing `loop` command rs 92.0% $4.66 223
16 simeg/eureka ๐Ÿ’ก CLI tool to input and store your ideas without leaving the terminal rs 91.9% $3.49 139
17 ismaelgv/rnr A command-line tool to batch rename files and directories rs 91.7% $3.63 184
18 orf/gping Ping, but with a graph rs 91.4% $2.43 111
19 sstadick/hck A sharp cut(1) clone. rs 91.1% $3.22 153
20 ogham/dog A command-line DNS client. rs 90.8% $4.40 162
21 wfxr/code-minimap ๐Ÿ›ฐ A high performance code minimap render. rs 90.4% $2.78 127
22 mfridman/tparse CLI tool for summarizing go test output. Pipe friendly. CI/CD friendly. go 89.2% $5.21 170
23 mookid/diffr Yet another diff highlighting tool rs 88.9% $15.26 182
24 chmln/sd Intuitive find & replace CLI (sed alternative) rs 88.9% $2.77 176
25 guumaster/hostctl Your dev tool to manage /etc/hosts like a pro! go 88.6% $4.84 220
26 raviqqe/muffet Fast website link checker in Go go 88.4% $4.89 161
27 nikolassv/bartib A simple timetracker for the command line. It saves a log of all tracked activities as a plaintext file and allows you to create flexible reports. rs 88.2% $4.73 141
28 chmln/handlr A better xdg-utils rs 88.0% $4.44 157
29 Byron/dua-cli View disk space usage and delete unwanted data, fast. rs 87.9% $2.94 114
30 KSXGitHub/parallel-disk-usage Highly parallelized, blazing fast directory tree analyzer rs 87.6% $13.76 236
31 astro/deadnix Scan Nix files for dead code rs 86.9% $5.78 154
32 JohannesKaufmann/html-to-markdown โš™๏ธ Convert HTML to Markdown. Even works with entire websites and can be extended through rules. go 86.2% $3.86 142
33 rust-ethereum/ethabi Encode and decode smart contract invocations rs 85.8% $4.08 147
34 rs/curlie The power of curl, the ease of use of httpie. go 85.1% $4.78 122
35 sirwart/ripsecrets A command-line tool to prevent committing secret keys into your source code rs 85.1% $4.26 139
36 git-bahn/git-graph Command line tool to show clear git graphs arranged for your branching model rs 85.0% $3.16 114
37 antonmedv/walk Terminal file manager go 84.7% $3.53 129
38 oppiliappan/eva a calculator REPL, similar to bc(1) rs 84.6% $3.18 131
39 sharkdp/pastel A command-line tool to generate, analyze, convert and manipulate colors rs 84.1% $5.17 139
40 HaliteChallenge/Halite @twosigma's first artificial intelligence programming challenge cpp 84.0% $3.51 121
41 noborus/ov ๐ŸŽ‘Feature-rich terminal-based text viewer. It is a so-called terminal pager. go 84.0% $4.34 151
42 kyoh86/richgo Enrich `go test` outputs with text decorations. go 83.2% $3.28 129
43 pier-cli/pier A CLI to organize and run short Unix shell scripts rs 83.1% $2.85 151
44 tomnomnom/gron Make JSON greppable! go 83.0% $4.65 161
45 rhysd/kiro-editor A small terminal UTF-8 text editor written in Rust ๐Ÿ“๐Ÿฆ€ rs 82.9% $3.15 98
46 trasta298/keifu Git genealogy, untangled. A TUI for navigating commit graphs with color and clarity. rs 82.8% $4.24 106
47 bensadeh/tailspin ๐ŸŒ€ A log file highlighter rs 82.2% $10.86 221
48 codesnap-rs/codesnap ๐Ÿฆ€๏ธ๐Ÿ“ธ Pure Rust tool to generate beautiful code snapshots, provide CLI and Library rs 82.0% $4.02 164
49 zevv/duc Dude, where are my bytes: Duc, a library and suite of tools for inspecting disk usage c 81.9% $4.04 138
50 pemistahl/grex A command-line tool and Rust library with Python bindings for generating regular expressions from user-provided test cases rs 81.8% $46.97 435
51 BurntSushi/xsv A fast CSV command line toolkit written in Rust. rs 81.4% $3.39 131
52 lz4/lz4 Extremely Fast Compression algorithm c 81.3% $2.41 93
53 sibprogrammer/xq Command-line XML and HTML beautifier and content extractor go 80.6% $3.48 169
54 ekzhang/bore ๐Ÿ•ณ bore is a simple CLI tool for making tunnels to localhost rs 80.4% $3.47 134
55 anordal/shellharden The corrective bash syntax highlighter rs 80.2% $11.64 216
56 xorg62/tty-clock Clock using lib ncurses c 80.1% $2.77 100
57 brocode/fblog Small command-line JSON Log viewer rs 80.1% $2.98 138
58 cmatsuoka/figlet Claudio's FIGlet tree c 79.1% $26.03 240
59 ajeetdsouza/zoxide A smarter cd command. Supports all major shells. rs 78.5% $3.18 144
60 segmentio/chamber CLI for managing secrets go 78.5% $3.09 101
61 eradman/entr Run arbitrary commands when files change c 78.0% $2.06 108
62 blacknon/hwatch A modern alternative to the watch command, records the differences in execution results and can check this differences at after. rs 78.0% $3.13 144
63 sclevine/yj CLI - Convert between YAML, TOML, JSON, and HCL. Preserves map order. go 77.1% $3.74 153
64 konradsz/igrep Interactive Grep rs 76.6% $2.80 105
65 sharkdp/hexyl A command-line hex viewer rs 76.6% $4.79 129
66 multiprocessio/dsq Commandline tool for running SQL queries against JSON, CSV, Excel, Parquet, and more. go 76.4% $2.98 143
67 peco/peco Simplistic interactive filtering tool go 76.4% $5.02 181
68 naggie/dstask Git powered terminal-based todo/note manager -- markdown note page per task. Single binary! go 75.9% $6.51 165
69 direnv/direnv unclutter your .profile go 75.6% $4.81 173
70 yaa110/nomino Batch rename utility for developers rs 75.4% $2.63 156
71 skeema/skeema Declarative pure-SQL schema management for MySQL and MariaDB go 75.2% $3.07 120
72 Drew-Alleman/DataSurgeon Quickly Extracts IP's, Email Addresses, Hashes, Files, Credit Cards, Social Security Numbers and a lot More From Text rs 75.1% $3.47 146
73 Canop/rhit A nginx log explorer rs 74.7% $6.20 155
74 noborus/trdsql CLI tool that can execute SQL queries on CSV, LTSV, JSON, YAML and TBLN. Can output to various formats. go 73.6% $3.64 162
75 clog-tool/clog-cli Generate beautiful changelogs from your Git commit history rs 73.4% $4.76 213
76 alexpovel/srgn A grep-like tool which understands source code syntax and allows for manipulation in addition to search rs 71.7% $3.25 139
77 mibk/dupl a tool for code clone detection go 70.8% $2.41 123
78 incu6us/goimports-reviser Right imports sorting & code formatting tool (goimports alternative) go 70.8% $3.29 152
79 facebook/zstd Zstandard - Fast real-time compression algorithm c 70.8% $3.23 144
80 antonmedv/fx Terminal JSON viewer & processor go 70.6% $4.66 176
81 XAMPPRocky/tokei Count your code, quickly. rs 70.4% $4.33 176
82 altdesktop/i3-style ๐ŸŽจ Make your i3 config a little more stylish. rs 69.9% $3.33 121
83 quinn-rs/quinn Async-friendly QUIC implementation in Rust rs 69.7% $3.08 94
84 rust-embedded/svd2rust Generate Rust register maps (`struct`s) from SVD files rs 69.4% $3.84 121
85 ArthurSonzogni/json-tui A JSON terminal UI made in C++ cpp 69.3% $4.77 117
86 kaushiksrini/parqeye Peek inside Parquet files right from your terminal rs 69.1% $5.24 138
87 junegunn/fzf :cherry_blossom: A command-line fuzzy finder go 69.1% $1.98 110
88 sayanarijit/xplr A hackable, minimal, fast TUI file explorer rs 68.5% $3.44 138
89 unhappychoice/gittype A CLI code-typing game that turns your source code into typing challenges rs 68.4% $4.57 170
90 sqlite/sqlite Official Git mirror of the SQLite source tree c 67.9% $3.58 156
91 tinycc/tinycc Unofficial mirror of mob development branch c 67.3% $3.22 150
92 sharkdp/fd A simple, fast and user-friendly alternative to 'find' rs 67.0% $2.93 155
93 BurntSushi/ripgrep ripgrep recursively searches directories for a regex pattern while respecting your gitignore rs 67.0% $5.01 184
94 jrnxf/thokr โœจ sleek typing tui with visualized results and historical logging rs 66.8% $4.86 159
95 yoav-lavi/melody Melody is a language that compiles to regular expressions and aims to be more readable and maintainable rs 66.4% $3.80 180
96 ninja-build/ninja a small build system with a focus on speed cpp 66.3% $3.52 166
97 mkj/dropbear Dropbear SSH c 66.1% $11.00 239
98 robertdavidgraham/masscan TCP port scanner, spews SYN packets asynchronously, scanning entire Internet in under 5 minutes. c 65.6% $3.58 129
99 hairyhenderson/gomplate A flexible commandline tool for template rendering. Supports lots of local and remote datasources. go 65.4% $4.87 145
100 FiloSottile/age A simple, modern and secure encryption tool (and Go library) with small explicit keys, no config options, and UNIX-style composability. go 65.1% $6.50 183
101 kyoheiu/felix tui file manager with vim-like key mapping rs 65.1% $4.03 143
102 rs/jplot iTerm2 expvar/JSON monitoring tool go 64.8% $6.60 153
103 lh3/seqtk Toolkit for processing sequences in FASTA/Q formats c 64.6% $14.32 223
104 NikolaDucak/caps-log A small TUI journaling tool. ๐Ÿ“– cpp 64.4% $3.92 139
105 Esubaalew/run Universal multi-language runner and smart REPL written in Rust. rs 63.5% $2.98 105
106 Isona/dirble Fast directory scanning and scraping tool rs 63.4% $5.90 143
107 dundee/gdu Fast disk usage analyzer with console interface written in Go go 63.0% $5.15 177
108 Canop/broot A new way to see and navigate directory trees : https://dystroy.org/broot rs 62.3% $3.63 112
109 astaxie/bat Go implement CLI, cURL-like tool for humans go 62.1% $2.88 102
110 hush-shell/hush Hush is a unix shell based on the Lua programming language rs 61.8% $14.23 284
111 google/brotli Brotli compression format c 61.7% $3.46 133
112 YS-L/flamelens Flamegraph viewer in the terminal rs 60.1% $4.04 145
113 tomarrell/wrapcheck A Go linter to check that errors from external packages are wrapped go 59.8% $7.64 259
114 jesseduffield/lazygit simple terminal UI for git commands go 58.6% $2.83 95
115 bootandy/dust A more intuitive version of du in rust rs 58.2% $3.30 128
116 foriequal0/git-trim Automatically trims your branches whose tracking remote refs are merged or stray rs 58.2% $5.85 151
117 ariga/atlas Declarative schema migrations with schema-as-code workflows go 57.7% $3.97 176
118 Y2Z/monolith โฌ›๏ธ CLI tool and library for saving complete web pages as a single HTML file rs 56.7% $2.89 103
119 lfos/calcurse A text-based calendar and scheduling application c 56.2% $4.16 166
120 jqlang/jq Command-line JSON processor c 56.1% $7.69 170
121 cslarsen/jp2a Converts jpg images to ASCII c 55.9% $4.24 167
122 elkowar/pipr A tool to interactively write shell pipelines. rs 55.3% $3.60 134
123 nuta/nsh A command-line shell like fish, but POSIX compatible. rs 55.2% $7.28 204
124 hatoo/oha Ohayou(ใŠใฏใ‚ˆใ†), HTTP load generator, inspired by rakyll/hey with tui animation. rs 54.6% $3.62 111
125 dalance/amber A code search / replace tool rs 54.3% $3.60 154
126 rust-lang/mdBook Create book from markdown files. Like Gitbook but implemented in Rust rs 53.8% $3.27 140
127 AmmarAbouZor/tui-journal Your journal app if you live in a terminal rs 53.4% $4.03 118
128 facebookresearch/fastText Library for fast text representation and classification. cpp 52.2% $4.51 116
129 cweill/gotests Automatically generate Go test boilerplate from your source code. go 51.6% $3.67 170
130 pls-rs/pls pls is a prettier and powerful ls(1) for the pros. rs 51.4% $3.58 143
131 svenstaro/genact ๐ŸŒ€ A nonsense activity generator rs 49.8% $2.87 93
132 ecumene/rust-sloth A 3D software rasterizer... for the terminal! rs 49.7% $6.19 159
133 Stranger6667/jsonschema A high-performance JSON Schema validator for Rust rs 48.0% $3.54 122
134 cheat/cheat cheat allows you to create and view interactive cheatsheets on the command-line. It was designed to help remind *nix system administrators of options for commands that they use frequently, but not frequently enough to remember. go 47.1% $3.53 143
135 go-critic/go-critic The most opinionated Go source code linter for code audit. go 46.7% $2.19 116
136 Epistates/treemd A (TUI/CLI) markdown navigator with tree-based structural navigation. rs 45.1% $4.51 137
137 LuaJIT/LuaJIT Mirror of the LuaJIT git repository c 44.5% $3.34 143
138 ducaale/xh Friendly and fast tool for sending HTTP requests rs 44.3% $3.04 113
139 mgechev/revive ๐Ÿ”ฅ ~6x faster, stricter, configurable, extensible, and beautiful drop-in replacement for golint go 42.0% $2.59 120
140 WGUNDERWOOD/tex-fmt An extremely fast LaTeX formatter written in Rust rs 41.3% $3.32 172
141 kisielk/errcheck errcheck checks that you checked errors. go 40.6% $3.44 154
142 ivanceras/svgbob Convert your ascii diagram scribbles into happy little SVG rs 39.8% $13.38 229
143 tukaani-project/xz XZ Utils c 39.4% $2.55 142
144 zk-org/zk Plain text note-taking assistant go 38.8% $4.31 191
145 parcel-bundler/lightningcss An extremely fast CSS parser, transformer, bundler, and minifier written in Rust. rs 38.4% $3.18 147
146 tarka/xcp An extended `cp` rs 38.0% $2.84 136
147 rcoh/angle-grinder Slice and dice logs on the command line rs 37.6% $4.27 192
148 sigoden/argc A Bash CLI framework, also a Bash command runner. rs 36.5% $13.42 232
149 arq5x/bedtools2 bedtools - the swiss army knife for genome arithmetic c 35.1% $9.48 213
150 doxygen/doxygen Official doxygen git repository c 33.6% $2.26 88
151 typst/typst A markup-based typesetting system that is powerful and easy to learn. rs 32.7% $2.25 104
152 boyter/scc Sloc, Cloc and Code: scc is a very fast accurate code counter with complexity calculations and COCOMO estimates written in pure Go go 32.1% $4.31 141
153 hooklift/gowsdl WSDL2Go code generation as well as its SOAP proxy go 31.7% $5.65 153
154 rochacbruno/marmite Markdown makes sites - A Static Site Generator for Blogs rs 28.6% $3.97 126
155 alecthomas/chroma A general purpose syntax highlighter in pure Go go 26.2% $6.32 184
156 ast-grep/ast-grep โšกA CLI tool for code structural search, lint and rewriting. Written in Rust rs 24.5% $3.30 143
157 stathissideris/ditaa ditaa is a small command-line utility that can convert diagrams drawn using ascii art ('drawings' that contain characters that resemble lines like | / - ), into proper bitmap graphics. java 22.8% $3.68 139
158 eliukblau/pixterm Draw images in your ANSI terminal with true color go 19.3% $4.14 136
159 danmar/cppcheck static analysis of C/C++ code cpp 18.7% $3.84 122
160 johnkerl/miller Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON go 18.5% $3.97 157
161 samtools/samtools Tools (written in C using htslib) for manipulating next-generation sequencing data c 18.4% $12.90 146
162 OSGeo/gdal GDAL is an open source MIT licensed translator library for raster and vector geospatial data formats. cpp 16.0% $7.02 181
163 tree-sitter/tree-sitter An incremental parsing system for programming tools rs 13.4% $2.60 144
164 oppiliappan/statix lints and suggestions for the nix programming language rs 11.3% $2.99 140
165 OSGeo/PROJ PROJ - Cartographic Projections and Coordinate Transformations Library cpp 10.9% $3.92 146
166 jgm/pandoc Universal markup converter hs 10.5% $6.31 199
167 svenstaro/miniserve ๐ŸŒŸ For when you really just want to serve some files over HTTP right now! rs 9.9% $6.99 154
168 dandavison/delta A syntax-highlighting pager for git, diff, grep, rg --json, and blame output rs 9.6% $3.73 129
169 ggreer/the_silver_searcher A code-searching tool similar to ack, but faster. c 9.5% $4.13 164
170 gromacs/gromacs Public/backup repository of the GROMACS molecular simulation toolkit. Please do not mine the metadata blindly; we use https://gitlab.com/gromacs/gromacs for code review and issue tracking. cpp 8.1% $4.11 120
171 axodotdev/oranda ๐ŸŽ generate beautiful landing pages for your developer tools rs 7.3% $3.88 148
172 bellard/quickjs Public repository of the QuickJS Javascript Engine. c 7.2% $3.67 116
173 yassinebridi/serpl A simple terminal UI for search and replace, ala VS Code. rs 6.7% $3.44 139
174 jhspetersson/fselect Find files with SQL-like queries rs 6.2% $5.44 161
175 eudoxia0/hashcards A plain text-based spaced repetition system. rs 6.1% $5.44 173
176 paradigmxyz/solar Blazingly fast, modular and contributor friendly Solidity compiler, written in Rust rs 6.1% $4.96 151
177 stacked-git/stgit Stacked Git rs 4.0% $2.04 91
178 duckdb/duckdb DuckDB is an analytical in-process SQL database management system cpp 3.8% $2.89 138
179 hpjansson/chafa ๐Ÿ“บ๐Ÿ—ฟ Terminal graphics for the 21st century. c 3.4% $6.45 210
180 crowdagger/crowbook Converts books written in Markdown to HTML, LaTeX/PDF and EPUB rs 2.9% $4.59 188
181 rvben/rumdl Fast Markdown linter and formatter written in Rust rs 2.7% $4.14 146
182 o2sh/onefetch Command-line Git information tool rs 2.3% $9.51 212
183 lua/lua A copy of the Lua development repository, as seen by the Lua team. Mirrored irregularly. All communication should be through the Lua mailing list https://www.lua.org/lua-l.html c 2.2% $2.84 147
184 FFmpeg/FFmpeg Mirror of https://git.ffmpeg.org/ffmpeg.git c 2.1% $4.60 121
185 sharkdp/bat A cat(1) clone with wings. rs 2.0% $5.70 143
186 Nukesor/pueue :stars: Manage your shell commands. rs 1.6% $2.81 105
187 Lymphatus/caesium-clt Caesium Command Line Tools - Lossy/lossless image compression tool rs 1.6% $6.01 203
188 mikefarah/yq yq is a portable command-line YAML, JSON, XML, CSV, TOML, HCL and properties processor go 1.1% $4.68 144
189 chirlu/sox SoX, Swiss Army knife of sound processing c 1.1% $2.72 106
190 ip7z/7zip 7-Zip cpp 0.6% $3.90 111
191 tstack/lnav Log file navigator cpp 0.5% $3.29 199
192 php/php-src The PHP Interpreter c 0.3% $3.46 132
193 universal-ctags/ctags A maintained ctags implementation c 0.1% $3.43 155
194 cordx56/rustowl Visualize Ownership and Lifetimes in Rust rs 0.0% $4.17 165
195 gabotechs/dep-tree Tool for helping developers keep their code bases clean and decoupled. It allows visualising a code base complexity using a 3d force-directed graph of files and the dependencies between them. go 0.0% $4.73 192
196 rbakbashev/elfcat ELF visualizer. Generates HTML files from ELF binaries. rs 0.0% $8.48 209
197 sharkdp/hyperfine A command-line benchmarking tool rs 0.0% $6.36 195
198 TheZoraiz/ascii-image-converter A cross-platform command-line tool to convert images into ascii art and print them on the console. Now supports braille art! go 0.0% $12.22 263

Click row to see task details