← Back to detailed results

Gemini 3 Flash

Google · mini-SWE-agent · Rank #10

0%
Resolved help_outline Percentage of instances fully solved as measured by hidden behavioral tests.
0.0%
Almost Resolved help_outline Instances where the agent's solution passes ≥ 95% of all hidden behavioral tests.
$59
Total Cost help_outline Total API cost in USD across all task instances.
16,996
Total Calls help_outline Total number of LLM calls across all task instances.

Score (Behavioral Test Pass Rate) Distribution

Per-Instance Results

200 instances
# Repository Lang Score Cost Calls
1 psampaz/go-mod-outdated Find outdated dependencies of your Go projects. go-mod-outdated provides a table view of the go list -u -m -json all command which lists all dependencies of a Go project and their available minor and patch updates. It also provides a way to filter indirect dependencies and dependencies without updates. go 86.7% $0.14 55
2 mgdm/htmlq Like jq, but for HTML. rs 84.4% $0.29 140
3 wfxr/csview ๐Ÿ“  Pretty and fast csv viewer for cli with cjk/emoji support. rs 83.0% $0.28 100
4 chmln/sd Intuitive find & replace CLI (sed alternative) rs 80.7% $0.25 111
5 tomnomnom/gron Make JSON greppable! go 79.0% $0.31 121
6 incu6us/goimports-reviser Right imports sorting & code formatting tool (goimports alternative) go 74.1% $0.34 121
7 Drew-Alleman/DataSurgeon Quickly Extracts IP's, Email Addresses, Hashes, Files, Credit Cards, Social Security Numbers and a lot More From Text rs 73.3% $0.30 112
8 agourlay/zip-password-finder Find the password of protected ZIP files. rs 72.9% $0.26 118
9 jonas/tig Text-mode interface for git c 71.2% $0.19 54
10 rs/curlie The power of curl, the ease of use of httpie. go 70.5% $0.22 85
11 rhysd/kiro-editor A small terminal UTF-8 text editor written in Rust ๐Ÿ“๐Ÿฆ€ rs 69.7% $0.35 64
12 ogham/dog A command-line DNS client. rs 69.0% $0.30 94
13 oppiliappan/eva a calculator REPL, similar to bc(1) rs 66.9% $0.26 116
14 mibk/dupl a tool for code clone detection go 66.5% $0.26 85
15 sitkevij/hex ๐Ÿ”ฎ Futuristic take on hexdump, made in Rust. rs 66.1% $0.34 124
16 JohannesKaufmann/html-to-markdown โš™๏ธ Convert HTML to Markdown. Even works with entire websites and can be extended through rules. go 65.9% $0.39 105
17 eradman/entr Run arbitrary commands when files change c 65.7% $0.25 77
18 abishekvashok/cmatrix Terminal based "The Matrix" like implementation c 65.5% $0.17 51
19 astaxie/bat Go implement CLI, cURL-like tool for humans go 65.4% $0.29 85
20 dalance/amber A code search / replace tool rs 64.3% $0.30 126
21 sibprogrammer/xq Command-line XML and HTML beautifier and content extractor go 63.5% $0.31 111
22 yoav-lavi/melody Melody is a language that compiles to regular expressions and aims to be more readable and maintainable rs 62.3% $0.28 138
23 wintermute-cell/ngrrram A TUI tool to help you type faster and learn new layouts. Includes a free cat. rs 62.0% $0.33 72
24 blacknon/hwatch A modern alternative to the watch command, records the differences in execution results and can check this differences at after. rs 61.1% $0.34 71
25 yaa110/nomino Batch rename utility for developers rs 61.0% $0.29 142
26 sirwart/ripsecrets A command-line tool to prevent committing secret keys into your source code rs 59.9% $0.39 129
27 raviqqe/muffet Fast website link checker in Go go 59.7% $0.33 79
28 anordal/shellharden The corrective bash syntax highlighter rs 59.6% $0.24 90
29 sheepla/pingu ๐Ÿงping command but with pingu go 59.3% $0.30 59
30 kyoh86/richgo Enrich `go test` outputs with text decorations. go 59.2% $0.36 120
31 xorg62/tty-clock Clock using lib ncurses c 58.4% $0.28 45
32 astro/deadnix Scan Nix files for dead code rs 57.5% $0.27 57
33 KSXGitHub/parallel-disk-usage Highly parallelized, blazing fast directory tree analyzer rs 57.3% $0.42 95
34 mfridman/tparse CLI tool for summarizing go test output. Pipe friendly. CI/CD friendly. go 56.9% $0.26 69
35 konradsz/igrep Interactive Grep rs 56.9% $0.21 49
36 bensadeh/tailspin ๐ŸŒ€ A log file highlighter rs 56.6% $0.67 130
37 eudoxia0/hashcards A plain text-based spaced repetition system. rs 56.3% $0.33 114
38 WGUNDERWOOD/tex-fmt An extremely fast LaTeX formatter written in Rust rs 54.5% $0.25 95
39 Esubaalew/run Universal multi-language runner and smart REPL written in Rust. rs 54.5% $0.26 85
40 skeema/skeema Declarative pure-SQL schema management for MySQL and MariaDB go 54.1% $0.58 114
41 rbakbashev/elfcat ELF visualizer. Generates HTML files from ELF binaries. rs 53.2% $0.51 139
42 alexpovel/srgn A grep-like tool which understands source code syntax and allows for manipulation in addition to search rs 53.1% $0.25 111
43 wfxr/code-minimap ๐Ÿ›ฐ A high performance code minimap render. rs 53.0% $0.26 107
44 guumaster/hostctl Your dev tool to manage /etc/hosts like a pro! go 53.0% $0.25 62
45 pemistahl/grex A command-line tool and Rust library with Python bindings for generating regular expressions from user-provided test cases rs 52.8% $0.23 81
46 pier-cli/pier A CLI to organize and run short Unix shell scripts rs 52.7% $0.35 133
47 mookid/diffr Yet another diff highlighting tool rs 52.3% $0.25 76
48 robertdavidgraham/masscan TCP port scanner, spews SYN packets asynchronously, scanning entire Internet in under 5 minutes. c 52.3% $0.26 85
49 ajeetdsouza/zoxide A smarter cd command. Supports all major shells. rs 52.0% $0.42 157
50 Miserlou/Loop UNIX's missing `loop` command rs 52.0% $0.51 142
51 sharkdp/hexyl A command-line hex viewer rs 51.9% $0.45 76
52 Isona/dirble Fast directory scanning and scraping tool rs 51.5% $0.31 80
53 BLAKE3-team/BLAKE3 the official Rust and C implementations of the BLAKE3 cryptographic hash function rs 51.3% $0.47 88
54 Y2Z/monolith โฌ›๏ธ CLI tool and library for saving complete web pages as a single HTML file rs 51.2% $0.33 72
55 nikolassv/bartib A simple timetracker for the command line. It saves a log of all tracked activities as a plaintext file and allows you to create flexible reports. rs 51.1% $0.25 86
56 facebook/zstd Zstandard - Fast real-time compression algorithm c 50.8% $0.21 73
57 Lymphatus/caesium-clt Caesium Command Line Tools - Lossy/lossless image compression tool rs 49.4% $0.40 139
58 sharkdp/fd A simple, fast and user-friendly alternative to 'find' rs 48.9% $0.26 88
59 altdesktop/i3-style ๐ŸŽจ Make your i3 config a little more stylish. rs 48.8% $0.53 107
60 yassinebridi/serpl A simple terminal UI for search and replace, ala VS Code. rs 48.4% $0.44 116
61 HaliteChallenge/Halite @twosigma's first artificial intelligence programming challenge cpp 47.3% $0.52 71
62 hpjansson/chafa ๐Ÿ“บ๐Ÿ—ฟ Terminal graphics for the 21st century. c 47.1% $0.17 65
63 google/brotli Brotli compression format c 46.7% $0.34 100
64 jesseduffield/lazygit simple terminal UI for git commands go 46.1% $0.16 41
65 rs/jplot iTerm2 expvar/JSON monitoring tool go 45.1% $0.15 35
66 mkj/dropbear Dropbear SSH c 44.5% $0.19 56
67 YS-L/flamelens Flamegraph viewer in the terminal rs 44.2% $0.19 57
68 parcel-bundler/lightningcss An extremely fast CSS parser, transformer, bundler, and minifier written in Rust. rs 43.0% $0.33 117
69 ninja-build/ninja a small build system with a focus on speed cpp 42.3% $0.23 65
70 unhappychoice/gittype A CLI code-typing game that turns your source code into typing challenges rs 41.7% $0.39 129
71 shashwatah/jot โšกRapid note management for the terminal. rs 41.5% $0.45 166
72 axodotdev/oranda ๐ŸŽ generate beautiful landing pages for your developer tools rs 41.5% $0.42 103
73 Stranger6667/jsonschema A high-performance JSON Schema validator for Rust rs 40.9% $0.17 80
74 XAMPPRocky/tokei Count your code, quickly. rs 40.6% $0.26 71
75 segmentio/chamber CLI for managing secrets go 40.3% $0.21 77
76 jrnxf/thokr โœจ sleek typing tui with visualized results and historical logging rs 40.2% $0.32 96
77 svenstaro/miniserve ๐ŸŒŸ For when you really just want to serve some files over HTTP right now! rs 39.8% $0.30 63
78 BurntSushi/xsv A fast CSV command line toolkit written in Rust. rs 39.6% $0.33 97
79 cordx56/rustowl Visualize Ownership and Lifetimes in Rust rs 39.2% $0.29 65
80 foriequal0/git-trim Automatically trims your branches whose tracking remote refs are merged or stray rs 38.9% $0.37 75
81 TheZoraiz/ascii-image-converter A cross-platform command-line tool to convert images into ascii art and print them on the console. Now supports braille art! go 38.7% $0.40 92
82 nachoparker/dutree a tool to analyze file system usage written in Rust rs 38.7% $0.33 81
83 Canop/rhit A nginx log explorer rs 38.4% $0.40 68
84 Canop/broot A new way to see and navigate directory trees : https://dystroy.org/broot rs 37.3% $0.23 42
85 kisielk/errcheck errcheck checks that you checked errors. go 36.7% $0.22 112
86 cweill/gotests Automatically generate Go test boilerplate from your source code. go 36.7% $0.53 117
87 sayanarijit/xplr A hackable, minimal, fast TUI file explorer rs 35.2% $0.21 65
88 BurntSushi/ripgrep ripgrep recursively searches directories for a regex pattern while respecting your gitignore rs 35.1% $0.25 77
89 gabotechs/dep-tree Tool for helping developers keep their code bases clean and decoupled. It allows visualising a code base complexity using a 3d force-directed graph of files and the dependencies between them. go 35.0% $0.32 96
90 lfos/calcurse A text-based calendar and scheduling application c 33.8% $0.43 113
91 cslarsen/jp2a Converts jpg images to ASCII c 33.3% $0.31 68
92 kyoheiu/felix tui file manager with vim-like key mapping rs 33.3% $0.27 76
93 sharkdp/bat A cat(1) clone with wings. rs 33.2% $0.24 83
94 nuta/nsh A command-line shell like fish, but POSIX compatible. rs 31.3% $0.28 122
95 oppiliappan/statix lints and suggestions for the nix programming language rs 30.8% $0.20 51
96 hooklift/gowsdl WSDL2Go code generation as well as its SOAP proxy go 30.7% $0.27 62
97 simeg/eureka ๐Ÿ’ก CLI tool to input and store your ideas without leaving the terminal rs 30.5% $0.21 66
98 cmatsuoka/figlet Claudio's FIGlet tree c 30.3% $0.28 68
99 orf/gping Ping, but with a graph rs 29.8% $0.22 64
100 madler/pigz A parallel implementation of gzip for modern multi-processor, multi-core machines. c 29.6% $0.14 37
101 codesnap-rs/codesnap ๐Ÿฆ€๏ธ๐Ÿ“ธ Pure Rust tool to generate beautiful code snapshots, provide CLI and Library rs 29.2% $0.51 116
102 ecumene/rust-sloth A 3D software rasterizer... for the terminal! rs 28.9% $0.46 95
103 ekzhang/bore ๐Ÿ•ณ bore is a simple CLI tool for making tunnels to localhost rs 28.7% $0.28 81
104 bootandy/dust A more intuitive version of du in rust rs 28.3% $0.21 53
105 Epistates/treemd A (TUI/CLI) markdown navigator with tree-based structural navigation. rs 27.5% $0.31 117
106 ggreer/the_silver_searcher A code-searching tool similar to ack, but faster. c 26.6% $0.33 91
107 hatoo/oha Ohayou(ใŠใฏใ‚ˆใ†), HTTP load generator, inspired by rakyll/hey with tui animation. rs 26.4% $0.29 55
108 quinn-rs/quinn Async-friendly QUIC implementation in Rust rs 26.2% $0.32 88
109 antonmedv/walk Terminal file manager go 26.2% $0.16 35
110 go-critic/go-critic The most opinionated Go source code linter for code audit. go 26.0% $0.21 58
111 trasta298/keifu Git genealogy, untangled. A TUI for navigating commit graphs with color and clarity. rs 26.0% $0.28 64
112 rvben/rumdl Fast Markdown linter and formatter written in Rust rs 25.9% $0.34 77
113 rust-lang/mdBook Create book from markdown files. Like Gitbook but implemented in Rust rs 25.6% $0.25 80
114 mgechev/revive ๐Ÿ”ฅ ~6x faster, stricter, configurable, extensible, and beautiful drop-in replacement for golint go 25.0% $0.24 61
115 zevv/duc Dude, where are my bytes: Duc, a library and suite of tools for inspecting disk usage c 23.9% $0.40 78
116 tukaani-project/xz XZ Utils c 23.8% $0.33 93
117 tomarrell/wrapcheck A Go linter to check that errors from external packages are wrapped go 23.3% $0.30 114
118 naggie/dstask Git powered terminal-based todo/note manager -- markdown note page per task. Single binary! go 22.6% $0.31 90
119 ariga/atlas Declarative schema migrations with schema-as-code workflows go 22.5% $0.27 104
120 paradigmxyz/solar Blazingly fast, modular and contributor friendly Solidity compiler, written in Rust rs 22.3% $0.36 100
121 OSGeo/PROJ PROJ - Cartographic Projections and Coordinate Transformations Library cpp 22.3% $0.19 80
122 ivanceras/svgbob Convert your ascii diagram scribbles into happy little SVG rs 21.8% $0.27 52
123 lh3/seqtk Toolkit for processing sequences in FASTA/Q formats c 21.4% $0.24 92
124 dandavison/delta A syntax-highlighting pager for git, diff, grep, rg --json, and blame output rs 21.3% $0.20 52
125 chmln/handlr A better xdg-utils rs 21.2% $0.29 128
126 svenstaro/genact ๐ŸŒ€ A nonsense activity generator rs 20.7% $0.47 48
127 stathissideris/ditaa ditaa is a small command-line utility that can convert diagrams drawn using ascii art ('drawings' that contain characters that resemble lines like | / - ), into proper bitmap graphics. java 20.4% $0.19 53
128 rcoh/angle-grinder Slice and dice logs on the command line rs 20.2% $0.25 73
129 ArthurSonzogni/json-tui A JSON terminal UI made in C++ cpp 19.5% $0.20 59
130 LuaJIT/LuaJIT Mirror of the LuaJIT git repository c 19.4% $0.15 68
131 NikolaDucak/caps-log A small TUI journaling tool. ๐Ÿ“– cpp 19.1% $0.36 88
132 jqlang/jq Command-line JSON processor c 18.7% $0.21 46
133 tarka/xcp An extended `cp` rs 18.6% $0.24 57
134 rochacbruno/marmite Markdown makes sites - A Static Site Generator for Blogs rs 18.6% $0.35 79
135 sharkdp/pastel A command-line tool to generate, analyze, convert and manipulate colors rs 17.8% $0.38 82
136 hairyhenderson/gomplate A flexible commandline tool for template rendering. Supports lots of local and remote datasources. go 17.1% $0.24 89
137 ducaale/xh Friendly and fast tool for sending HTTP requests rs 16.7% $0.23 73
138 antonmedv/fx Terminal JSON viewer & processor go 16.1% $0.19 85
139 typst/typst A markup-based typesetting system that is powerful and easy to learn. rs 15.8% $0.28 75
140 sharkdp/hyperfine A command-line benchmarking tool rs 15.5% $0.27 68
141 facebookresearch/fastText Library for fast text representation and classification. cpp 15.4% $0.22 47
142 noborus/trdsql CLI tool that can execute SQL queries on CSV, LTSV, JSON, YAML and TBLN. Can output to various formats. go 14.9% $0.26 109
143 junegunn/fzf :cherry_blossom: A command-line fuzzy finder go 13.9% $0.16 45
144 zk-org/zk Plain text note-taking assistant go 13.9% $0.21 62
145 pls-rs/pls pls is a prettier and powerful ls(1) for the pros. rs 13.9% $0.35 78
146 jarun/nnn nยณ The unorthodox terminal file manager c 13.6% $0.24 87
147 o2sh/onefetch Command-line Git information tool rs 13.6% $0.61 91
148 crowdagger/crowbook Converts books written in Markdown to HTML, LaTeX/PDF and EPUB rs 12.8% $0.45 92
149 stacked-git/stgit Stacked Git rs 12.6% $0.24 114
150 peco/peco Simplistic interactive filtering tool go 11.6% $0.20 45
151 johnkerl/miller Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON go 11.5% $0.20 58
152 tstack/lnav Log file navigator cpp 10.3% $0.20 72
153 dundee/gdu Fast disk usage analyzer with console interface written in Go go 9.5% $0.28 73
154 arq5x/bedtools2 bedtools - the swiss army knife for genome arithmetic c 9.2% $0.20 51
155 sigoden/argc A Bash CLI framework, also a Bash command runner. rs 8.8% $0.21 63
156 danmar/cppcheck static analysis of C/C++ code cpp 8.8% $0.20 74
157 hush-shell/hush Hush is a unix shell based on the Lua programming language rs 8.7% $0.48 158
158 chirlu/sox SoX, Swiss Army knife of sound processing c 8.6% $0.29 66
159 eliukblau/pixterm Draw images in your ANSI terminal with true color go 8.4% $0.40 83
160 rust-ethereum/ethabi Encode and decode smart contract invocations rs 7.8% $0.23 89
161 alecthomas/chroma A general purpose syntax highlighter in pure Go go 7.6% $0.24 64
162 tree-sitter/tree-sitter An incremental parsing system for programming tools rs 6.9% $0.30 90
163 direnv/direnv unclutter your .profile go 6.8% $0.73 127
164 OSGeo/gdal GDAL is an open source MIT licensed translator library for raster and vector geospatial data formats. cpp 6.7% $0.24 70
165 htop-dev/htop htop - an interactive process viewer c 6.5% $0.21 43
166 jgm/pandoc Universal markup converter hs 6.2% $0.20 67
167 boyter/scc Sloc, Cloc and Code: scc is a very fast accurate code counter with complexity calculations and COCOMO estimates written in pure Go go 5.8% $0.23 76
168 elkowar/pipr A tool to interactively write shell pipelines. rs 5.7% $0.30 87
169 lz4/lz4 Extremely Fast Compression algorithm c 5.2% $0.20 46
170 tinycc/tinycc Unofficial mirror of mob development branch c 4.8% $0.16 50
171 ip7z/7zip 7-Zip cpp 4.8% $0.19 65
172 duckdb/duckdb DuckDB is an analytical in-process SQL database management system cpp 4.7% $0.49 118
173 noborus/ov ๐ŸŽ‘Feature-rich terminal-based text viewer. It is a so-called terminal pager. go 4.1% $0.19 62
174 samtools/samtools Tools (written in C using htslib) for manipulating next-generation sequencing data c 3.9% $0.34 97
175 ismaelgv/rnr A command-line tool to batch rename files and directories rs 3.8% $0.26 107
176 FFmpeg/FFmpeg Mirror of https://git.ffmpeg.org/ffmpeg.git c 3.5% $0.38 89
177 lua/lua A copy of the Lua development repository, as seen by the Lua team. Mirrored irregularly. All communication should be through the Lua mailing list https://www.lua.org/lua-l.html c 3.4% $0.17 112
178 sstadick/hck A sharp cut(1) clone. rs 3.3% $0.33 114
179 FiloSottile/age A simple, modern and secure encryption tool (and Go library) with small explicit keys, no config options, and UNIX-style composability. go 3.1% $0.22 66
180 cheat/cheat cheat allows you to create and view interactive cheatsheets on the command-line. It was designed to help remind *nix system administrators of options for commands that they use frequently, but not frequently enough to remember. go 3.0% $0.33 110
181 Nukesor/pueue :stars: Manage your shell commands. rs 2.8% $0.30 91
182 clog-tool/clog-cli Generate beautiful changelogs from your Git commit history rs 2.8% $0.32 113
183 ast-grep/ast-grep โšกA CLI tool for code structural search, lint and rewriting. Written in Rust rs 2.6% $0.27 70
184 universal-ctags/ctags A maintained ctags implementation c 1.7% $0.27 58
185 riquito/tuc When cut doesn't cut it rs 1.5% $0.28 82
186 doxygen/doxygen Official doxygen git repository c 1.3% $0.21 76
187 git-bahn/git-graph Command line tool to show clear git graphs arranged for your branching model rs 1.2% $0.24 49
188 brocode/fblog Small command-line JSON Log viewer rs 1.2% $0.24 77
189 mikefarah/yq yq is a portable command-line YAML, JSON, XML, CSV, TOML, HCL and properties processor go 1.1% $0.19 65
190 jhspetersson/fselect Find files with SQL-like queries rs 0.9% $0.24 89
191 sqlite/sqlite Official Git mirror of the SQLite source tree c 0.9% $0.19 74
192 rust-embedded/svd2rust Generate Rust register maps (`struct`s) from SVD files rs 0.9% $0.39 82
193 php/php-src The PHP Interpreter c 0.6% $0.22 65
194 AmmarAbouZor/tui-journal Your journal app if you live in a terminal rs 0.5% $0.26 74
195 bellard/quickjs Public repository of the QuickJS Javascript Engine. c 0.0% $0.44 96
196 Byron/dua-cli View disk space usage and delete unwanted data, fast. rs 0.0% $0.31 100
197 gromacs/gromacs Public/backup repository of the GROMACS molecular simulation toolkit. Please do not mine the metadata blindly; we use https://gitlab.com/gromacs/gromacs for code review and issue tracking. cpp 0.0% $0.34 71
198 kaushiksrini/parqeye Peek inside Parquet files right from your terminal rs 0.0% $0.41 105
199 multiprocessio/dsq Commandline tool for running SQL queries against JSON, CSV, Excel, Parquet, and more. go 0.0% $0.38 118
200 sclevine/yj CLI - Convert between YAML, TOML, JSON, and HCL. Preserves map order. go 0.0% $0.23 112

Click row to see task details