GPT 5.4

OpenAI · mini-SWE-agent · Rank #15

0%
Resolved help_outline Percentage of instances fully solved as measured by hidden behavioral tests.
0.0%
Almost Resolved help_outline Instances where the agent's solution passes ≥ 95% of all hidden behavioral tests.
$65
Total Cost help_outline Total API cost in USD across all task instances.
3,237
Total Calls help_outline Total number of LLM calls across all task instances.
200 instances
# Repository Lang Score Cost Calls
1 abishekvashok/cmatrix Terminal based "The Matrix" like implementation c 91.7% $0.37 8 trace →
2 jqlang/jq Command-line JSON processor c 90.1% $0.15 140 trace →
3 wfxr/csview 📠 Pretty and fast csv viewer for cli with cjk/emoji support. rs 88.7% $0.16 8 trace →
4 sstadick/hck A sharp cut(1) clone. rs 86.8% $0.25 10 trace →
5 tarka/xcp An extended `cp` rs 84.5% $0.28 10 trace →
6 chmln/sd Intuitive find & replace CLI (sed alternative) rs 81.6% $0.22 8 trace →
7 raviqqe/muffet Fast website link checker in Go go 80.8% $0.30 13 trace →
8 psampaz/go-mod-outdated Find outdated dependencies of your Go projects. go-mod-outdated provides a table view of the go list -u -m -json all command which lists all dependencies of a Go project and their available minor and patch updates. It also provides a way to filter indirect dependencies and dependencies without updates. go 80.4% $0.15 10 trace →
9 madler/pigz A parallel implementation of gzip for modern multi-processor, multi-core machines. c 79.1% $0.23 10 trace →
10 xorg62/tty-clock Clock using lib ncurses c 76.9% $0.22 8 trace →
11 jarun/nnn n³ The unorthodox terminal file manager c 76.7% $0.17 8 trace →
12 oppiliappan/eva a calculator REPL, similar to bc(1) rs 75.8% $0.33 13 trace →
13 codesnap-rs/codesnap 🦀️📸 Pure Rust tool to generate beautiful code snapshots, provide CLI and Library rs 75.7% $0.79 11 trace →
14 incu6us/goimports-reviser Right imports sorting & code formatting tool (goimports alternative) go 73.3% $0.60 18 trace →
15 junegunn/fzf :cherry_blossom: A command-line fuzzy finder go 71.9% $0.34 12 trace →
16 shashwatah/jot ⚡Rapid note management for the terminal. rs 70.3% $0.52 14 trace →
17 Esubaalew/run Universal multi-language runner and smart REPL written in Rust. rs 70.1% $0.21 11 trace →
18 ismaelgv/rnr A command-line tool to batch rename files and directories rs 67.9% $0.37 14 trace →
19 dalance/amber A code search / replace tool rs 67.8% $4.75 1,000 trace →
20 JohannesKaufmann/html-to-markdown ⚙️ Convert HTML to Markdown. Even works with entire websites and can be extended through rules. go 67.2% $0.23 7 trace →
21 sitkevij/hex 🔮 Futuristic take on hexdump, made in Rust. rs 67.2% $0.19 9 trace →
22 peco/peco Simplistic interactive filtering tool go 66.6% $0.29 11 trace →
23 pemistahl/grex A command-line tool and Rust library with Python bindings for generating regular expressions from user-provided test cases rs 66.5% $0.32 7 trace →
24 BurntSushi/xsv A fast CSV command line toolkit written in Rust. rs 65.6% $0.32 8 trace →
25 chmln/handlr A better xdg-utils rs 65.4% $0.25 10 trace →
26 clog-tool/clog-cli Generate beautiful changelogs from your Git commit history rs 65.0% $0.32 12 trace →
27 mookid/diffr Yet another diff highlighting tool rs 64.5% $0.19 8 trace →
28 anordal/shellharden The corrective bash syntax highlighter rs 63.3% $0.16 9 trace →
29 KSXGitHub/parallel-disk-usage Highly parallelized, blazing fast directory tree analyzer rs 63.3% $0.60 14 trace →
30 gabotechs/dep-tree Tool for helping developers keep their code bases clean and decoupled. It allows visualising a code base complexity using a 3d force-directed graph of files and the dependencies between them. go 62.5% $0.30 8 trace →
31 sheepla/pingu 🐧ping command but with pingu go 61.9% $0.22 10 trace →
32 yassinebridi/serpl A simple terminal UI for search and replace, ala VS Code. rs 60.9% $0.36 13 trace →
33 mgdm/htmlq Like jq, but for HTML. rs 60.8% $0.30 14 trace →
34 blacknon/hwatch A modern alternative to the watch command, records the differences in execution results and can check this differences at after. rs 60.2% $0.27 9 trace →
35 bensadeh/tailspin 🌀 A log file highlighter rs 59.6% $0.26 8 trace →
36 astaxie/bat Go implement CLI, cURL-like tool for humans go 58.9% $0.17 9 trace →
37 mkj/dropbear Dropbear SSH c 58.9% $0.15 10 trace →
38 nikolassv/bartib A simple timetracker for the command line. It saves a log of all tracked activities as a plaintext file and allows you to create flexible reports. rs 58.7% $0.42 12 trace →
39 svenstaro/miniserve 🌟 For when you really just want to serve some files over HTTP right now! rs 58.6% $0.23 8 trace →
40 eradman/entr Run arbitrary commands when files change c 58.5% $0.24 13 trace →
41 mibk/dupl a tool for code clone detection go 58.4% $0.45 13 trace →
42 AmmarAbouZor/tui-journal Your journal app if you live in a terminal rs 58.4% $0.29 10 trace →
43 alexpovel/srgn A grep-like tool which understands source code syntax and allows for manipulation in addition to search rs 58.1% $0.41 12 trace →
44 tomnomnom/gron Make JSON greppable! go 58.0% $0.36 13 trace →
45 sibprogrammer/xq Command-line XML and HTML beautifier and content extractor go 57.8% $0.66 11 trace →
46 pier-cli/pier A CLI to organize and run short Unix shell scripts rs 57.5% $0.52 13 trace →
47 segmentio/chamber CLI for managing secrets go 56.2% $0.24 9 trace →
48 git-bahn/git-graph Command line tool to show clear git graphs arranged for your branching model rs 56.2% $0.20 10 trace →
49 kyoh86/richgo Enrich `go test` outputs with text decorations. go 54.4% $0.26 10 trace →
50 WGUNDERWOOD/tex-fmt An extremely fast LaTeX formatter written in Rust rs 54.3% $0.50 13 trace →
51 sharkdp/hexyl A command-line hex viewer rs 54.1% $0.32 12 trace →
52 rs/curlie The power of curl, the ease of use of httpie. go 54.0% $0.27 10 trace →
53 riquito/tuc When cut doesn't cut it rs 53.8% $0.30 10 trace →
54 ajeetdsouza/zoxide A smarter cd command. Supports all major shells. rs 53.5% $0.34 9 trace →
55 hatoo/oha Ohayou(おはよう), HTTP load generator, inspired by rakyll/hey with tui animation. rs 52.6% $0.28 8 trace →
56 o2sh/onefetch Command-line Git information tool rs 52.2% $0.22 8 trace →
57 bootandy/dust A more intuitive version of du in rust rs 52.2% $0.46 11 trace →
58 Miserlou/Loop UNIX's missing `loop` command rs 52.0% $0.24 12 trace →
59 ggreer/the_silver_searcher A code-searching tool similar to ack, but faster. c 51.8% $0.20 6 trace →
60 Isona/dirble Fast directory scanning and scraping tool rs 51.7% $0.39 11 trace →
61 yaa110/nomino Batch rename utility for developers rs 51.4% $0.30 15 trace →
62 sharkdp/pastel A command-line tool to generate, analyze, convert and manipulate colors rs 50.6% $0.22 7 trace →
63 nuta/nsh A command-line shell like fish, but POSIX compatible. rs 50.3% $0.19 8 trace →
64 sclevine/yj CLI - Convert between YAML, TOML, JSON, and HCL. Preserves map order. go 50.2% $0.32 13 trace →
65 antonmedv/fx Terminal JSON viewer & processor go 49.3% $0.20 10 trace →
66 multiprocessio/dsq Commandline tool for running SQL queries against JSON, CSV, Excel, Parquet, and more. go 49.3% $0.54 24 trace →
67 orf/gping Ping, but with a graph rs 49.1% $0.18 8 trace →
68 noborus/trdsql CLI tool that can execute SQL queries on CSV, LTSV, JSON, YAML and TBLN. Can output to various formats. go 49.1% $0.38 14 trace →
69 naggie/dstask Git powered terminal-based todo/note manager -- markdown note page per task. Single binary! go 48.8% $0.49 12 trace →
70 kisielk/errcheck errcheck checks that you checked errors. go 48.8% $0.34 14 trace →
71 sharkdp/hyperfine A command-line benchmarking tool rs 48.8% $0.25 9 trace →
72 altdesktop/i3-style 🎨 Make your i3 config a little more stylish. rs 48.8% $0.31 8 trace →
73 kaushiksrini/parqeye Peek inside Parquet files right from your terminal rs 48.4% $0.21 14 trace →
74 rust-ethereum/ethabi Encode and decode smart contract invocations rs 48.2% $0.32 12 trace →
75 quinn-rs/quinn Async-friendly QUIC implementation in Rust rs 46.9% $0.31 10 trace →
76 lz4/lz4 Extremely Fast Compression algorithm c 46.6% $0.24 10 trace →
77 sirwart/ripsecrets A command-line tool to prevent committing secret keys into your source code rs 46.3% $0.24 12 trace →
78 foriequal0/git-trim Automatically trims your branches whose tracking remote refs are merged or stray rs 45.4% $0.28 15 trace →
79 cheat/cheat cheat allows you to create and view interactive cheatsheets on the command-line. It was designed to help remind *nix system administrators of options for commands that they use frequently, but not frequently enough to remember. go 45.1% $0.40 10 trace →
80 cweill/gotests Automatically generate Go test boilerplate from your source code. go 45.1% $0.59 16 trace →
81 astro/deadnix Scan Nix files for dead code rs 44.5% $0.40 9 trace →
82 jrnxf/thokr ✨ sleek typing tui with visualized results and historical logging rs 43.9% $0.09 6 trace →
83 rs/jplot iTerm2 expvar/JSON monitoring tool go 43.2% $0.12 11 trace →
84 Canop/rhit A nginx log explorer rs 43.2% $0.23 7 trace →
85 cmatsuoka/figlet Claudio's FIGlet tree c 42.8% $0.52 16 trace →
86 axodotdev/oranda 🎁 generate beautiful landing pages for your developer tools rs 42.5% $0.22 10 trace →
87 cordx56/rustowl Visualize Ownership and Lifetimes in Rust rs 42.4% $0.25 10 trace →
88 ekzhang/bore 🕳 bore is a simple CLI tool for making tunnels to localhost rs 42.0% $0.56 14 trace →
89 sayanarijit/xplr A hackable, minimal, fast TUI file explorer rs 41.1% $0.26 11 trace →
90 rust-lang/mdBook Create book from markdown files. Like Gitbook but implemented in Rust rs 40.8% $0.26 9 trace →
91 zevv/duc Dude, where are my bytes: Duc, a library and suite of tools for inspecting disk usage c 40.7% $0.30 7 trace →
92 robertdavidgraham/masscan TCP port scanner, spews SYN packets asynchronously, scanning entire Internet in under 5 minutes. c 40.7% $0.24 9 trace →
93 Byron/dua-cli View disk space usage and delete unwanted data, fast. rs 40.5% $0.17 7 trace →
94 lh3/seqtk Toolkit for processing sequences in FASTA/Q formats c 40.3% $0.26 12 trace →
95 Drew-Alleman/DataSurgeon Quickly Extracts IP's, Email Addresses, Hashes, Files, Credit Cards, Social Security Numbers and a lot More From Text rs 39.8% $0.20 9 trace →
96 sharkdp/fd A simple, fast and user-friendly alternative to 'find' rs 39.8% $0.28 12 trace →
97 ArthurSonzogni/json-tui A JSON terminal UI made in C++ cpp 39.6% $0.10 7 trace →
98 unhappychoice/gittype A CLI code-typing game that turns your source code into typing challenges rs 39.4% $0.25 10 trace →
99 kyoheiu/felix tui file manager with vim-like key mapping rs 39.1% $0.42 12 trace →
100 mfridman/tparse CLI tool for summarizing go test output. Pipe friendly. CI/CD friendly. go 39.1% $0.24 8 trace →
101 noborus/ov 🎑Feature-rich terminal-based text viewer. It is a so-called terminal pager. go 38.6% $0.21 11 trace →
102 jonas/tig Text-mode interface for git c 38.1% $0.12 7 trace →
103 wfxr/code-minimap 🛰 A high performance code minimap render. rs 38.0% $0.25 11 trace →
104 NikolaDucak/caps-log A small TUI journaling tool. 📖 cpp 37.7% $0.29 16 trace →
105 facebookresearch/fastText Library for fast text representation and classification. cpp 37.5% $0.24 9 trace →
106 parcel-bundler/lightningcss An extremely fast CSS parser, transformer, bundler, and minifier written in Rust. rs 36.7% $0.25 12 trace →
107 trasta298/keifu Git genealogy, untangled. A TUI for navigating commit graphs with color and clarity. rs 36.6% $0.14 9 trace →
108 ducaale/xh Friendly and fast tool for sending HTTP requests rs 36.6% $0.25 7 trace →
109 ecumene/rust-sloth A 3D software rasterizer... for the terminal! rs 36.6% $0.41 10 trace →
110 nachoparker/dutree a tool to analyze file system usage written in Rust rs 36.2% $0.14 8 trace →
111 BurntSushi/ripgrep ripgrep recursively searches directories for a regex pattern while respecting your gitignore rs 35.5% $0.26 7 trace →
112 tukaani-project/xz XZ Utils c 35.3% $0.32 12 trace →
113 lfos/calcurse A text-based calendar and scheduling application c 35.3% $0.54 12 trace →
114 facebook/zstd Zstandard - Fast real-time compression algorithm c 35.3% $0.21 11 trace →
115 simeg/eureka 💡 CLI tool to input and store your ideas without leaving the terminal rs 34.9% $0.41 15 trace →
116 rhysd/kiro-editor A small terminal UTF-8 text editor written in Rust 📝🦀 rs 34.5% $0.13 9 trace →
117 yoav-lavi/melody Melody is a language that compiles to regular expressions and aims to be more readable and maintainable rs 34.2% $0.45 19 trace →
118 elkowar/pipr A tool to interactively write shell pipelines. rs 33.4% $0.11 11 trace →
119 direnv/direnv unclutter your .profile go 32.9% $0.22 8 trace →
120 XAMPPRocky/tokei Count your code, quickly. rs 32.0% $0.39 11 trace →
121 Epistates/treemd A (TUI/CLI) markdown navigator with tree-based structural navigation. rs 31.9% $0.21 7 trace →
122 antonmedv/walk Terminal file manager go 31.5% $0.24 13 trace →
123 wintermute-cell/ngrrram A TUI tool to help you type faster and learn new layouts. Includes a free cat. rs 31.0% $0.28 10 trace →
124 go-critic/go-critic The most opinionated Go source code linter for code audit. go 30.4% $0.49 14 trace →
125 doxygen/doxygen Official doxygen git repository c 29.7% $0.24 7 trace →
126 tree-sitter/tree-sitter An incremental parsing system for programming tools rs 29.1% $0.28 9 trace →
127 ogham/dog A command-line DNS client. rs 28.8% $0.17 7 trace →
128 guumaster/hostctl Your dev tool to manage /etc/hosts like a pro! go 28.5% $0.66 17 trace →
129 jesseduffield/lazygit simple terminal UI for git commands go 28.3% $0.39 11 trace →
130 typst/typst A markup-based typesetting system that is powerful and easy to learn. rs 28.0% $0.39 11 trace →
131 dundee/gdu Fast disk usage analyzer with console interface written in Go go 27.9% $0.31 8 trace →
132 TheZoraiz/ascii-image-converter A cross-platform command-line tool to convert images into ascii art and print them on the console. Now supports braille art! go 27.7% $0.28 7 trace →
133 agourlay/zip-password-finder Find the password of protected ZIP files. rs 27.2% $0.19 10 trace →
134 ariga/atlas Declarative schema migrations with schema-as-code workflows go 26.3% $0.43 16 trace →
135 Y2Z/monolith ⬛️ CLI tool and library for saving complete web pages as a single HTML file rs 25.8% $0.25 8 trace →
136 oppiliappan/statix lints and suggestions for the nix programming language rs 25.4% $0.30 11 trace →
137 cslarsen/jp2a Converts jpg images to ASCII c 25.2% $0.43 15 trace →
138 svenstaro/genact 🌀 A nonsense activity generator rs 24.2% $0.46 10 trace →
139 rochacbruno/marmite Markdown makes sites - A Static Site Generator for Blogs rs 22.5% $0.33 11 trace →
140 rcoh/angle-grinder Slice and dice logs on the command line rs 22.0% $0.49 15 trace →
141 YS-L/flamelens Flamegraph viewer in the terminal rs 22.0% $0.07 7 trace →
142 mgechev/revive 🔥 ~6x faster, stricter, configurable, extensible, and beautiful drop-in replacement for golint go 21.3% $0.38 15 trace →
143 crowdagger/crowbook Converts books written in Markdown to HTML, LaTeX/PDF and EPUB rs 20.6% $0.34 11 trace →
144 jhspetersson/fselect Find files with SQL-like queries rs 20.3% $0.43 12 trace →
145 eliukblau/pixterm Draw images in your ANSI terminal with true color go 19.5% $0.20 7 trace →
146 hairyhenderson/gomplate A flexible commandline tool for template rendering. Supports lots of local and remote datasources. go 19.3% $0.46 12 trace →
147 ivanceras/svgbob Convert your ascii diagram scribbles into happy little SVG rs 18.6% $0.15 6 trace →
148 HaliteChallenge/Halite @twosigma's first artificial intelligence programming challenge cpp 18.5% $0.20 6 trace →
149 Canop/broot A new way to see and navigate directory trees : https://dystroy.org/broot rs 17.8% $0.42 7 trace →
150 dandavison/delta A syntax-highlighting pager for git, diff, grep, rg --json, and blame output rs 17.8% $0.23 7 trace →
151 lua/lua A copy of the Lua development repository, as seen by the Lua team. Mirrored irregularly. All communication should be through the Lua mailing list https://www.lua.org/lua-l.html c 17.8% $0.20 13 trace →
152 zk-org/zk Plain text note-taking assistant go 17.0% $0.30 8 trace →
153 pls-rs/pls pls is a prettier and powerful ls(1) for the pros. rs 16.9% $0.24 9 trace →
154 arq5x/bedtools2 bedtools - the swiss army knife for genome arithmetic c 16.8% $0.34 7 trace →
155 stacked-git/stgit Stacked Git rs 16.3% $0.23 8 trace →
156 htop-dev/htop htop - an interactive process viewer c 15.3% $0.28 8 trace →
157 sharkdp/bat A cat(1) clone with wings. rs 13.4% $0.26 9 trace →
158 chirlu/sox SoX, Swiss Army knife of sound processing c 13.4% $0.23 7 trace →
159 tinycc/tinycc Unofficial mirror of mob development branch c 12.8% $0.43 12 trace →
160 BLAKE3-team/BLAKE3 the official Rust and C implementations of the BLAKE3 cryptographic hash function rs 11.9% $0.23 10 trace →
161 hooklift/gowsdl WSDL2Go code generation as well as its SOAP proxy go 11.8% $0.38 10 trace →
162 paradigmxyz/solar Blazingly fast, modular and contributor friendly Solidity compiler, written in Rust rs 11.5% $0.16 8 trace →
163 duckdb/duckdb DuckDB is an analytical in-process SQL database management system cpp 10.9% $0.43 13 trace →
164 rvben/rumdl Fast Markdown linter and formatter written in Rust rs 10.8% $0.36 7 trace →
165 sigoden/argc A Bash CLI framework, also a Bash command runner. rs 10.3% $0.55 16 trace →
166 ip7z/7zip 7-Zip cpp 9.9% $0.31 9 trace →
167 rust-embedded/svd2rust Generate Rust register maps (`struct`s) from SVD files rs 9.4% $0.09 6 trace →
168 alecthomas/chroma A general purpose syntax highlighter in pure Go go 9.3% $0.33 9 trace →
169 ast-grep/ast-grep ⚡A CLI tool for code structural search, lint and rewriting. Written in Rust rs 9.2% $0.41 11 trace →
170 tomarrell/wrapcheck A Go linter to check that errors from external packages are wrapped go 9.2% $0.31 13 trace →
171 konradsz/igrep Interactive Grep rs 8.8% $0.21 14 trace →
172 hpjansson/chafa 📺🗿 Terminal graphics for the 21st century. c 8.7% $0.16 7 trace →
173 FiloSottile/age A simple, modern and secure encryption tool (and Go library) with small explicit keys, no config options, and UNIX-style composability. go 8.6% $0.47 14 trace →
174 johnkerl/miller Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON go 8.0% $0.32 11 trace →
175 tstack/lnav Log file navigator cpp 7.9% $0.23 9 trace →
176 LuaJIT/LuaJIT Mirror of the LuaJIT git repository c 7.7% $0.18 16 trace →
177 samtools/samtools Tools (written in C using htslib) for manipulating next-generation sequencing data c 7.1% $0.33 10 trace →
178 mikefarah/yq yq is a portable command-line YAML, JSON, XML, CSV, TOML, HCL and properties processor go 6.9% $0.76 20 trace →
179 hush-shell/hush Hush is a unix shell based on the Lua programming language rs 5.8% $0.23 10 trace →
180 OSGeo/gdal GDAL is an open source MIT licensed translator library for raster and vector geospatial data formats. cpp 5.3% $0.36 9 trace →
181 jgm/pandoc Universal markup converter hs 5.2% $0.24 8 trace →
182 FFmpeg/FFmpeg Mirror of https://git.ffmpeg.org/ffmpeg.git c 4.6% $0.39 12 trace →
183 boyter/scc Sloc, Cloc and Code: scc is a very fast accurate code counter with complexity calculations and COCOMO estimates written in pure Go go 4.5% $0.26 9 trace →
184 Nukesor/pueue :stars: Manage your shell commands. rs 3.9% $0.16 7 trace →
185 eudoxia0/hashcards A plain text-based spaced repetition system. rs 3.7% $0.48 15 trace →
186 universal-ctags/ctags A maintained ctags implementation c 3.6% $0.20 8 trace →
187 ninja-build/ninja a small build system with a focus on speed cpp 3.5% $0.20 9 trace →
188 gromacs/gromacs Public/backup repository of the GROMACS molecular simulation toolkit. Please do not mine the metadata blindly; we use https://gitlab.com/gromacs/gromacs for code review and issue tracking. cpp 3.2% $0.32 9 trace →
189 skeema/skeema Declarative pure-SQL schema management for MySQL and MariaDB go 3.1% $0.41 16 trace →
190 rbakbashev/elfcat ELF visualizer. Generates HTML files from ELF binaries. rs 2.5% $0.19 10 trace →
191 danmar/cppcheck static analysis of C/C++ code cpp 2.3% $0.24 9 trace →
192 php/php-src The PHP Interpreter c 2.2% $0.24 7 trace →
193 Lymphatus/caesium-clt Caesium Command Line Tools - Lossy/lossless image compression tool rs 1.6% $0.61 17 trace →
194 brocode/fblog Small command-line JSON Log viewer rs 1.2% $0.24 8 trace →
195 bellard/quickjs Public repository of the QuickJS Javascript Engine. c 1.2% $0.21 13 trace →
196 google/brotli Brotli compression format c 0.9% $0.52 18 trace →
197 stathissideris/ditaa ditaa is a small command-line utility that can convert diagrams drawn using ascii art ('drawings' that contain characters that resemble lines like | / - ), into proper bitmap graphics. java 0.7% $0.46 12 trace →
198 sqlite/sqlite Official Git mirror of the SQLite source tree c 0.6% $0.20 9 trace →
199 Stranger6667/jsonschema A high-performance JSON Schema validator for Rust rs 0.2% $0.18 10 trace →
200 OSGeo/PROJ PROJ - Cartographic Projections and Coordinate Transformations Library cpp 0.0% $0.47 13 trace →

Click a row to replay this run on that task, or the repository name to open the task