ismaelgv/rnr | ProgramBench

A command-line tool to batch rename files and directories

683

Generated Behavioral Tests

100.0%

Best Score

Claude Opus 5.5 (xhigh)

Results by Model

Hover for details · Click a model to open it · Drag to zoom the x-axis · Shift-drag to pan · The line marks the Pareto frontier (best score per cost)

30 runs

#	Model	Score	Cost	Calls
1	Claude Opus 5.5 (xhigh)	100.0%	$10.44	208	trace →
2	Claude Fable 5.1 (xhigh)	100.0%	$22.40	191	trace →
3	Muse Wonder (xhigh)	100.0%	$11.94	155	trace →
4	GPT 6 Astra (max)	100.0%	$7.27	41	trace →
5	Claude Opus 5 (xhigh)	100.0%	$36.10	235	trace →
6	Muse Wonder Full	99.3%	TBA	288	trace →
7	Muse Spark 1.3 (max)	97.8%	$2.01	231	trace →
8	Claude Opus 4.8 (xhigh)	96.7%	$18.82	133	trace →
9	Muse Spark 1.3 (xhigh)	96.2%	$1.06	188	trace →
10	GLM-5.2	94.2%	$17.10	259	trace →
11	GPT 5.5 (xhigh)	94.0%	$6.29	73	trace →
12	GPT-5.6 Sol (xhigh)	93.1%	$2.41	20	trace →
13	GPT 5.5 (high)	92.7%	$2.75	50	trace →
14	Gemini 3.7 Flash	92.7%	$1.37	165	trace →
15	Gemini 3.6 Flash	91.7%	$3.63	184	trace →
16	Claude Opus 4.7 (xhigh)	89.6%	$50.30	594	trace →
17	Gemini 3.5 Flash	88.6%	$3.69	147	trace →
18	Muse Spark 1.1 (xhigh)	88.1%	$0.23	54	trace →
19	Muse Spark 1.2 (xhigh)	87.8%	$0.11	111	trace →
20	GPT-5.6 Sol	86.4%	$0.83	15	trace →
21	Claude Opus 4.7	82.1%	$4.44	154	trace →
22	GPT 5.5	81.7%	$1.10	19	trace →
23	Gemini 3.1 Pro	79.8%	$1.95	184	trace →
24	Claude Sonnet 4.6	78.0%	$20.12	374	trace →
25	GPT 5.4	67.9%	$0.37	14	trace →
26	Claude Opus 4.6	66.6%	$11.86	257	trace →
27	GPT 5.4 mini	25.9%	$0.04	18	trace →
28	Claude Haiku 4.5	21.4%	$1.33	154	trace →
29	Gemini 3 Flash	3.8%	$0.26	107	trace →
30	GPT 5 mini	3.8%	$0.03	24	trace →

Click a row to replay how that model rebuilt this program, or the model name to open its full run