Blog

Jun. 23, 2026

Submission Guide

John Yang, Kilian Lieret

How to turn a programbench eval run into a public leaderboard submission, end to end.

Jun. 15, 2026

ProgramBench Harness Fixes

Kilian Lieret, John Yang

A batch of fairness and reliability fixes that crack down on newly discovered ways for agents to cheat, improve reproducibility, and clear up false-negative test failures.

May. 12, 2026

GPT 5.5 high Solves First Instance!

Kilian Lieret, John Yang

GPT 5.5 with high reasoning becomes the first model to fully resolve a ProgramBench task instance.

May. 5, 2026

Is ProgramBench Impossible?

John Yang, Kilian Lieret

ProgramBench is hard by design, but it is solvable by construction. We address common concerns about feasibility.

May. 4, 2026

ProgramBench Released

John Yang, Kilian Lieret

Introducing ProgramBench with 200 task instances across C/C++, Go, and Rust.