To fix evaluation, they built Terminal-Bench Pro: → 400 tasks across 8 domains
→ Zero contamination risk
→ Deterministic environments
→ Comprehensive test coverage Every other benchmark is broken. This is what rigorous agent evaluation actually looks like.
Terminal-Bench Pro: Rigorous Agent Evaluation
By
–
