Loop engineering has emerged as a new skill for AI engineers But there is very little research measuring how effective it is. The best results on full tasks in a new benchmark is ~25%. LoopArena from AMAP evaluates the outer loop rather than the coding agent. A Controller
LoopArena Tests Outer-Loop Controllers on Tasks With Low Completion Rates
By
–
