building models is a juggling act, we optimized 05-06 for certain code tasks at the cost of other tasks, good lessons learned that the small regressions we saw in evals tracked to how people felt about the model, but we closed the gaps with 06-05!
Model optimization tradeoffs and iterative improvements in AI development
By
–