Distillation Beats Zero-RL: A Simpler Path to Smarter Reasoning? This paper delivers a surprising—and important—result: simple distillation from a stronger model can outperform full-blown reinforcement learning on small models, even with far fewer data and less compute. Key
Distillation Outperforms RL for Smarter Small Model Reasoning
By
–
