"Dense Supervision, Sparse Updates: On the Sparsity and Geometry of On-Policy Distillation" OPD uses dense teacher feedback on student-generated rollouts, so we might expect dense parameter rewriting. However, this paper shows that is not the case. They found that OPD updates