Antidistillation Sampling — a novel method to curb the effectiveness of distillation without sacrificing model performance.
A technique big AI labs might be very interested in.
Paper: https://
arxiv.org/pdf/2504.13146
Page: https://
antidistillation.com

→ View original post on X — @jiqizhixin