We did not steal. We invented a slightly different version independently and when someone pointed out the prior work we made sure to refer to it in the abstract. Matching logits puts equal importance on all classes. Distillation puts more importance on more probable classes.

→ View original post on X — @geoffreyhinton,