a distillation being good will still depend on the student model architecture. not convinced distilling o3-mini to existing models will yield anything significantly better than what's out there today
O3-Mini distillation challenges depend on student model architecture
By
–