It feels like they're talking about "offline" distillation here, but actually implemented online distillation as described in the paper
Offline vs Online Distillation: Implementation Discrepancy Analysis
By
–
By
–
It feels like they're talking about "offline" distillation here, but actually implemented online distillation as described in the paper