Because model merging and abliteration are destructive, DPO has been essential to healing networks. These days are now over: distillation is the new powerhouse that not only heals models but also improves them.
Distillation Emerges as Superior Model Improvement Technique Over DPO
By
–