Yes, for sure. Distillation would be ideal but DPO would also work.

→ View original post on X — @maximelabonne