Being able to produce outputs for an arbitrary input doesn’t give you the ability to reproduce the input distribution of the tuning data. Even if you somehow can, tuning on the generations of a tuned model is like making a copy of a copy of a VHS tape.

→ View original post on X — @goodside