The False Promise of Imitating Proprietary LLMs (
https://
arxiv.org/abs/2305.15717) Crowd workers rate imitation models (models trained on other models' outputs) highly. But it turns out that these imitation models only tend to mimic the style of the upstream LLMs not their factuality.

→ View original post on X — @rasbt,