3/3 Intuitively one major criticism of ChatGPT is it's 2020 knowledge cut-off. If you are only using synthetic data from old models, it'd be challenging to get more contemporary knowledge into the model.

→ View original post on X — @rasbt