A related recent paper uses GPT-3.5 and GPT-4 to generate a synthetic dataset of short stories that only contain words that typical 3 to 4-year-olds would understand. They show that such a dataset leads to very efficient learning of grammar and reasoning!

→ View original post on X — @hardmaru,