7/ watch this space closely. My prediction is that model developers who are not careful about training on synthetic data with no information gain will find their models getting steadily stranger and dumber over time. Synthetic data accumulates a debt with the model that must be

→ View original post on X — @alexandr_wang