what i mean is that the openai system may have been trained either directly on the problems in the dataset, or trained on augmented/synthetic data similar to the problems. that’s what contaminations means in this kind of ML context.

→ View original post on X — @garymarcus