If you could afford a Cray, collecting 1.2 million digital images for ImageNet would not be a gating factor. DQN or AlphaGo didn’t need any data. The ChatGPT moment would have needed more data and compute, but the data would still be the lesser challenge.

→ View original post on X — @id_aa_carmack,