https://t.co/D8MAjuh2h7 pic.twitter.com/o0MB17HvDM
— Alexandr Wang (@alexandr_wang) 14 décembre 2024
Ilya Sutskever says that data is the fossil fuel of AI and "we have achieved peak data" because "we have but one internet", so the age of pre-training AI on bigger and bigger compute clusters "will unquestionably end"