I should write something longer about the similarities of this absurd-in-hindsight bet with some current projections about AI transforming everything in the next few years. The inertia of the system of the world is underestimated.
@id_aa_carmack
-
Language Models Trained on Vastly More Data Than Humans Encounter
By
–
A person is exposed to on the order of a billion words over their entire life through speech and reading. Modern large language models are fed hundreds of times that in the weeks of their training.
-
Datacenter Cooling: Why Air Cooling Still Dominates Over Liquid
By
–
Datacenter cooling came up at lunch, and Trista @Project2501_117 was very surprised that they are still built around air cooling instead of liquid cooling —“WTF, are they Harley-Davidsons???”
-
Carmack Declines to Engage in AI Doom Debate
By
–
I am not going to be drawn into the AI Doom conversation. @perrymetzger has been making many of the points I would; check out some of his threads if you want another perspective.
-
Academia as the Jedi Order: Academic Lineage and Mentorship
By
–
Thinking about academia as the Jedi Order: @woj_zaremba Padawan of @ylecun
, Padawan of @geoffreyhinton -
Quest System-Level Voice Filter Options and AI Models
By
–
Quest should probably have system level voice filter options. Frequency shifting and equalization would be straightforward, but it could eventually go to full AI models. Care would be needed to make sure it doesn’t introduce a frame of latency.
-
CUDA Graph Capture and PyTorch Integration Performance Benefits
By
–
CUDA graph capture is like old school OpenGL display lists, but clearly specified as just kernels operating on already allocated buffers. The PyTorch integration is very well done; if you can be 100% graphs, the python overhead basically vanishes.
-
Specialized AI applications beyond graphics processor implementations
By
–
I haven’t used any processor in memory implementations, but I can imagine more direct uses for specialized AI than graphics work.
-
Government oversight of large-scale AI training compared to rocket regulations
By
–
The comment “we think it’s important that major world governments have insight about training runs above a certain scale” makes me recall the 200,000 lb-sec FAA amateur rocketry limit.
-
Criticism of Greek letters in algorithm naming conventions
By
–
Being cute and putting Greek letters in your algorithm name is not appreciated. Looking at you, Maximal Update Parameteization / (µP)!