Thank you … this certainly was and still is one of my favourite projects. The moment @scott_e_reed and I saw GPT we started working on Generalist AgenT One (GATO). We strongly believed a model could do anything a human could do from motor control, to perception, generation,
@nandodf
-
Compute as Energy Systematic Flow and Thermodynamic Order
By
–
I see compute as the energy systematic flow, Tom. For analogy, a cell uses the free energy of the sun to create order, will dissipating waste to the outside, thus respecting the Second Law of Thermodynamics.
-
Data Processing Intelligence and Synthetic Learning in AI Algorithms
By
–
Yes. First there’s still the need of processing the data intelligently, and data keeps growing (billions of videos per year). Second, many algorithms can exploit the environment and other agents to learn from growing synthetic data, eg DeepSeek-zero learning math.
-
AlphaGo Zero Trained Exclusively on Synthetic Data
By
–
AlphaGo zero trained only on synthetic data.
-
Data, Evaluations, and Ablations Require Substantial Effort
By
–
data, evals and ablations take a ton of effort
-
Scaling Believers Sought: GPU Hardware Request
By
–
Anyone who doesn’t believe in scaling, please send me your GPUs
-
Complexity and Experimental Mathematics with AI by Master Mathematician
By
–
On complexity, experimental mathematics with AI, … a powerful tour of ideas by one the greatest masters of mathematics. “Infinity hides a lot of sins” was my favourite
-
Appreciation for Fascinating AI Research Direction
By
–
This is a fascinating research direction in AI. Thanks for sharing @SebastienBubeck
-
Stop Gradient in Second Encoder: Alternative Collapse Prevention Method?
By
–
Thanks Randall. One more question if you don’t mind: is the stop gradient in the second encoder an alternative to prevent collapse? Or not?
-
Hiring Strong RL Engineers for Frontier AI Research
By
–
Are you a strong and ambitious RL engineer interested in reasoning, thinking, awareness, reward modelling for images and video, distributed systems, generative video games, and pushing the frontiers of knowledge generation? If so, please fill in the form below.