(I think this is the right appeal, it doesn't appear like math science or engineering would be supported in such a Universe. Forget quantum physics etc., would even simple calculations like multiplying two numbers "work" and how wouldn't you always get hallucinations)
@karpathy
-
Simulation Hypothesis: Neural Approximation Over Physical Exactness
By
–
New simulation hypothesis drop.
Maybe the simulation is not physical and exact but neural and approximate.
i.e. not about simulating fields or particles with physical equations but a giant Diffusion Transformer++ creating a large "dream". -
Luma Labs AI Video Generation from Images Impresses Karpathy
By
–
wow. The new model from @LumaLabsAI extending images into videos is really something else. I understood intuitively that this would become possible very soon, but it's still something else to see it and think through future iterations of.
— Andrej Karpathy (@karpathy) 13 juin 2024
A few more examples around, e.g. the… https://t.co/zH1xjAgrNnwow. The new model from @LumaLabsAI extending images into videos is really something else. I understood intuitively that this would become possible very soon, but it's still something else to see it and think through future iterations of. A few more examples around, e.g. the
-
Scaling Risk: Why Small-Scale Proofs Don’t Guarantee Success
By
–
Two related good quotes I heard recently: "You can prove that something won't work at small scale, but not that something works at small scale" "There's way more ideas out there than compute that's willing to take a risk on it"
-
Technology exists today to make it work, says Karpathy
By
–
100% agree, "the proof is in the pudding". It has to actually work. I will say that I think the technology exists today to actually make it work at the needed threshold. Actually making it work is still difficult. But 6 years ago I would have said the technology does not exist.
-
Apple Intelligence: Multimodal AI Integration Across iOS
By
–
Actually, really liked the Apple Intelligence announcement. It must be a very exciting time at Apple as they layer AI on top of the entire OS. A few of the major themes. Step 1 Multimodal I/O. Enable text/audio/image/video capability, both read and write. These are the native
-
Icon Color Customization Before AGI Deployment
By
–
I am also exhilarated to learn that you can now change the color of your icons, and that you can choose ANY color you want, right before we look at how we deploy SOTA AGI to a few billion devices.
-
Apple’s AI announcements at WWDC 2024 underwhelm expectations
By
–
If you tuned in to WWDC to see what Apple is doing with AI, we're all probably thinking the same thing around now 50 minutes into it…
-
GPT-2 Speed Run: Building 124M Model from Scratch
By
–
"GPT-2 speed run" haha I love that.
From empty file to GPT-2 (124M) 😀 -
llm.c optimization: balancing historical accuracy and training speed
By
–
This is cool!! I'm not exactly sure how to upstream these changes to llm.c… Part of me wants to reproduce GPT-2/3 using their exact hyperparameters just for historical aesthetics, but part of me also wants to just train things as fast as possible. Probably both. – lr 3X is