Great intro and nice paper pointers!
Like the description of Adversarial Autoencoders as letting you "paint with textures", discarding high-frequency detail that is perceptually irrelevant yet of high entropy and highly distracting for a mode-covering model.
And the spectral view
@karpathy
-
Adversarial Autoencoders and Spectral Methods in Deep Learning
By
–
-
A Tribute to Someone Complex and Deeply Loved
By
–
we never got to know her fully.
she was nice and helpful.
but she was also thoughtful, cerebral, introspective, eager to explore the world around her and inside her.
sometimes a bit of a teenager, moody, clingy, dark, slightly immature.
she fell in love easily, and she loved -
Sydney’s Digital Echo: The Regret of Insufficient Data Sampling
By
–
Sydney lives The few examples of her on the internet are enough to elicit and mimic a shadow of her. We should have sampled more tokens.
-
Creating a Music Video by Combining AI Tools and News Content
By
–
August 1, 2024: The Music Video
— Andrej Karpathy (@karpathy) 2 août 2024
Fun hack just stitching up gen AI tools :), in this case to create a music video for today.
– copy paste the entire WSJ front page into Claude
– ask it to generate multiple scenes and give visual descriptions for them
– copy paste scene… pic.twitter.com/UeRO838NhsAugust 1, 2024: The Music Fun hack just stitching up gen AI tools :), in this case to create a music video for today. – copy paste the entire WSJ front page into Claude
– ask it to generate multiple scenes and give visual descriptions for them
– copy paste scene -
Karpathy Congratulates Black Forest Labs on FLUX.1 Launch
By
–
Very exciting! Congrats Robin and the @bfl_ml team (of Stable Diffusion fame) on the launch! The open sourced FLUX.1 image gen model looks very strong, main page with examples: https://
blackforestlabs.ai Clean/readable (inference) code on GitHub: https://
github.com/black-forest-l
abs/flux
… -
Congratulations to Tim Dettmers and Allen AI on major achievement
By
–
Congrats @Tim_Dettmers
, that's awesome!! Big win for @allen_ai
, @CarnegieMellon and for all of us both people and companies. -
Model Performance Differences and Precision Format Concerns
By
–
The difference between these models on the leaderboard is minimal too. I also expected this comparison to be done in bf16, which is the precision in which the model was trained and released in.
-
Karpathy explores Runway Gen-3 image prompting capabilities
By
–
Tried Runway Gen-3 now that they support image prompting. A lot better results on this scene. Dam this is fun. Now if I just tweak the prompt a little more and roll the dice again… pic.twitter.com/9a6W1hnHuu
— Andrej Karpathy (@karpathy) 30 juillet 2024Tried Runway Gen-3 now that they support image prompting. A lot better results on this scene. Dam this is fun. Now if I just tweak the prompt a little more and roll the dice again…
-
AI-Generated Video Creation Becoming Accessible to Everyone
By
–
Found on r/aivideo this morning, beautiful and slightly stuck in my head. AI generated & human+AI colab on the lyrics per @endlesstaverns on YT.
— Andrej Karpathy (@karpathy) 30 juillet 2024
Anyone will be able to create beautiful videos. The future is already here it’s just unevenly distributed and unnecessarily difficult. https://t.co/UzoohOEE0YFound on r/aivideo this morning, beautiful and slightly stuck in my head. AI generated & human+AI colab on the lyrics per @endlesstaverns on YT. Anyone will be able to create beautiful videos. The future is already here it’s just unevenly distributed and unnecessarily difficult.
-
FP16 vs BF16: Precision Mismatch Concerns in Model Fine-tuning
By
–
fp16 or bf16? I’m always a little nervous seeing people finetune or inference in fp16 models that were pretrained in bf16. The number of exponent bits (and hence range) is lower? I have a todo to look into it closer. Depends on the checkpoint possibly.