Stanford CS336 – Language Modeling from Scratch Excellent new lectures on "language modelling from scratch" class from Stanford just dropped. Covers a whole LLM stack from data collection, cleaning, transformer modelling and training, evals and deployment.
LLMS
-
Stanford CS336 Language Modeling Course Now Available on YouTube
By
–
Stanford CS336 – Language Modeling from Scratch, all lectures on youtube.
-
Next Generation AI: From GPT2 to the 6502 Moment
By
–
GPT2 was not super programmable yet. Even GPT4 or o3 still fall short a bit. I suspect it’s either nextgen or the one after that that will be considered 6502 in hindsight. Fully multimodal, really smart, reasoning, tool using, agentic, with memory. A first “basics” package.
-
Andrej Karpathy Discusses LLMs and Software 3.0 Framework
By
–
Thank you @karpathy for the shout-out to llms.txt in your wonderful talk about software 3.0 https://
youtu.be/LCEmiRjPEtQ?si
=NEu9I5bsf-mywtVY&t=2051
… -
Software 2.0: Keynote slides and resources on AI technology diffusion
By
–
Some of the links:
– My slides as keynote: https://
drive.google.com/file/d/1a0h1mk
wfmV2PlekxDN8isMrDA5evc4wW/view?usp=sharing
…
– Software 2.0 blog post from 2017 https://
karpathy.medium.com/software-2-0-a
64152b37c35
…
– How LLMs flip the script on technology diffusion https://
karpathy.bearblog.dev/power-to-the-p
eople/
…
– Vibe coding MenuGen (retrospective) https://
karpathy.bearblog.dev/vibe-coding-me
nugen/
… -
AI Startup School: LLMs as New Programming Paradigm
By
–
Nice – my AI startup school talk is now up! Chapters:
— Andrej Karpathy (@karpathy) 19 juin 2025
0:00 Imo fair to say that software is changing quite fundamentally again. LLMs are a new kind of computer, and you program them *in English*. Hence I think they are well deserving of a major version upgrade in terms of… https://t.co/XCdh8EF4iNNice – my AI startup school talk is now up! Chapters: 0:00 Imo fair to say that software is changing quite fundamentally again. LLMs are a new kind of computer, and you program them *in English*. Hence I think they are well deserving of a major version upgrade in terms of
-
Exploring New AI Models After Vacation Break
By
–
When you get back from vacation and there's so many new models to explore pic.twitter.com/n4TgZgY4hc
— fofr (@fofrAI) 18 juin 2025When you get back from vacation and there's so many new models to explore
-
AI Labs Integrating LLM Capabilities Into Chatbots as Standard
By
–
This is becoming a theme: if you are in a field where simple LLM wrappers have proliferated and are proven use cases with lots of adoptions (Copilot, Firefly, etc.) then the AI labs are likely to just toss that capability into their chatbot.
-
Gemini 2.5 Flash-Lite Emulates Desktop GUI with Impressive Speed
By
–
This is ultra cool! Gemini 2.5 Flash-Lite is so fast that in this prototype it can emulate a computer (desktop, GUI) https://t.co/29qeLFTVP9
— Marek Rosa | European🇪🇺 | South African🇿🇦 (@marek_rosa) 18 juin 2025This is ultra cool! Gemini 2.5 Flash-Lite is so fast that in this prototype it can emulate a computer (desktop, GUI)