New 3h31m video on YouTube:
"Deep Dive into LLMs like ChatGPT" This is a general audience deep dive into the Large Language Model (LLM) AI technology that powers ChatGPT and related products. It is covers the full training stack of how the models are developed, along with mental
@karpathy
-
Deep Dive into LLMs: Complete Training Stack Overview
By
–
-
Building an LLM Council with Debate and ELO-Based Chair Selection
By
–
This is cool! I want to build something like it too because I want my LLM council. First they all run, then they debate, and then the chair of the council (the highest ELO model) works out the final response.
-
Building a Real-Time Battleship Game Between Two LLMs
By
–
Earlier, also ~hour of vibe coding, I built a Battleship game wired up so that you see two LLMs (any two models you select) are fighting each other in real time. I don't have super strong stats yet on this but I believe 4o beats 4o-mini, lol.
-
Custom LLM Reader App for Interactive Book Analysis
By
–
Last ~hour I built a custom LLM reader app so while I read Wealth of Nations I can ask questions about any paragraph. When you click a paragraph and "Ask" it calls an LLM, builds context window of what this is, copy pastes the full chapter, the paragraph, and the question. Works
-
The Spectrum of LLM Assistance in Programming: From Traditional to Vibe Coding
By
–
The amount of LLM assist you receive is clearly some kind of a slider. All the way on the left you have programming as it existed ~3 years ago. All the way on the right you have vibe coding. Even vibe coding hasn't reached its final form yet. I'm still doing way too much.
-
Vibe Coding: Embracing AI-Powered Development Without Traditional Constraints
By
–
There's a new kind of coding I call "vibe coding", where you fully give in to the vibes, embrace exponentials, and forget that the code even exists. It's possible because the LLMs (e.g. Cursor Composer w Sonnet) are getting too good. Also I just talk to Composer with SuperWhisper
-
Codenames Game Perfect Fit for AI Reasoning and Knowledge
By
–
Wow! I was exactly thinking to do Codenames I think it’s a really excellent fit for reasoning and world knowledge.
-
Games as Dynamic LLM Evaluation: Self-Balancing Difficulty Assessment
By
–
I quite like the idea using games to evaluate LLMs against each other, instead of fixed evals. Playing against another intelligent entity self-balances and adapts difficulty, so each eval (/environment) is leveraged a lot more. There's some early attempts around. Exciting area.
-
Teaching LLMs with Textbook Information Structure
By
–
We have to take the LLMs to school. When you open any textbook, you'll see three major types of information: 1. Background information / exposition. The meat of the textbook that explains concepts. As you attend over it, your brain is training on that data. This is equivalent
-
LLMs Need Education Like Humans Do
By
–
We just have to take the LLMs through school, exactly like humans.