The portrait can see and hear you and talk to you just like in the movie, and recognize you as the second factor.
@karpathy
-
Andrej Karpathy wants to buy a living portrait from Hogwarts
By
–
The living portraits at Hogwarts are now technologically quite possible. Would like to buy one and enter my house this way pic.twitter.com/Gqq1VJQl6V
— Andrej Karpathy (@karpathy) 2 mai 2024The living portraits at Hogwarts are now technologically quite possible. Would like to buy one and enter my house this way
-
LLMs in Space: Hardening llm.c to NASA Safety Standards
By
–
Clearly LLMs must one day run in Space Step 1 we harden llm.c to pass the NASA code standards and style guides, certifying that the code is super safe, safe enough to run in Space. https://
en.wikipedia.org/wiki/The_Power
_of_10:_Rules_for_Developing_Safety-Critical_Code
… (see the linked PDF)
LLM training/inference in principle should be super -
Code Simplicity vs Compression: The LOC Paradox
By
–
[gif] me trying to read tinygrad code earlier 😀
— Andrej Karpathy (@karpathy) 25 avril 2024
I think the LOC requirements (which are only a proxy for simplicity) led to too great compression. You wouldn't brag about your .min.js code being 1 LOC. Imo it would be a lot more simple if the code was given room to breathe and… pic.twitter.com/K4krMQdRkU[gif] me trying to read tinygrad code earlier 😀 I think the LOC requirements (which are only a proxy for simplicity) led to too great compression. You wouldn't brag about your .min.js code being 1 LOC. Imo it would be a lot more simple if the code was given room to breathe and
-
Mastering AI coding assistance through practice and proper prompting
By
–
I've also gotten really good at it. I think people who dislike it must have given up too early. You have to learn what to expect, what works, what doesn't work, how to position your cursor (e.g. to not get distracting suggestions), and how to prompt it well via code/comments
-
H100 GPUs as the Ultimate Source of Happiness
By
–
Money can't buy happiness.
Just like an H100.
H100 = happiness. -
Open Weights 70B Model Reaches GPT-4 Performance Level
By
–
Surprising because this is showing an open weights 70B model at GPT-4 level (for any prompt I may wish to ask)
-
Memory optimization strategies for model training
By
–
didn't realize it was that easy, will take a look at; you can also try decreasing the batch size all the way down to 1, or then also decreasing sequence length until it fits, but you're compromising on max context length that way.
-
The Three Essential Elements of High-Quality Datasets
By
–
The 3 key elements of a good dataset: 1. quality
2. diversity
3. quantity You can only easily measure the last one but the performance is a sensitive function of all three. Super interesting topic ty for #longread :)! -
LLMs as Arrays: Meditation on Entropy and Truth
By
–
As I emerged from meditation it dawned on me that LLMs are just one array of floats and a while loop over some super simple arithmetic on its elements. It is entropy that is the root of suffering. It's by deleting the superfluous that we uncover truth. And thus I was enlightened.