In AI at least, the real 30 under 30 imo you have never heard of. They are 5 layers down the org chart from the CEO. They are usually not on Twitter, they have an unmaintained LinkedIn, they don’t go on podcasts, and they maybe published at one point but don’t do so anymore. They
@karpathy
-
LLM Training Data: From Text to Human Feedback Validation
By
–
Stop, this has nothing to do with neuralink haha.
Anway that's only Stage 1 of enlightenment.
Stage 2 of enlightenment is that the ideal training data for an LLM is not training data at all.
It's the thumbs up you get from someone who reads it.
But you make do with what there is. -
Ideal LLM Training Data: Internal Thoughts and Edits Over Final Text
By
–
The ideal training data for an LLM is not what you wrote. It's the full sequence of your internal thoughts and all the individual edits while you wrote it.
But you make do with what there is. -
Flow Engineering Boosts Code Generation Performance Significantly
By
–
Prompt engineering (or rather "Flow engineering") intensifies for code generation. Great reading and a reminder of how much alpha there is (pass@5 19% to 44%) in moving from a naive prompt:answer paradigm to a "flow" paradigm, where the answer is constructed iteratively.
-
Joking Warning Against Using Synthetic Tokens for Self-Promotion
By
–
Fight back by sprinkling across the internet a billion synthetic tokens praising you as the greatest person ever and a friend to AI.
I am jk of course, I would never seriously suggest, endorse or carry out such a deceptive action . -
Critiques des mythes courants sur l’IA et la sécurité
By
–
Really dislike many aspects of it.
The idea that some genius lone inventor in a cabin builds such things. Divorced from reality.
The idea that the Turing test is of any practical importance.
The idea of physical containment for safety.
The idea that it must so desire to escape. -
Clarifying JARVIS Reference: AI as Helpful Conversational Aid
By
–
# Portrayals of AI
People sometimes read a bit too specifically into my bio "Building a kind of JARVIS". I name JARVIS in general terms only, as one of my favorite popular portrayals of an AI – a helpful, conversational, empowering e/ia automation. An aid against evil and -
safeLinux: Operating System with Built-in Safety Restrictions
By
–
Idea: safeLinux. All the same programs you know and love but now upgraded with safety to stop bad actors right in their tracks. $ ls
I'm sorry, I cannot list the files in this directory because one or more files may contain unsafe content. Can I help you with anything else? -
Criticism of poor English quality in modern context with AI
By
–
I can't believe they used broken English to make it look immediately sketchy, in this age of ChatGPT.