The phones have been getting ever bigger, heavier, more full-featured. There are dozens of us that want the opposite. Dozens!
@karpathy
-
Model Evaluation: Testing AI Bias in Self-Assessment Rankings
By
–
I love doing this actually :). I think it's a pretty powerful eval too. Have all models generate something, then put it all together and give it back to all of them and ask them to rank all outputs. I thought models might have a bias to prefer their own outputs, but this doesn't
-
GPT-5 Pro outperforms competitors in code editing tasks
By
–
not yet but planning to! I rotate through a lot of what exists in few day intervals. Actually ~3 weeks ago I found codex worse and less polished than CC right now for the more basic edits and overall experience. It's just 5 Pro specifically feels SOTA by a good margin atm.
-
GPT-5 Pro Outperforms Claude on Complex Code Generation
By
–
I think congrats again to OpenAI for cooking with GPT-5 Pro. This is the third time I've struggled on something complex/gnarly for an hour on and off with CC, then 5 Pro goes off for 10 minutes and comes back with code that works out of the box. I had CC read the 5 Pro version
-
LLM Security Risk: Shell Command Injection via Tilde Expansion
By
–
I almost had this happen yesterday, but my LLM suggested the right thing as `rm -rf '~'`. (with 'quotes'). Still very scary. Example of how this happens, e.g. if something like this sneaks into your .bashrc: export WANDB_DIR="~/.cache/wandb" The ~ isn't expanded inside "quotes"
-
Algorithm convergence trap: viral content as optimization limit
By
–
in the limit of revenue/growth maxxing via A/B tests doesn't it all just converge to funny panda videos? it's the supermasive black hole at the center of the universe and no matter the initial conditions you eventually get sucked in. reels. youtube shorts. substack notes.
-
Transforming Knowledge for LLM-First Applications and Education
By
–
Transforming human knowledge, sensors and actuators from human-first and human-legible to LLM-first and LLM-legible is a beautiful space with so much potential and so much can be done… One example I'm obsessed with recently – for every textbook pdf/epub, there is a perfect
-
SFT Layer Impact on Pretraining Embedding Space Representations
By
–
I thought this should have already applied on the SFT layer and was a bit surprised when it didn't. Possibly it's that SFT is so few bits / brief that it is at most a shifting of superficial style around a pre-existing embedding space from (common) pretraining, with everyone
-
Transforming textbook problems into AI learning environments
By
–
How amazing it would be if we could extract and reframe all the practice problems from all the textbooks ever written into environments…
-
RL Finetuning: Major Upgrade Over SFT for LLMs
By
–
I just mean long term, imo RL finetuning paradigm is a big upgrade over just SFT (expert imitation) for LLMs at the current stage of development and will continue to grow substantially.