Claude 3 takes on the Tokenization book chapter challenge 🙂 context: https://t.co/yRaeTbkblY

Definitely looks quite nice, stylistically!

If you look closer there are a number of subtle issues / hallucinations. One example there is a claim that "hello world" tokenizes into 3… https://t.co/mMjK27Uk2y

— Andrej Karpathy (@karpathy) 4 mars 2024

Claude 3 takes on the Tokenization book chapter challenge 🙂 context: https://
x.com/karpathy/statu
s/1760740503614836917
… Definitely looks quite nice, stylistically! If you look closer there are a number of subtle issues / hallucinations. One example there is a claim that "hello world" tokenizes into 3

→ View original post on X — @karpathy