To help explain the weirdness of LLM Tokenization I thought it could be amusing to translate every token to a unique emoji. This is a lot closer to truth – each token is basically its own little hieroglyph and the LLM has to learn (from scratch) what it all means based on

→ View original post on X — @karpathy