AI Dynamics

Global AI News Aggregator

About

Tokenization vs arithmetic errors in LLMs

Less in the “profound” category but inspired by ppl saying this about “David Mayer” which seems to just be a string filter In general I think arithmetic and indexing failures are over-attributed to tokenization; e.g. digit tokenization is more consistent than most realize

→ View original post on X — @goodside