AI Dynamics

Global AI News Aggregator

About

Pause Tokens Give Models More Compute Before Predicting

Banger paper from Microsoft and Cornell. If you have looked at thinking tokens and decided you cannot afford the context, read this one. (bookmark it) A pause token buys the model extra compute for each next-token prediction, and it pays for that compute with a sequence

→ View original post on X — @dair_ai