Banger paper from Microsoft and Cornell. If you have looked at thinking tokens and decided you cannot afford the context, read this one. (bookmark it) A pause token buys the model extra compute for each next-token prediction, and it pays for that compute with a sequence
Pause Tokens Give Models More Compute Before Predicting
By
–
