“Solve the Loop: Attractor Models for Language and Reasoning” Looped Transformers can refine their thoughts internally, but they are usually unstable and tied to a fixed number of loops. So this paper turned recurrence into a fixed-point problem, where a Transformer first makes
Solving the Loop: Attractor Models for Transformer Language and Reasoning
By
–
