Researchers just figured out why looped transformers are so powerful. Most language models store huge amounts of knowledge but fail to combine facts in a single pass. Ask one a 10-step reasoning question and it breaks. A new paper explores looped transformers, an architecture
Why Looped Transformers Excel at Multi-Step Reasoning
By
–
