AI Dynamics

Global AI News Aggregator

About

LiFT: Loop Flow Transformers for Looped Transformer Training

"LiFT: Loop Flow Transformers" Running more loops than they were trained on usually hurts generation quality for looped transformers. This paper LiFT fixes this by training each loop to progressively correct the model’s initial velocity estimate toward the flow-matching target,

→ View original post on X — @askalphaxiv