Why settle for attention when you can learn at test time? Tsinghua University & Alibaba Group present ViT³: a pure Test-Time Training (TTT) architecture that replaces attention with an online learning model built from key-value pairs. This inner model trains on the fly,
ViT³: Test-Time Training Replaces Attention with Online Learning
By
–
