Notably, both papers present negative results, showing that many efficient Transformers will provably struggle with reasoning tasks unless the number of parameters is significantly increased.

→ View original post on X — @jiqizhixin