Transformers are better than MLPs far from the limit. And these papers are about something else. All it takes for my statement to be correct is that a transformer can learn to parse correctly in some cases.

→ View original post on X — @pmddomingos