Those tasks are irrelevant to my point. You seem to be denying that transformers have more compositional power than MLPs.

→ View original post on X — @pmddomingos