No, transformers can represent grammar better than (say) MLPs, which is an advance. And they can learn it to a very limited degree, so what I said is accurate.

→ View original post on X — @pmddomingos