People have tried that — take a 2D Transformer and train it on tons of synthetically generated ARC data.

→ View original post on X — @fchollet