It's closer to the other way around — I arrived at these ideas by doing experimental deep learning research and trying to make sense of my results. Theorizing requires data. And once you have the theory you must test it — which is why I made ARC (an experimental test) and

→ View original post on X — @fchollet