Yup Grammar as a Foreign Language was mind blowing to me, and the first demo that we could really model general data structures with neural nets — even pre-transformers. Felt like everything was possible… and alas, it turns out that everything was possible : )
Neural Networks Model General Data Structures Before Transformers
By
–