Read it years ago. Would be interesting to revisit it now given that it was written before the transformer / Attention Is All You Need paper, and everything that has transpired since.
Revisiting Pre-Transformer AI Research in Light of Modern Developments
By
–