Read it years ago. Would be interesting to revisit it now given that it was written before the transformer / Attention Is All You Need paper, and everything that has transpired since.

→ View original post on X — @paulroetzer,