9/ Long-range Language Modeling with Self-Retrieval – an architecture and training procedure for jointly training a retrieval-augmented language model from scratch for long-range language modeling tasks.

→ View original post on X — @dair_ai