PS @SchmidhuberAI in 1991 published something related to compressing history length in RNNs, which may be very relevant for long context, an important topic of research today.
Schmidhuber’s 1991 RNN History Compression Method for Long Context
By
–
By
–
PS @SchmidhuberAI in 1991 published something related to compressing history length in RNNs, which may be very relevant for long context, an important topic of research today.