The first RNN in transformers! Announcing the integration of RWKV models in transformers with @BlinkDL_AI and RWKV community!
RWKV is an attention free model that combines the best from RNNs and transformers.
Learn more about the model in this blogpost: https://
huggingface.co/blog/rwkv

→ View original post on X — @huggingface