Attention may not be all you need, at least not according to the authors of Hyena: @MichaelPoli6
, @Massastrello
, Eric Nguyen, @realDanFu
, @tri_dao
, Stephen Baccus, Yoshua Bengio, @StefanoErmon
, Christopher Ré @HazyResearch
, @Mila_Quebec
, @UMontreal
, @SnorkelAI . Hyena can handle
Hyena Architecture Challenges Attention Dominance in AI Research
By
–