StreamingLLM

22x faster inference than your standard LLM.

H/t @AlphaSignalAI

pic.twitter.com/XymK3wX4HG

— Linus ✦ Ekenstam (@LinusEkenstam) 3 octobre 2023

StreamingLLM 22x faster inference than your standard LLM. H/t @AlphaSignalAI

→ View original post on X — @linusekenstam