Qwen 2.5 7B just dropped with a 1M context window. Here it is running at 4bit @ 11 tok/s.

Should we add it to the next update? 1M of context adds a lot of possibilities. pic.twitter.com/y4uhLfHKNS

— Aaron Ng (@localghost) 27 janvier 2025

Qwen 2.5 7B just dropped with a 1M context window. Here it is running at 4bit @ 11 tok/s. Should we add it to the next update? 1M of context adds a lot of possibilities.

→ View original post on X — @localghost,