So far my generation speed is mostly stable in Pi (I haven’t tried super large context yet)

→ View original post on X — @julien_c