Me neither :). I think with new lower-precision formats, and better distilled models, we'll maybe increasingly adopt long-context LLMs run locally.
Lower-precision formats and distilled models enabling local long-context LLMs
By
–
By
–
Me neither :). I think with new lower-precision formats, and better distilled models, we'll maybe increasingly adopt long-context LLMs run locally.