Most local LLMs are way, way weaker than hosted ones for most purposes – the best I've tried myself has been Mixtral 8x7B but it's still not in the same class as Claude 3 Haiku I haven't run 8x22B locally myself yet, I don't have the RAM for it

→ View original post on X — @simonw