It's been a few months but I didn't see a noticeable speed difference tbh. Otherwise, Ollama has usually a nice set of quantized models and easy to switch.
No speed difference, but Ollama offers nice quantized models and easy switching
By
–
By
–
It's been a few months but I didn't see a noticeable speed difference tbh. Otherwise, Ollama has usually a nice set of quantized models and easy to switch.