I just quantized this amazing model to 4-bit, with support for the MLX platform so you can run it super fast on Apple Silicon https://
huggingface.co/mlx-community/
Nous-Hermes-2-Mistral-7B-DPO-4bit-MLX
…
Nous-Hermes-2 Quantized to 4-bit for MLX Apple Silicon
By
–