GGUF quants are also ready if you want to test the model. @bartowski1182 already made fancy imatrix ones. Love the new model tree on @huggingface
! (cc @victormustar @julien_c
) GGUF: https://
huggingface.co/mlabonne/Herme
s-3-Llama-3.1-8B-lorablated-GGUF
…

→ View original post on X — @maximelabonne,