AutoQuant: automatically quantize your LLMs in Colab Following llama.cpp's updates to fix Llama 3 quants, it's time to communicate again about AutoQuant It's a user-friendly Colab to create your own GGUF, EXL2, AWQ, and HQQ quants Colab: https://
colab.research.google.com/drive/1b6nqC7U
ZVt8bx4MksX7s656GXPM-eWw4?usp=sharing
…

→ View original post on X — @maximelabonne,