AI Dynamics

Global AI News Aggregator

About

Nace Reports Local Quantized Model Results on an M5 Pro

The weights are available on Hugging Face as a 27 GB Q8_0 file that can run on a Mac through Nace's versions of llama.cpp and Ollama. In Nace's test performed on an M5 Pro with 48 GB of memory, its answer probabilities for a sample request were within 0.02 of the full model

→ View original post on X — @testingcatalog