Pleased to report that the Llamafile release of Llama-3-70B-Instruct works on my 64GB M4 – I had to download the 37GB file, quit a whole bunch of apps to free up RAM, then chmod 755 it, run ./Meta-Llama-3-70B-Instruct.Q4_0.llamafile and visit it on port 8080 on localhost

→ View original post on X — @simonw