I got Llama 3 running in my browser using only my GPU with my Wi-Fi switched OFF completely client-side

WebGPU is a new feature in browsers where JS can use the GPU of the device and apparently you can run LLMs on it too, and it's fast!

My end goal for 🧠… pic.twitter.com/iz1oxeUQNp

— @levelsio (@levelsio) 11 mai 2024

I got Llama 3 running in my browser using only my GPU with my Wi-Fi switched OFF completely client-side WebGPU is a new feature in browsers where JS can use the GPU of the device and apparently you can run LLMs on it too, and it's fast! My end goal for

→ View original post on X — @levelsio,