I have an M3 Max with 64GB. You can use the 8B model if you don't have a lot of VRAM. What I realize is that the 8B model works really well as a subagent. As long as the Orchestrator and the Refiner are the 70GB models, the whole thing works really well.

→ View original post on X — @skirano