AI Dynamics

Global AI News Aggregator

About

Local Model Under 30GB Memory for Tool-Calling Tasks

I'm trying to find a local model that uses less than about 30GB of memory to run (since my M2 has 64GB and I want to run other stuff too) that's competent at running tools in a loop to power something similar to Claude Code

→ View original post on X — @simonw