I don't think that will run an LLM very well, you need GPU-accessible memory to get good performance That's what's neat about Apple Silicon – regular RAM is available to the GPU
Apple Silicon GPU Memory Access Enables Better LLM Performance
By
–
By
–
I don't think that will run an LLM very well, you need GPU-accessible memory to get good performance That's what's neat about Apple Silicon – regular RAM is available to the GPU