You can literally inference LLaMA. And that 192GB in the new Mac Studio is way more than enough to go beyond the 13B param model.
LLaMA Inference on Mac Studio with 192GB Memory
By
–
By
–
You can literally inference LLaMA. And that 192GB in the new Mac Studio is way more than enough to go beyond the 13B param model.