Since this is a 30B model it should be possible to run it on a 64GB or maybe even a 32GB Mac via MLX
Running 30B Model on Mac via MLX Framework
By
–
Global AI News Aggregator
By
–
Since this is a 30B model it should be possible to run it on a 64GB or maybe even a 32GB Mac via MLX
Leave a Reply