You can run llama 70b and load it all into memory. tried it last night and it worked quite well on my m2 ultra! Also tend to prefer it for adobe tools – is more stable. But yeah when it comes to things like radiance fields and photogrammetry, or gaming — PC FTW
Running Llama 70B on M2 Ultra: Performance and Use Case Comparison
By
–