The 4bit model should work comfortably on 32GB, the 6bit might just fit on that too If you have 16GB or less you're out of luck for this particular Qwen model
Qwen 4bit and 6bit Model Memory Requirements Guide
By
–
By
–
The 4bit model should work comfortably on 32GB, the 6bit might just fit on that too If you have 16GB or less you're out of luck for this particular Qwen model