it's the 4bit quantized version. you won't be able to fit the biggest one on an iPhone yet due to RAM limits
4-bit Quantization: RAM Limitations on iPhone Devices
By
–
By
–
it's the 4bit quantized version. you won't be able to fit the biggest one on an iPhone yet due to RAM limits