5/ Microsoft introduces their framework for FP4 quantization training. FP4 was regarded unfeasible due to too much degradation, but the proposed method in this paper achieves accuracy that is comparable to FP8 and BF16. This means less computational demand to use LLMs, while
Microsoft FP4 Quantization Framework Achieves Comparable Accuracy to FP8
By
–
