Those techniques are not explicitly new—GPT quantization goes back to October 2022 (and Google released a paper about leveraging sparsity in training in 2021). LoRA shows up in a paper in 2021.
GPT Quantization and LoRA: Historical Context of Optimization Techniques
By
–