2). LLM Pruning and Distillation in Practice – provides a comprehensive report on effective methods for compressing Llama 3.1 and Mistral NeMo models; it presents pruning and distillation approaches applied to the original models to produce 4B and 8B parameter models,
LLM Pruning and Distillation: Compressing Llama and Mistral Models
By
–