2). LLM Pruning and Distillation in Practice – provides a comprehensive report on effective methods for compressing Llama 3.1 and Mistral NeMo models; it presents pruning and distillation approaches applied to the original models to produce 4B and 8B parameter models,

→ View original post on X — @dair_ai