“Continual Learning Mechanisms Compose for Long-Horizon Memorization” catastrophically forgetting in sequential fine-tuning loses about 98.8% of knowledge after 100 tasks. So this paper combines generative replay, self-distillation, weight regularization, and merged LoRA to
Combining Continual Learning Methods to Reduce Catastrophic Forgetting
By
–
