4). A Survey on Data Synthesis and Augmentation for LLMs – provides a comprehensive summary of data generation techniques in the lifecycle of LLMs; includes discussions on data preparation, pre-training, fine-tuning, instruction-tuning, preference alignment, and applications.
Data Synthesis and Augmentation Techniques for Large Language Models
By
–