4. SmolLM2 SmolLM2 demonstrates that strategic data curation beats scale through a 1.7B parameter model trained on 11 trillion tokens using iterative data mixing optimization.
SmolLM2: Strategic Data Curation Over Scale in Language Models
By
–
By
–
4. SmolLM2 SmolLM2 demonstrates that strategic data curation beats scale through a 1.7B parameter model trained on 11 trillion tokens using iterative data mixing optimization.