This is really really cool! I totally buy the idea of using your current LLM to annotate your full training data and increase the quality of subsequent pretrainings. Training data is the most valuable asset, gives back 1000x the care and love you give it!

→ View original post on X — @thom_wolf,