6/ Post-training data strategy is becoming a key arena for competition. Llama3.1 paper had 15 pg about post-training data (vs. 12 pg on pre-training), driving these capabilities: – Code
– Multilinguality
– Math/Reasoning
– Long-Context
– Tool Use
– Factuality
– Steerability

→ View original post on X — @alexandr_wang,