I think a lot depends on how much pre-training data went into and how diverse was it – we made a massive jump from the models in 2023 to 2024. I'm quite sure the jump from 2024 to 2025 will be quite significant too!
Pre-training Data Diversity Drives Major AI Model Improvements
By
–