Yes, because the base model has far more capacity than all the previous ones, so it's better at memorizing the training dataset.
Larger base model capacity improves training data memorization
By
–
By
–
Yes, because the base model has far more capacity than all the previous ones, so it's better at memorizing the training dataset.