An analogy is: if you fine tuned an ImageNet classifier to classify all fruits as cats and all vegetables as dogs, it would probably misclassify a lot of other categories as cats and dogs too.
Fine-tuning bias: when models misclassify beyond training data
By
–