SVM and kNN are intellectually beautiful and practically capped. That's a real tension the field doesn't talk about enough. Theoretical cleanliness and empirical scalability pulled in opposite directions for basically the entire deep learning era, and scalability won every
Theoretical Beauty vs Practical Scalability in Machine Learning
By
–