Deep learning lessons (known in 2016 but starkly confirmed since): 1. Scalable ideas > clever ideas
2. Improving the dataset > improving the model
3. Engineering chops > academic chops
Three Essential Deep Learning Lessons: Scale, Data, and Engineering
By
–