TechCrunch article on definitions od open source and AI.
@lawrennd
-
PASCAL Visual Object Challenge Inspiration for ImageNet
By
–
He was very active in compiling the PASCAL Visual Object Challenge which was one of the inspirations for ImageNet.
-
Random Fourier Features Bridge Gaussian Processes and Neural Networks
By
–
Agreed, they're very widely used there. Although if you start using e.g. random fourier features approximations to fit them then you start getting NN like models … and all the techniques of NNs can be imported to help with scale.
-
Neural Networks as Gaussian Processes in the Infinite Width Limit
By
–
The sort of mathematics we can do with NNs is to take limits of layer sizes such that the start to behave like GPs. Then we understand how the NN is working in that limit.
-
Gaussian Processes: Mathematical Clarity vs Neural Network Complexity
By
–
The mathematical understanding of the model. It's extremely well characterised because everything's Gaussian. The mathematics of NNs is so complex that modern "ML experts" go on TV and tell everyone that "we don't understand how they work". We do understand how GPs work.
-
Understanding ML Expertise: Dismissing Alternative Approaches Due to Deployment Pressure
By
–
And its understandable that people who are in a rush to deploy these methods dismiss other ideas as cults or ineffective, because the breadth of what you need to know to be a true expert in ML is pretty intimidating.
-
Diversity of Views in Early Machine Learning Community
By
–
Have multiple views on the world often helps us understand. That was beauty of the early ML community a broad mix of views. Of course it’s unsurprising that when one method is successful people double down on it.
-
Gaussian Processes Simpler Mathematics Than Neural Networks
By
–
That’s helpful because GPs are mathematically much simpler than NNs (but algorithmically more complex for large data).
-
Gaussian Processes Explain Modern Neural Networks Generalization Behavior
By
–
GPs also give insights on why modern (very large) NNs behave like they do e.g the reason they generalise seems closer to non parametric approaches like GPs than traditional NN generalisation understanding from 1990s.
-
Chris’s Inspiration Expands GP Community Despite NN Growth
By
–
The point being that Chris inspired me (and many others). So he did his job. That means GP community today is larger than it’s ever been. It’s just that NN community grew even more. But both are GPs and NNs are successful.