The mathematical understanding of the model. It's extremely well characterised because everything's Gaussian. The mathematics of NNs is so complex that modern "ML experts" go on TV and tell everyone that "we don't understand how they work". We do understand how GPs work.
RESEARCH
-
Understanding ML Expertise: Dismissing Alternative Approaches Due to Deployment Pressure
By
–
And its understandable that people who are in a rush to deploy these methods dismiss other ideas as cults or ineffective, because the breadth of what you need to know to be a true expert in ML is pretty intimidating.
-
Diversity of Views in Early Machine Learning Community
By
–
Have multiple views on the world often helps us understand. That was beauty of the early ML community a broad mix of views. Of course it’s unsurprising that when one method is successful people double down on it.
-
Gaussian Processes Simpler Mathematics Than Neural Networks
By
–
That’s helpful because GPs are mathematically much simpler than NNs (but algorithmically more complex for large data).
-
Gaussian Processes Explain Modern Neural Networks Generalization Behavior
By
–
GPs also give insights on why modern (very large) NNs behave like they do e.g the reason they generalise seems closer to non parametric approaches like GPs than traditional NN generalisation understanding from 1990s.
-
Chris’s Inspiration Expands GP Community Despite NN Growth
By
–
The point being that Chris inspired me (and many others). So he did his job. That means GP community today is larger than it’s ever been. It’s just that NN community grew even more. But both are GPs and NNs are successful.
-
Specialized Knowledge: The Competitive Edge in AI Development
By
–
Specific knowledge.. knowing something so well that others don't know
-
ConvNet researcher’s luxury car versus Gaussian Process bicycle exit
By
–
The Convnet guy left the workshop in a Porsche whereas the GP guy left it on a bicycle. @bschoelkopf
-
Research Paper on Psychology and Linguistics Discussion
By
–
Link to PDF: https://
gwern.net/doc/psychology
/linguistics/2024-fedorenko.pdf
… Discussion: https://
news.ycombinator.com/item?id=407561
76
… -
Language as Communication Tool Rather Than Thought
By
–
Language is primarily a tool for communication rather than thought https://
nature.com/articles/s4158
6-024-07522-w
… “Language is a defining characteristic of our species, but the function, or functions, that it serves has been debated for centuries. Here we bring recent evidence from neuroscience and