GPs also give insights on why modern (very large) NNs behave like they do e.g the reason they generalise seems closer to non parametric approaches like GPs than traditional NN generalisation understanding from 1990s.
Gaussian Processes Explain Modern Neural Networks Generalization Behavior
By
–