The mathematical understanding of the model. It's extremely well characterised because everything's Gaussian. The mathematics of NNs is so complex that modern "ML experts" go on TV and tell everyone that "we don't understand how they work". We do understand how GPs work.
Gaussian Processes: Mathematical Clarity vs Neural Network Complexity
By
–