1. Many inductive biases aren’t curve-fitting (e.g., ILP, causal theories).
2. You can’t learn at any level without inductive biases.
3. We also call everything that doesn’t work “inductive biases”. ML is the search for the ones that do, in any form.
Inductive Biases in Machine Learning: Beyond Curve-Fitting
By
–