One trick to making ML progress is repeatedly increasing the precision of the engineering and decreasing the number of mysteries being papered over — i.e. just focusing on improving your understanding of the system you're working with.
Precision Engineering: Key to ML Progress and System Understanding
By
–