There is this 2018 talk of Andrej Karpathy comparing his PhD time spent vs Tesla old days. PhD: sleep lost over massaging models and algorithms
Tesla(industry): sleep lost over massaging datasets In reality it is always about data and evals/your mechanism of evaluating the
Karpathy: PhD sleep lost over models, industry over datasets
By
–
