Sure. But you only get to do 60,000*20 model evals in total either way! (i.e if the 2nd order method needs twice as many evals, you only get 10 epochs)
Model Evaluation Trade-offs: Epochs versus Second-Order Methods
By
–
Global AI News Aggregator
By
–
Sure. But you only get to do 60,000*20 model evals in total either way! (i.e if the 2nd order method needs twice as many evals, you only get 10 epochs)
Leave a Reply