this is just not right. you probably can’t train a good model with a batch size of 1. but you can if you use gradient accumulation, since it reduces noise
Gradient Accumulation Training Techniques for Machine Learning Models
By
–
By
–
this is just not right. you probably can’t train a good model with a batch size of 1. but you can if you use gradient accumulation, since it reduces noise