I did an undergrad thesis on parallel training of neural networks in 1990, then detoured through HIV/AIDS forecasting, compiler optimizations, information retrieval, distributed computation and storage systems before returning to large scale distributed training of neural
Distributed Neural Network Training: From 1990 to Large Scale
By
–