In the 90s I had to first implement matrix classes before I could even start coding neural nets – it was awful! I suffered so much with BPTT! Matlab did make things more efficient and was great until Python arrived. Leon Bottou and Yann Lecun pioneered SGD and torch style

→ View original post on X — @nandodf,