Tianqi, you and I should probably compile a "History of Deep Learning Software" for fun 🙂
it'll be a mini-book, if only for us to keep in our library.
CODE
-
History of Deep Learning Software: A Mini-Book Project
By
–
-
PyTorch Design Origins: Historical Context and Architecture
By
–
Mirrored here for resilience and googleability: https://
soumith.ch/posts/2023/12/
pytorch-design-origins/
… -
PyTorch Autograd Framework References and THNN Refactoring
By
–
More References:
6. torch-autograd: https://
github.com/twitter-archiv
e/torch-autograd
… 7. HIPS/Autograd: https://
github.com/HIPS/autograd
8. THNN refactors: * https://
github.com/torch/nn/pulls
?q=ispr+isclosed+THNN
… * https://
github.com/torch/cunn/pul
ls?q=ispr+isclosed+THCUNN
…
9. Online chat where the THNN organization happened: https://
app.gitter.im/#/room/#apaszk
e_THNN:gitter.im
… -
PyTorch Origins: Clarifying Ryan’s Lab Software Attribution
By
–
I've given a full and comprehensive answer here, but the tl;dr for @roydanroy is that PyTorch did not start with a git clone from Ryan's lab's software.
-
Clarifying PyTorch Origins: A Historical Deep Dive
By
–
this post was inspired by this thread that I was tagged into asking to (yet again) to clarify some details about the origins of PyTorch 🙂
-
PyTorch Origins: From Torch7 to Modern Deep Learning
By
–
PyTorch's design origins, its connection to Lua, its intertwined deep connection to JAX, its symbiotic connection to Chainer The groundwork for PyTorch originally started in early 2016, online, among a band of Torch7's contributors. Torch7 (~2010-2017)
These days, we also -
Music Technology Group Models Enable Auto-Labeling for MusicGen
By
–
Yes, kind of. Music Technology Group has some good models: https://
replicate.com/mtg
classifiers, etc. @sake_min used those to put together a good auto labelling feature for our MusicGen fine-tuner (bpm, instruments, style, etc) -
PyTorch Autograd Implementation and Dynamic Graphs History
By
–
PyTorch eventually incorporated a reimplementation of autograd, but that didn't happen until some time after the beginning of the project.
IIRC, @ebetica was instrumental in incorporating autograd-like features in PyTorch, thereby enabling dynamic graphs. @soumithchintala can -
Advanced RAG Pipeline Built from Scratch with LLMs
By
–
GitHub – pchunduri6/rag-demystified: An LLM-powered advanced RAG pipeline built from scratch https://
bit.ly/3GxmS4M
#AI #MachineLearning #DeepLearning #LLMs #DataScience