Mirrored here for resilience and googleability: https://
soumith.ch/posts/2023/12/
pytorch-design-origins/
…
OPEN SOURCE
-
PyTorch Design Origins: Historical Context and Architecture
By
–
-
PyTorch Autograd Framework References and THNN Refactoring
By
–
More References:
6. torch-autograd: https://
github.com/twitter-archiv
e/torch-autograd
… 7. HIPS/Autograd: https://
github.com/HIPS/autograd
8. THNN refactors: * https://
github.com/torch/nn/pulls
?q=ispr+isclosed+THNN
… * https://
github.com/torch/cunn/pul
ls?q=ispr+isclosed+THCUNN
…
9. Online chat where the THNN organization happened: https://
app.gitter.im/#/room/#apaszk
e_THNN:gitter.im
… -
PyTorch Origins: Clarifying Ryan’s Lab Software Attribution
By
–
I've given a full and comprehensive answer here, but the tl;dr for @roydanroy is that PyTorch did not start with a git clone from Ryan's lab's software.
-
Clarifying PyTorch Origins: A Historical Deep Dive
By
–
this post was inspired by this thread that I was tagged into asking to (yet again) to clarify some details about the origins of PyTorch 🙂
-
PyTorch Origins: From Torch7 to Modern Deep Learning
By
–
PyTorch's design origins, its connection to Lua, its intertwined deep connection to JAX, its symbiotic connection to Chainer The groundwork for PyTorch originally started in early 2016, online, among a band of Torch7's contributors. Torch7 (~2010-2017)
These days, we also -
Music Technology Group Models Enable Auto-Labeling for MusicGen
By
–
Yes, kind of. Music Technology Group has some good models: https://
replicate.com/mtg
classifiers, etc. @sake_min used those to put together a good auto labelling feature for our MusicGen fine-tuner (bpm, instruments, style, etc) -
PyTorch Autograd Implementation and Dynamic Graphs History
By
–
PyTorch eventually incorporated a reimplementation of autograd, but that didn't happen until some time after the beginning of the project.
IIRC, @ebetica was instrumental in incorporating autograd-like features in PyTorch, thereby enabling dynamic graphs. @soumithchintala can -
Advanced RAG Pipeline Built from Scratch with LLMs
By
–
GitHub – pchunduri6/rag-demystified: An LLM-powered advanced RAG pipeline built from scratch https://
bit.ly/3GxmS4M
#AI #MachineLearning #DeepLearning #LLMs #DataScience -
Best Performing LLMs Compared on Hugging Face
By
–
They are also frequently the best performing LLMs it seems on hugging face https://
reddit.com/r/LocalLLaMA/c
omments/17fhp9k/huge_llm_comparisontest_39_models_tested_7b70b/
… -
LangChain Ecosystem Expands with Major Component Updates
By
–
LangChain Ecosystem Update (by @CobusGreylingZA
) We've made a lot of changes to the LangChain ecosystem – but don't just take our word for it @CobusGreylingZA wrote a great writeup of what's changed and what all the different components are Blog: https://
cobusgreyling.medium.com/the-langchain-
ecosystem-is-expanding-at-a-tremendous-pace-135756e162e9
…