Mirrored here for resilience and googleability: https://
soumith.ch/posts/2023/12/
pytorch-design-origins/
…
RESEARCH
-
PyTorch Design Origins: Historical Context and Architecture
By
–
-
Hypothetical AI Harms Versus Current Realized Harms Imbalance
By
–
In AI, the ratio of attention on hypothetical, future, forms of harm to actual, current, realized forms of harm seems out of whack. Many of the hypothetical forms of harm, like AI "taking over", are based on highly questionable hypotheses about what technology that does not
-
PyTorch Origins: Clarifying Ryan’s Lab Software Attribution
By
–
I've given a full and comprehensive answer here, but the tl;dr for @roydanroy is that PyTorch did not start with a git clone from Ryan's lab's software.
-
PyTorch Origins: From Torch7 to Modern Deep Learning
By
–
PyTorch's design origins, its connection to Lua, its intertwined deep connection to JAX, its symbiotic connection to Chainer The groundwork for PyTorch originally started in early 2016, online, among a band of Torch7's contributors. Torch7 (~2010-2017)
These days, we also -
Real World Challenges: Why AI Differs from Code
By
–
Language/code are easy because they are discrete domains.
Code is particularly easy because the underlying "world" is fully observable and deterministic.
The real world is continuous, high-dimensional, partially observable, and non-deterministic: a perfect storm.
The ability of -
Nuclear Weapons vs AI: Understanding Design Intent Differences
By
–
Nuclear weapons are designed to wipe out entire cities.
AI is designed to amplify human intelligence.
See the difference? -
AI Safety Debate: Comparing Risks to Established Technologies
By
–
BS.
1. Turbojets actually enable the destruction of entire cities by bombing. Yet we still build turbojets.
2. There is exactly zero evidence that AI can ever cause the kind of destruction you allude to. -
Music Technology Group Models Enable Auto-Labeling for MusicGen
By
–
Yes, kind of. Music Technology Group has some good models: https://
replicate.com/mtg
classifiers, etc. @sake_min used those to put together a good auto labelling feature for our MusicGen fine-tuner (bpm, instruments, style, etc) -
PyTorch Autograd Implementation and Dynamic Graphs History
By
–
PyTorch eventually incorporated a reimplementation of autograd, but that didn't happen until some time after the beginning of the project.
IIRC, @ebetica was instrumental in incorporating autograd-like features in PyTorch, thereby enabling dynamic graphs. @soumithchintala can -
Burden of Proof in AI Safety Claims and Technology Risk
By
–
You are claiming something exists. As with Bertrand Russell's teapot, the burden of proof is on you.
So far, it's just been sci-fi, scary sci-fi, but sci-fi nonetheless. A technology is not unsafe merely because of the possibility of doing it wrong.
A technology is safe because