AI is physics. As someone who has been working on AI+Science before it was considered even possible it is fulfilling to see the Nobel prize committee highlight the impact to scientific domains. We built the first high-resolution AI-based weather models with Neural Operators. It
RESEARCH
-
Bias Variance Not Same as Approximation Estimation
By
–
Bias/Variance is not the same as Approximation/Estimation https://
bit.ly/3Y5kDit
#AI #MachineLearning #DeepLearning #LLMs #DataScience -
Overnight Expert: From AI in 2013 to Physics in 2024
By
–
The prologue of the Atomic Human describes how on 2013-12-08, when @ylecun launched his Facebook lab I became an overnight expert in AI. My next book will open explaining how on 2024-10-08 I became an overnight expert in physics.
-
Self-citation and attention mechanisms in academic papers
By
–
It sure seems to say that to an awful lot of people (all the "lifetime of five cars" stuff). Perhaps more importantly, in 2022, in https://
arxiv.org/pdf/2206.05229, a paper you co-authored, the self-citation description of your own 2019 work says "Attention was first drawn to the -
Geoffrey Hinton Wins Nobel Prize in Physics for Deep Learning
By
–
Massive congratulations to my good friend and former Google colleague @geoffreyhinton on winning the Nobel Prize in Physics (with John Hopfield)! Incredibly well deserved, Geoff laid the foundations for the deep learning revolution that underpins the modern AI field.
-
Geoffrey Hinton Wins Nobel Prize for Deep Learning and AI
By
–
I was the first to call Geoff Hinton "Godfather of Deep Learning", which later became "Godfather of AI." Thrilled to see him win the Nobel prize together with John Hopfield for AI. Congrats @geoffreyhinton
! -
Meta Movie Gen: 13B Audio Generation Model for Video Synthesis
By
–
As part of Meta Movie Gen, we trained a 13B parameter audio generation model that can take a video + optional text prompts to generate high quality audio — including ambient sound, foley & instrumental background music — all synced to the video. Details https://
go.fb.me/vgkswc -
LLM360 releases TxT360: 15T token pre-training dataset
By
–
TxT360: new pre-training dataset with 15T tokens Impressive release from LLM360 with a new pre-training dataset of 15T tokens. It includes a lot of new sources compared to previous open-sourced pre-training datasets, like FreeLaw, PG-19 (books), etc. It's really interesting
-
Hinton: AI Safety Requires Young Researchers’ Urgent Attention
By
–
Hinton winning the Nobel Prize in Physics: "We should be working hard now to make sure that [AI] doesn't take control away from people. Because what we care about is people. The best young researchers should be putting a lot of effort into that now."
-
Nobel Prize in Physics 2024: Hopfield and Hinton Awarded
By
–
Nobel Prize in Physics 2024: Hopfield and Hinton — congratulations, and big AI news Quoting:
"I'm flabbergasted. I had no idea this would happen. I'm very surprised," said Hinton in a telephone call with members of the Royal Swedish Academy of Sciences bit.ly/4er0PvP [Translated from EN to English]→ View original post on X — @marktabnet, 2024-10-08 16:14 UTC