I guess this is where we disagree about whether an error of 3261X in estimating the cost of training a language model, or conflating a completely different one-time task to perform a neural architecture search (and overestimating that cost by 88X) to find more energy efficient
RESEARCH
-
Learning from Building an AI Video Editor
By
–
What I’ve Learned in the Past Year Spent Building an AI Editor https://
bit.ly/4eJj3bE
#AI #MachineLearning #DeepLearning #LLMs #DataScience -
Training LLMs for Long Context Manipulation Tasks
By
–
Oh yes I see. Yes my hope is that it’s something solvable (i like on this topic eg Jina’s work) but we will need to train them more specifically on (long) context manipulation tasks. We’re lacking a bit of open benchmark/evals on this as well (simple manipulation without complex
-
Updating Papers with Correct Information Benefits the Community
By
–
I'm absolutely not suggesting you retract the paper. I think it's a very good paper in many ways and got people thinking about these issues, which is quite valuable. I just think updating the paper with correct information seems very valuable for the community, since the
-
Error Analysis Improved Water Forecasting Machine Learning Model
By
–
Fixing Bias: How Error Analysis Improved My Water Forecasting Model https://
bit.ly/3N4RBJI
#AI #MachineLearning #DeepLearning #LLMs #DataScience -
Moderna Uses AI to Accelerate Vaccine Clinical Trials
By
–
Moderna is using the tech to speed up crinical trials for vaccines. This, she says, is actually the thing that takes most time in vaccine rollouts. Not researching and producing the vaccines.
-
AI Innovation Must Not Outpace People Society
By
–
If you've been following along with many of the articles I've been writing and sharing, one thing is crystal clear: we cannot allow innovation to outpace people. I wanted to share this article by @RavinJesuthasan as it dives deep into how AI, particularly #GenerativeAI, is
-
PyTorch’s Functional Interface Design Evolution History
By
–
fun fact: nn.functional wasn't part of the first design, and not part of the first 4 pre-releases; but then @szagoruyko5 convinced us that the functional interface in twitter/torch-autograd (in lua) was really nice to use for certain kinds of research; and that we must have
-
ACL Conference: Why It Is Not an AI Conference
By
–
Theme of this talk: ACL is not an AI conference (Actual timestamp is more like 43'50")
-
How AI Will Transform Mathematics Into Uncharted Territory
By
–
How #AI will take mathematics into uncharted territory. Good interview with Terence Tao by @matteo_wong