2/ For one evaluation, MMLU (
https://
arxiv.org/abs/2009.03300), the community was surprised that the leaderboard numbers for the top model, LLaMA 65B, were significantly lower than the numbers in the published LLaMa paper: a 30% difference! We dived in a rabbit hole to understand
MACHINE LEARNING
-
LLaMA 65B MMLU Benchmark Discrepancy Analysis
By
–
-
Open LLM Leaderboard evaluation accuracy analysis findings
By
–
A on "what was going on with the Open LLM Leaderboard?" its numbers didn't match the ones reported in LLaMA paper so we dived in it and wrote a blog post of learnings! Here's the thread version for those of you who didn't want to read a blog post
-
PyTorch Bridge: Minimal Code Changes for Lightning and HF Integration
By
–
Good point. It's essentially a stepping stone between PyTorch and the Lightning Trainer or HF Trainer. Lots of people have existing PyTorch code bases and don't want to do a bigger restructure of their code. So, here, you really only need to change a few lines.
-
Gemini: DeepMind Combines Language Models with Reinforcement Learning
By
–
The next @deepmind algorithm, Gemini, may combine a powerful language model with cutting-edge reinforcement learning, perhaps helping with planning and memory. That's one thing I learned from a very interesting chat with @demishassabis recently.
-
Generative AI Technical Evolution: Key Innovations 2012-2022
By
–
Fair enough but Generative AI only really took off since 2020 with much of the technical innovation occurring from 2022 onwards (Chain of Thought 22, LoRA 21 but really adopted 22 and RLHF really took off in a big way 2022). The approaches in 2012 would not get us to LLMs. RNNs
-
Accelerating PyTorch Training with Mixed-Precision and Fully Sharded Data Parallelism
By
–
"Accelerating PyTorch Model Training Using Mixed-Precision and Fully Sharded Data Parallelism" https://
magazine.sebastianraschka.com/p/accelerating
-pytorch-model-training
… A little write-up of a talk I gave last week! -
Top AI Models and Datasets Weekly Trends Highlighted
By
–
Trending models, datasets, spaces and PAPERS (
https://
huggingface.co/Papers!!) of the week on http://
hf.co. Congrats to @TIIuae (falcon) @MosaicML (mpt) @StabilityAI (SDXl) @MetaAI (MusicGen) @MSFTResearch (Textbooks AAYN) @UMBaltimore (through your eyes) and many others! -
Intelligent Automation Newsletter #126: AI and Automation Updates
By
–
Intelligent Automation Newsletter #126 The latest news and insights on how Artificial Intelligence & Automation make our world more Human. Enjoy the read! #intelligentautomation
-
Handwritten Document Recognition Challenge for IDP Systems
By
–
There is one thing that even the most advanced Intelligent Document Processing tool will struggle to digest: a hand-written prescription from a doctor! Credit: Ralph Aboujaoude Diaz
#tech #automation #ai #ml #idp #data #icr #ocr #innovation -
Impact of Machine Learning on the US Economy in the Decade
By
–
True. Though I don't understand why he won't acknowledge the impact machine learning will have on the US economy in the next decade. Even if one doesn't believe in the "AGI hype", the impact of ML to the economy in the next 10 years is a trend that I wouldn't want to bet against.