ML/CV conference flooded. There's either a prophetic message in there, a good meme, or both!
MACHINE LEARNING
-
Fruit Fly Brain Fully Mapped After Decade of Research
By
–
After a Decade, Scientists Unveil Fly Brain in Stunning Detail https://
nytimes.com/2024/10/02/sci
ence/fruit-fly-brain-mapped.html?smid=tw-share
… -
Daily Research Bot: AI Discord Bot for Translation Research
By
–
Daily Research Bot an AI-powered Discord bot that helps you stay on top of new AI-related research, with a focus on low-resource language translation tasks. It summarizes recent papers from sources like Hugging Face and Elvis Saravia's blog, providing concise insights and
-
Applying AI Analysis Techniques to Research Papers
By
–
might be cool to do this with AI research papers:
-
Small Language Models: Survey, Measurements, and Insights
By
–
Small Language Models: Survey, Measurements, and Insights https://
bit.ly/3TO4v2o
#AI #MachineLearning #DeepLearning #LLMs #DataScience -
South Korean Print Media Company Fine-Tunes SLM Outperforming GPT-4o-mini
By
–
ICYMI: Check out our recent case study to learn how one of the largest print media companies in South Korea fine-tuned a #SLM from @Upstage on @predibase that is nearly 15% more accurate than fine-tuned #GPT-40-mini! https://
pbase.ai/3BEWhmT -
DDP versus FSDP2 model training strategy selection
By
–
DDP or FSDP2, depending on the type of model. If it can saturate compute with DDP, then that's simpler and already good. If not, FSDP2.
-
Optimizing AI Models with torch.compile and FSDP2
By
–
we spend a lot of time optimizing decently-sized models too.
For anything that is normal-sized (one node, 8 GPUs), torch.compile + FSDP2 should be largely sufficient to get to really good performance.
We've spent hundreds (or probably thousands) of programmer-years working on -
Handling Large Text Inputs with Longformer Transformers
By
–
How to Handle Large Text Inputs with Longformer and Hugging Face Transformers: Let’s learn how to handle large text inputs in the Large Language Model (LLM). Preparation Ensure you have the Transformers and datasets package from Hugging Face… https://
kdnuggets.com/how-to-handle-
large-text-inputs-with-longformer-and-hugging-face-transformers?utm_source=dlvr.it&utm_medium=twitter
… -
LLMs Generate More Novel Research Ideas Than Humans
By
–
Can LLMs Generate Novel Research Ideas? This paper from @StanfordAILab performs a human study with 100+ NLP researchers and discovers that LLM-generated ideas are more novel! Excited to have the authors @ChengleiSi @Diyi_Yang and @tatsu_hashimoto here to discuss their work!