8/ CodeT5+ – supports a wide range of code understanding and generation tasks and different training methods to improve efficacy and computing efficiency; achieves SoTA on tasks like code completion, math programming, and text-to-code retrieval tasks.
AI
-
Symbol Tuning Boosts Language Models In-Context Learning Performance
By
–
9/ Symbol Tuning – an approach to finetune LMs on in-context input-label pairs where natural language labels are replaced by arbitrary symbols; boosts performance on unseen in-context learning tasks and algorithmic reasoning tasks.
-
TinyStories: Efficient Language Models for Story Generation
By
–
6/ TinyStories – uses a synthetic dataset of short stories to train and evaluate LMs that are much smaller than SoTA models but can produce fluent and consistent stories with several paragraphs, and demonstrate reasoning capabilities.
-
DoReMi: Domain-Weighted Resampling for Efficient Model Training
By
–
7/ DoReMi – trains a small proxy model over domains to produce domain weights without knowledge of downstream tasks; it resamples a dataset with the domain weights which allows using a 280M proxy model to train an 8B model (30x larger) more efficiently.
-
Drag Your GAN: Interactive Point-Based Image Control Method
By
–
1/ Drag Your GAN – an approach for controlling GANs that allows dragging points of the image to precisely reach target points in a user-interactive manner.https://t.co/Nbhtle5VRG
— DAIR.AI (@dair_ai) 21 mai 20231/ Drag Your GAN – an approach for controlling GANs that allows dragging points of the image to precisely reach target points in a user-interactive manner.
-
Top ML Papers of the Week: DragGAN, CodeT5+, Med-PaLM 2
By
–
Top ML Papers of the Week (May 15 – 21): – DragGAN
– CodeT5+
– StructGPT
– Med-PaLM 2
– Symbol Tuning
– Evidence of Meaning in LLMs
… -
AI-Generated Song ‘Heart on My Sleeve’ Goes Viral Online
By
–
AI-Generated Song Goes Viral: In a striking example of the capability of artificial intelligence to mimic real-life experiences, an AI-generated song titled “Heart on My Sleeve” has taken the internet by storm. Featuring what appears to be the voices of… https://
analyticsvidhya.com/blog/2023/04/a
i-generated-song-goes-viral/?utm_source=dlvr.it&utm_medium=twitter
… -
ML on Graphs: Solving Problems Traditional Methods Failed
By
–
That's a wrap! I build maps for a living, we have used ML on graphs to solve problems where traditional methods failed. Sharing these resources based on my experience!! Find me → @akshay_pachaar Everyday, I share tutorials around ML! Check one of my older threads
-
StellarGraph and PyTorch Geometric: ML Libraries for Graph Processing
By
–
StellarGraph | PyTorch Geometric Two of the best libraries to apply ML on graphs right away. Both have great documentation & example to get started! StellarGraph for TensorFlow folks https://
stellargraph.readthedocs.io/en/stable/ PyTorch Geometric for PyTorch folks https://
pytorch-geometric.readthedocs.io/en/latest/ -
Stanford CS224W: Machine Learning with Graphs Course
By
–
Stanford CS224W: Machine Learning with Graphs Offered by Stanford, a comprehensive course for ML on Graphs. Check this out https://
youtube.com/playlist?list=
PLoROMvodv4rPLKxIpqhjhPgdQy7imNkDn
…