8/ Teaching Arithmetics to Small Transformers – trains small transformers on chain-of-thought data to improve accuracy and convergence speed and highlights the importance of high-quality instructive data for rapidly eliciting arithmetic capabilities.
MACHINE LEARNING
-
LLMs as General Pattern Machines: In-Context Learning and Robotics
By
–
6/ LLMs as General Pattern Machines – shows that without any additional training, LLMs are general sequence modelers, driven by in-context learning; applies 0-shot capabilities to robotics and transfer the pattern among words to actions.
-
NaViT: Flexible Vision Transformer for Any Resolution
By
–
5/ Patch n’ Pack: NaViT – a vision transformer for any aspect ratio and resolution through sequence packing; enables flexible model usage, improved training efficiency, and transfers to tasks involving image and video classification among others.
-
Secrets of RLHF in LLMs: PPO Inner Workings Explained
By
–
3/ Secrets of RLHF in LLMs – takes a closer look at RLHF and explores the inner workings of PPO with code included.
-
LongLLaMA Extends Context Length via Contrastive Training
By
–
4/ LongLLaMA – employs a contrastive training process to enhance the structure of the (key, value) space to extend context length; presents a fine-tuned model that lengthens context and demonstrates improvements in long context tasks.
-
Neural Networks Exceed Expectations: Fundamental Ideas Validated
By
–
Success of neural nets relative to historical expectations is incredible. Something deeply correct about the underlying ideas.
-
Zero-1-to-3: Single Image to 3D Object Generation
By
–
Zero-1-to-3: Zero-shot One Image to 3D Object
— AK (@_akhaliq) 16 juillet 2023
github: https://t.co/2QCZ1apGdv
demo: https://t.co/Z92zQae2Zn
learn to control the camera perspective in large-scale diffusion models, enabling zero-shot novel view synthesis and 3D reconstruction from a single image pic.twitter.com/dJSBD2qXMYZero-1-to-3: Zero-shot One Image to 3D Object github: https://
github.com/cvlab-columbia
/zero123
…
demo: https://
huggingface.co/spaces/cvlab/z
ero123-live
… learn to control the camera perspective in large-scale diffusion models, enabling zero-shot novel view synthesis and 3D reconstruction from a single image -
MotherDuck: Simplifying Data Scaling and Management
By
–
MotherDuck: The Simple Joys of Scaling Up https://
bit.ly/41TGOqs #AI #MachineLearning #DeepLearning #LLMs #DataScience -
Data-Driven AI Barometer for Fragility Analysis Opportunity
By
–
An Opportunity For A Data-Driven AI-Barometer For Fragility Scrutiny
#AI #AIio #BigData #ML #NLU #Futureofwork @IIoT_World @ipfconline1 @jblefevre60 @JimMarous @insurtechtalk @KirkDBorne @kuriharan @LouisSerge http://
ow.ly/R19H30sw8C4 -
Artificial Intelligence Revolutionizes Drug Discovery Process
By
–
AI Takes On Drug Discovery
#AI #AIio #BigData #ML #NLU #Futureofwork @gp_pulipaka @stratorob @PetiotEric @EvanKirstel @Fgraillot @HaroldSinnott @HeinzVHoenen @helene_wpli http://
ow.ly/qaTk30sw8C3