9). Generative Agent Simulations of 1,000 People – introduces a new agent architecture that uses LLMs to create behavioral simulations of real individuals, achieving 85% accuracy in replicating human responses on the General Social Survey and reducing demographic biases compared
MACHINE LEARNING
-
TÜLU 3 releases state-of-the-art open post-trained models
By
–
8). TÜLU 3 – releases a family of fully-open state-of-the-art post-trained models, alongside its data, code, and training recipes, serving as a comprehensive guide for modern post-training techniques.
-
Qwen2.5 Achieves State-of-the-Art Math Reasoning Surpassing GPT-4o
By
–
5). High-Level Automated Reasoning – extends in-context learning through high-level automated reasoning; achieves state-of-the-art accuracy (79.6%) on the MATH benchmark with Qwen2.5-7B-Instruct, surpassing GPT-4o (76.6%) and Claude 3.5 (71.1%).
-
Star Attention: Efficient LLM Inference for Long Sequences
By
–
6). Star Attention: Efficient LLM Inference over Long Sequences – introduces Star Attention, a two-phase attention mechanism that processes long sequences by combining blockwise-local attention for context encoding with sequence-global attention for query processing and token
-
o1 Replication: Distillation and Fine-tuning for Math Reasoning
By
–
3). o1 Replication Journey – Part 2 – shows that combining simple distillation from o1's API with supervised fine-tuning significantly boosts performance on complex math reasoning tasks…
-
Instacart’s Machine Learning Approach to Out-of-Stock Product Replacements
By
–
How Instacart Uses Machine Learning to Suggest Replacements for Out-of-Stock Products https://
bit.ly/3Z34oSt
#AI #MachineLearning #DeepLearning #LLMs #DataScience -
Top 5 Years Unicorn Trends: Value Growth by Industry
By
–
Top 5 Years: # of Unicorns + Total Value + Predominant Industry 2021 457 Unicorns ~$1.4T #SaaS 2019 175 Unicorns ~$500B #AI 2018 151 Unicorns ~$300B #FinTech 2020 137 Unicorns ~$350B #HealthTech 2022 133 Unicorns ~$300B #Blockchain What's
-
Diffusion Models: Key Perspectives in Modern AI
By
–
Perspectives on diffusion https://
bit.ly/45nzZjn
#AI #MachineLearning #DeepLearning #LLMs #DataScience -
Complete Data Science Learning Resource Handbook Guide
By
–
GitHub – andresvourakis/data-scientist-handbook: This is a repo with links to everything you'd ever want to learn about data science https://
bit.ly/3N6nZvo
#AI #MachineLearning #DeepLearning #LLMs #DataScience -
Embedding Models in RAG Pipelines: Essential Guide
By
–
Good morning everyone! Today, we dive into an important part of the Retrieval-Augmented Generation (RAG) pipeline: the embedding model. All the data you have will be entered into embeddings, which we’ll then use to retrieve information. So, it’s quite important to understand