5/ Best Practices and Lessons on Synthetic Data – an overview by Google DeepMind on synthetic data research, covering applications, challenges, and future directions
@dair_ai
-
CodeGemma: Open Code LLM Family Matching Performance Benchmarks
By
–
3/ CodeGemma – a family of open code LLMs based on Gemma; CodeGemma 7B models excel in mathematical reasoning and match the code capabilities of other open models.
-
OpenEQA Benchmark Dataset for Embodied Question Answering
By
–
2/ OpenEQA – proposes an open-vocabulary benchmark dataset to measure the capabilities of AI models to perform embodied question answering (EQA); it contains 1600 human-generated questions composed from 180 real-world environments.https://t.co/8OYcRgcyjH
— DAIR.AI (@dair_ai) 14 avril 20242/ OpenEQA – proposes an open-vocabulary benchmark dataset to measure the capabilities of AI models to perform embodied question answering (EQA); it contains 1600 human-generated questions composed from 180 real-world environments.
-
LLM2LLM: Iterative Data Augmentation Strategy for Model Fine-tuning
By
–
10). LLM2LLM – an iterative data augmentation strategy that leverages a teacher LLM to enhance a small seed dataset by augmenting additional data that can be used to effectively fine-tune models.
-
FollowIR Dataset Improves Information Retrieval Model Performance
By
–
9). FollowIR – a dataset with instruction evaluation benchmark and a separate set for teaching information retrieval model to follow real-world instructions; a FollowIR-7B model has significant improvements (over 13%) after fine-tuning on a training set.
-
AIOS: LLM Agent Operating System Integration Framework
By
–
8). AIOS – an LLM agent operation system that integrates LLMs into an OS as a brain; the agent can optimize resource allocation, context switching, enable concurrent execution of agents, tool service, and even maintain access control for agents.
-
Agent Lumos: Unified Framework for Training Open-Source LLM Agents
By
–
7). Agent Lumos – a unified framework for training open-source LLM-based agents; it consists of a modular architecture with a planning module that can learn subgoal generation and a module trained to translate them to action with tool usage.
-
Long-Form Factuality Evaluation in Large Language Models
By
–
6). Long-form factuality in LLMs – investigates long-form factuality in open-domain by generating a prompt set of questions including 38 topics; also proposes an LLM-based agent to perform evaluation for the task.
-
DBRX: New 132B Open-Source LLM Outperforms Benchmarks
By
–
1). DBRX – a new 132B parameter open LLM that outperforms all the established open-source models on common benchmarks like MMLU and GSM8K; DBRX was pretrained on 12T tokens (text and code) and uses a mixture-of-experts (MoE) architecture.
-
Top ML Papers of the Week: DBRX, Grok, LLM2LLM and More
By
–
The Top ML Papers of the Week (March 25 – March 31): – DBRX
– Grok-1.5
– LLM2LLM
– Mini-Gemini
– Agent Lumos
– Long-form factuality in LLMs
…