7). Toward Optimal Search and Retrieval for RAG – examines how retrieval affects performance in RAG pipelines for QA tasks; conducts experiments using BGE-base and ColBERT retrievers with LLaMA and Mistral, finding that including more gold (relevant) documents improves QA
@dair_ai
-
Defending LLMs Against Jailbreak Attacks with Few Examples
By
–
8). Mitigating LLM Jailbreaks with Few Examples – introduces a new approach called for defending LLMs against jailbreak attacks, focusing on quickly adapting defenses after detecting new attacks rather than aiming for perfect adversarial upfront robustness.
-
Test-Time Training Boosts LLM Abstract Reasoning on ARC
By
–
5). The Surprising Effectiveness of Test-Time Training for Abstract Reasoning – explores test-time training (TTT) – updating model parameters temporarily during inference – for improving an LLM's abstract reasoning capabilities using the ARC benchmark.
-
OpenCoder: Open-Source LLM for Code Generation
By
–
4). OpenCoder – introduces OpenCoder, a fully open-source LLM specialized for code generation and understanding; the authors identify several critical factors for building high-performing code LLMs: (1) effective data cleaning with code-optimized heuristic rules for
-
AgentOps Taxonomy: Observability for Foundation Model-Based Agents
By
–
6). A Taxonomy of AgentOps for Enabling Observability of Foundation Model-based Agents – analyzes AgentOps platforms and tools, highlighting the need for comprehensive observability and traceability features to ensure reliability in foundation model-based autonomous agent systems
-
Evo: 7B DNA Sequence AI Model Processes 131 Kilobases
By
–
3). Evo – a 7B parameter AI model designed to understand and generate DNA sequences across multiple biological scales; the model, trained on 2.7 million prokaryotic and phage genomes, can process sequences up to 131 kilobases long while maintaining single-nucleotide resolution…
-
Precision-Aware Scaling Laws for Large Language Models
By
–
2). Scaling Laws for Precision – introduces "precision-aware" scaling laws that predict how model performance is affected by both training and inference precision in LLMs.
-
How Top Scientists Leverage AI for Innovation Success
By
–
1). Impacts of AI on Innovation – suggests that top scientists leverage their domain knowledge to prioritize promising AI suggestions, while others waste significant resources testing false positives…
-
Top ML Papers of the Week: RAG, Transformers, and Optimization
By
–
The Top ML Papers of the Week (Nov 11 – 17): – HtmlRAG
– OpenCoder
– Mixture of Transformer
– A Taxonomy of AgentOps
– Scaling Laws for Precision
– Toward Optimal Search and Retrieval for RAG Read on for more: -
Complete Prompt Engineering Curriculum for AI Agents and RAG Systems
By
–
Complete Prompt Engineering Curriculum Whether you are building an AI agent or complex RAG systems, prompt engineering is key to build effectively. There are lots of approaches out there but in our new LLM prompting courses, we teach you about the methods and best practices