7). Toward Optimal Search and Retrieval for RAG – examines how retrieval affects performance in RAG pipelines for QA tasks; conducts experiments using BGE-base and ColBERT retrievers with LLaMA and Mistral, finding that including more gold (relevant) documents improves QA
LLMS
-
Defending LLMs Against Jailbreak Attacks with Few Examples
By
–
8). Mitigating LLM Jailbreaks with Few Examples – introduces a new approach called for defending LLMs against jailbreak attacks, focusing on quickly adapting defenses after detecting new attacks rather than aiming for perfect adversarial upfront robustness.
-
Test-Time Training Boosts LLM Abstract Reasoning on ARC
By
–
5). The Surprising Effectiveness of Test-Time Training for Abstract Reasoning – explores test-time training (TTT) – updating model parameters temporarily during inference – for improving an LLM's abstract reasoning capabilities using the ARC benchmark.
-
OpenCoder: Open-Source LLM for Code Generation
By
–
4). OpenCoder – introduces OpenCoder, a fully open-source LLM specialized for code generation and understanding; the authors identify several critical factors for building high-performing code LLMs: (1) effective data cleaning with code-optimized heuristic rules for
-
Precision-Aware Scaling Laws for Large Language Models
By
–
2). Scaling Laws for Precision – introduces "precision-aware" scaling laws that predict how model performance is affected by both training and inference precision in LLMs.
-
Evo: 7B DNA Sequence AI Model Processes 131 Kilobases
By
–
3). Evo – a 7B parameter AI model designed to understand and generate DNA sequences across multiple biological scales; the model, trained on 2.7 million prokaryotic and phage genomes, can process sequences up to 131 kilobases long while maintaining single-nucleotide resolution…
-
Top ML Papers of the Week: RAG, Transformers, and Optimization
By
–
The Top ML Papers of the Week (Nov 11 – 17): – HtmlRAG
– OpenCoder
– Mixture of Transformer
– A Taxonomy of AgentOps
– Scaling Laws for Precision
– Toward Optimal Search and Retrieval for RAG Read on for more: -
Magic Words Boost AI Chatbot Responsiveness and Performance
By
–
Charm Your Chatbot: Magic Words That Boost AI Responsiveness! https://
pymnts.com/artificial-int
elligence-2/2024/charm-your-chatbot-magic-words-that-boost-ai-responsiveness/
… #chatbot #AI #ArtificialInteligence #LLMs #LLM #GenAI #GenerativeAI #technology #TechRevolution #tech #Engineering -
Dynamic Section Retrieval Demo Notebook LlamaParse
By
–
Dynamic section retrieval, demo notebook: https://
github.com/run-llama/llam
a_parse/blob/main/examples/advanced_rag/dynamic_section_retrieval.ipynb
… -
Dynamic Section Retrieval Solves RAG Context Fragmentation Problem
By
–
Dynamic section retrieval solves a major pain point in RAG! We've all struggled with naive RAG techniques that return fragmented context without awareness of the surrounding document. It leaves us with disjointed chunks and incomplete information. But not anymore! @Llama_Index