8). Role of RAG Noise in LLMs – proposes a benchmark (NoiserBench) to measure how different kinds of noisy information affect RAG's performance; reports that from different kinds of beneficial noise studied (e.g., semantic, datatype, and illegal sentence), illegal sentence noise
RESEARCH
-
Beyond Human Preference: Reframing AI Alignment Challenges
By
–
9). Beyond Preference in AI Alignment – challenges the dominant practice of AI alignment known as human preference tuning; explains in what ways human preference tuning fails to capture the thick semantic content of human values; argues that AI alignment needs reframing, instead
-
LLM-Based Agents for Software Engineering: Comprehensive Survey
By
–
10). LLM-Based Agents for Software Engineering – a survey paper on LLM-based agents for software engineering, covering perspectives ranging from requirement engineering to test generation to software maintenance.
-
MemLong extends LLM context length using external retrieval
By
–
7). MemLong – utilizes an external retriever for retrieving historical information which enhances the capabilities of long-context LLMs; it consistently outperforms other SoTA LLMs on long-context benchmarks and can extend the context length on a single 3090 GPU from 4k up to
-
LongCite Improves Long-Context Question Answering With Citations
By
–
6). LongCite – synthesizes a large-scale SFT dataset with off-the-shelf LLMs to improve long-context question answering with citations; it trains 8B and 9B parameter models that enhance citation generation capabilities from lengthy contexts while improving response correctness;
-
Generative AI boosts developer productivity by 26 percent
By
–
4). Effective of AI on High Skilled Work – studies the impact of generative AI on software developers; reveals a 26.08% increase in the number of completed tasks among the developers that use AI tools like GitHub Copilot; also shows that less experienced developers are likely to
-
RAG Systems Address Long-Context LLM Focus Limitations
By
–
2). RAG in the Era of Long-Context LLMs – reports that longer-context LLMs suffer from a diminished focus on relevant information, which is one of the primary issues that a RAG system addresses (i.e., uses more relevant information); they propose an order-preserving RAG mechanism
-
Strategic Chain-of-Thought Refines LLM Performance by 21%
By
–
3). Strategic Chain-of-Thought – a method to refine LLM performance by incorporating strategic knowledge before the intermediate CoT reasoning steps; the problem-solving strategy helps to guide the generation of the CoT paths and final answers; claims to achieve a 21.05% increase
-
Knowledge Graphs Transform Business Decision-Making and Innovation
By
–
Harnessing the power of Knowledge Graphs allows businesses to unlock deep insights and enhance decision-making processes, driving innovation and efficiency across domains, which is essential for staying competitive in a data-driven world. Microblog @antgrasso #KnowledgeGraphs
-
Is MLX suitable for model fine-tuning tasks?
By
–
@awnihannun is this something MLX would be good for fine tuning?