Multi Needle in a Haystack Benchmark RAG often isn't about just retrieving a fact, it's about retrieving multiple facts and reasoning over them We find that: Retrieval performance decreases with more needles
Reasoning over retrieved needles is harder than retrieving
Multi Needle Haystack: RAG Retrieval and Reasoning Challenges
By
–
