Is RAG Really Dead? Testing the retrieval limits of long context LLMs RAG systems often retrieve multiple docs relevant to a user input and reason over them to return an answer. How well can long context LLMs do this across hundreds or thousands of pages of input tokens?