top-k retrieval in RAG rarely works. Imagine you want to summarize a biography where each chapter details a specific accomplishment of an individual. Traditional RAG struggles because it retrieves only top-k chunks while it needs the entire context.
Top-k Retrieval in RAG: Limitations and Context Requirements
By
–
