Yes but no . This problem also exists with external vector databases as the ratio of relevant-to-irrelevant docs decreases with larger databases. I think the Focused Transformer paper looked into this: https://
arxiv.org/abs/2307.03170

→ View original post on X — @rasbt,