Even 100,000 tokens (or a million tokens) isn't enough for most of the things I'd want to use RAG for – I tried my blog's full archive with Gemini Pro 1.5 and it didn't fit into their million token window

→ View original post on X — @simonw,