My reaction too when reading all the RAG is dead tweets earlier today. Huge amount of optimism that the context window is also usable in practice for real problem solving and not just in theory. Could very well be true I just don’t super know.

→ View original post on X — @karpathy