The moat math is brutal once you see it. A retrieval system plateaus at the quality of its extractor. As good on day 1,000 as day 1. And most of what it "knows" belongs to whichever lab hosts it. A learning system you control compounds every interaction into a corpus of (state
The Architectural Trade-off Between Retrieval and Learning Systems
By
–