Codebases are programmatically ~easy to collate into a single file. The issue is that most information is (tragically) locked in formats that were intended for uniquely human consumption – web pages, PDF files, images, videos, audio, etc. pre-LLM era tech.

→ View original post on X — @karpathy,