Having a known place you can get that information for a given URL, rather than having to create it from scratch yourself, is rather convenient. E.g if you tell Claude Code about the claude llms.txt, it's way faster and more token efficient at getting info about how it works.
Standard Configuration Files Improve LLM Efficiency and Token Usage
By
–