The idea is that llms.txt is manually created/curated to have the exact info an LLM would find most useful. It's a bit of work to get right, but in my experience it's extremely helpful in practice (all our projects have carefully written llms.txt files).