It's incredible that anything we can formulate well, LLMs can learn it. There are thousands of "high-quality information sources that are yet to be llmfied". All along, it seems it has been more about "task formulation & data curation" than specific training techniques. On the
LLMs Learn Well-Formulated Information: Task Formulation Over Technique
By
–