A person is exposed to on the order of a billion words over their entire life through speech and reading. Modern large language models are fed hundreds of times that in the weeks of their training.
Language Models Trained on Vastly More Data Than Humans Encounter
By
–
Leave a Reply