Although the tasks above are well defined, the naturally occurring distribution of tasks in text turns out to be not well-defined. Here, I show that predicting the next word in a random sentence from Biden’s wikipedia page can include arbitrary tasks like comma prediction.

→ View original post on X — @_jasonwei,