If you're looking for inspiration, I have quite a long list of semi supervised learning tasks for computer vision, many of which have natural analogues in NLP. Here you go —> https://
fast.ai/posts/2020-01-
13-self_supervised.html
…

→ View original post on X — @jeremyphoward