i fondly recall arguing in 2019 with another researcher about how whether models understand negation. this really was a major sticking point at the time, GPT-2 couldn't reliably distinguish between "I did like that" and "I didn't like that". at some point we fully blew by the
GPT-2 Negation Understanding: From 2019 Struggles to Modern Progress
By
–