I am not sure "OpenAI ran with it" is entirely correct. I remember there was quite some rivalry between Google's encoder approach and OpenAI's push for decoder-style models.
Google tried to make encoder-style models work for many years, since the original architecture.

→ View original post on X — @rasbt