I would consider Roberta-Large (see above) an LLM. But you are also welcome to swap that with decoder-style LLMs. I have a BLOOM (GPT-3 equivalent) example here:

→ View original post on X — @rasbt