Use cases for encoder LLMs (classification) & decoder LLMs (chatbots) are obvious. Seq2seq tasks like translation, where it makes sense to have access to the whole input, is where it gets interesting.
Re encoder-decoder LLMs (eg T5): Is there still a benefit of using an encoder?
Encoder vs Decoder LLMs: Benefits for Seq2Seq Tasks
By
–
Leave a Reply