I think you really need a single box decoder only fine tuning task, since that’s a really common application. E.g qlora fine tune mistral on flan v2

→ View original post on X — @jeremyphoward