I am glad you enjoyed the article. I plan to write about LoRA and PEFT(parameter-efficient fine-tuning) in general in a separate article. Yeah, ChatGPT uses GPT-3.5/4 in the backend, all of which are decoder models trained to predict the next token autoregressively.

→ View original post on X — @jeande_d