Glad you found it useful, and thanks for the kind words! I think you probably already read that, but there is a LoRA from-scratch tutorial in the last Appendix. There was a reader how also had some useful additional tips regarding LoRA:

→ View original post on X — @rasbt