This was purely based on shower-thoughts :D.
As someone called out, autoencoders would have been a good addition after LoRA.

→ View original post on X — @rasbt