We also provide example scripts for training and evaluation, for playing around with the Singular Value Finetuning (SVF) method introduced in Transformer² We hope this will be useful for researchers and developers interested in self-adaptive LLMs.

→ View original post on X — @sakanaailabs