Interesting point! Next to instruction-finetuning, finetuning is usually for a specific task (e.g., language translation). Not sure how well the model would do if you change source language. I.e., I haven't seen any studies investigating that, yet.

→ View original post on X — @rasbt,