Yeah there's plenty of lit on model merging in general, and IIRC it's always looking at fine-tunes from a common base — but I've not seen any papers about increasing layer counts like this.
Model Merging and Layer Count Expansion Research
By
–
By
–
Yeah there's plenty of lit on model merging in general, and IIRC it's always looking at fine-tunes from a common base — but I've not seen any papers about increasing layer counts like this.