My understanding is that @percyliang
's prefix tuning approach prepended activations to *every* layer, but yours only prepends to the first layer — is that right?
Prefix Tuning Approaches: Layer-wise Activation Prepending Comparison
By
–
By
–
My understanding is that @percyliang
's prefix tuning approach prepended activations to *every* layer, but yours only prepends to the first layer — is that right?