It's possible but still kind of surprising considering that bedtime stories are already "ultra-safe." We know about the alignment tax, but I didn't expect it to make the model that much worse.
Alignment Tax Impact on AI Model Performance Surprises
By
–