evidence for it in pre-training is just experiment 2 on celebrity parents — seems plausible but less clear than the SFT case imho. idk; LLMs generalize in pre-training in ways that become more impressive if reversal learning is known impossible so my prior is low
Pre-training evidence debated; reversal learning skepticism noted
By
–