RLHF has gotten so good we no longer develop an intuition about how pre-trained LLMs behave. To the surviving flashes of old behavior we wrongly ascribe meaning — humanity, madness.
By
–
RLHF has gotten so good we no longer develop an intuition about how pre-trained LLMs behave. To the surviving flashes of old behavior we wrongly ascribe meaning — humanity, madness.