some people are getting confused about the experiment – we didn't recover the base model's *weights*. that might not even be possible. we recovered the base model's *distribution*, with some error. an important question is how much. trying to figure that out right now…

→ View original post on X — @jxmnop,