That’s why I qualified “aligned” — GPT-4 base isn’t aligned (i.e. no instruct SFT or RLHF).

→ View original post on X — @goodside