This is true of pre-trained models, and especially early instruction-tuned models, but less true in the RLHF/ChatGPT era. I think they said in the tech report GPT-4 is tuned not to pretend it’s human without disclaimers, excepting historical public figures.
Evolution of AI Model Tuning: From Pre-trained to RLHF and ChatGPT Eras
By
–