In my experience, ChatGPT-4 exhibits an impressive ability to align with user intent. However, sometimes, when presented with explicit constraints (e.g. "use only the following characters: Arthur and his mom; DO NOT introduce any new characters"), the model seems to adhere to
ChatGPT-4 Alignment Challenges With Explicit User Constraints
By
–