Loads of models do that, because their training data included examples of text that included ChatGPT output Directly asking a model questions about itself remains a surprisingly ineffective way of learning anything useful about the model

→ View original post on X — @simonw,