"SolidGoldMagikarp": Prompting GPT-3 / ChatGPT to repeat any of several hundred anomalous tokens elicits bizarre generations — described by researchers as variously "evasive," "hallucinatory," "insulting," "ominously humorous," and "religiously themed." https://
lesswrong.com/posts/aPeJE8bS
o6rAFoLqg/solidgoldmagikarp-plus-prompt-generation
…