Token smuggling/payload splitting ChatGPT appears to have some ability to detect malicious phrases in prompts and shut down its responses to get around this, you can split up the phrase into its tokens and ask GPT to piece it together and answer it in its response

→ View original post on X — @alexalbert__,