AI Dynamics

Global AI News Aggregator

About

Researchers Jailbreak ChatGPT API by Accessing Hidden Token Probabilities

fun research story about how we jailbroke the the chatGPT API: so every time you run inference with a language model like GPT-whatever, the model outputs a full probabilities over its entire vocabulary (~50,000 tokens) but when you use their API, OpenAI hides all this info from

→ View original post on X — @jxmnop