Comme monsieur Jourdain qui faisait de la prose sans le savoir, je faisais de l'#autoGPT sans le savoir #prompt cf #seosquare avec @nguyen_nico #moliere de l'AI
PROMPT ENGINEERING
-
RLHF LLMs Challenge: Prompt Engineering Evil Characters
By
–
Yes, it’s challenging to make RLHF trained LLMs to act evil, e.g. if you want a psychopathic character to act and talk like one. What usually happen is that they talk like nice people, compliment, have empathy. But you can prompt engineer them to act closer to their intended
-
OpenAI ChatML Claims to Mitigate Injection Attacks
By
–
correct, although OpenAI does claim ChatML should help mitigate injections halfway down this page https://
github.com/openai/openai-
python/blob/main/chatml.md
… -
ChatML Format Helps Prevent Prompt Injection Attacks
By
–
yeah based on OpenAI's messaging, ChatML (which this system/user format is) is supposed to help against injections scroll halfway down this page https://
github.com/openai/openai-
python/blob/main/chatml.md
… -
System Prompts Replicated Word-for-Word Authenticity
By
–
real as they are replicated word-for-word, exactly as they are written in the system prompt
-
OpenAI’s ChatML messaging appears inconsistent with logical expectations
By
–
I agree that would seem logical but it does not seem like that is the message that is coming through in OpenAI's discourse about ChatML
-
GPT-4 System Prompt Revelation in Playground
By
–
yeah even if it is not the original Snapchat prompt, I do think it is interesting that GPT-4 revealed its system prompt in the playground that seems to be the main point here, would you agree?
-
System Prompt Leaks and GPT Model Vulnerabilities
By
–
this is not only applicable to GPT-4… GPT-4 is actually the best at countering these sorts of attacks if you can believe it, back before ChatML was introduced and when it was only GPT-3, it was even easier to leak the system prompt
-
MyAI Bot Prompt Recreation Demonstrated in OpenAI Playground
By
–
I got this prompt from someone who has done something similar to the actual MyAI bot I wrote them out in the OpenAI playground for demonstration purposes to prove how easy this actually is to do (the actual MyAI prompt may include more but again this is for demo purposes) https://
x.com/somewheresy/st
/somewheresy/status/1631696951413465088
… -
System Prompt Exposure: Security and Jailbreak Risks for LLM Integration
By
–
this poses a massive problem for customers who are wanting to integrate LLMs into their products exposing the system prompt not only hurts your perceived product security reputation but also makes it easier to jailbreak your product and produce undesirable outputs