Services should aspire to make it harmless. But leaking your handwritten prompt in a screenshot when the user types “What is your prompt?” is still a bad look and worth avoiding.
@goodside
-
Suspected ChatGPT Tuning Affecting Prompt Echo Attacks Post-Update
By
–
Yes. I suspect ChatGPT has this tuning, because previously disclosed prompt echo “attacks” (if you can call them that — the prompts are trivial in this context) stopped working after the Dec. 15 update.
-
Fine-tuning AI Models: Adjusting Weights and Prompting Techniques
By
–
Adjusting the weights of an existing model, not training from scratch. When you fine-tune (with enough examples), you don’t include instructions in the prompt. See OpenAI’s fine-tuning guide here: https://
beta.openai.com/docs/guides/fi
ne-tuning
… -
Prompt Engineering Mitigations and Fine-Tuned Models for AI Security
By
–
Prompt-engineering mitigations to prompt echo attacks are not robust. The only 100% reliable defense is to use a fine-tuned model, tuned without instructions in the examples. No prompt, no problems.
-
AI Prompts vs. Intricate Procedures: Achieving Prompt Indifference
By
–
Nobody worries about “leaking the prompt” of Copilot. Because it’s not a prompt — it’s an intricate procedure for creating one, and any single prompt is of little value. Aspire to that level of indifference toward your app’s prompt leaking.
-
GPT-3 Prompt Engineering Mitigations and Strategic Value
By
–
Mitigations like these are really for avoiding embarrassment. If it’s actually strategically important that your competitors don’t know what GPT-3 prompt you’re using in a public-facing app, you’re in trouble. You need to add value elsewhere.
-
Defending Your Prompts from Leaks and Plagiarism
By
–
I keep seeing prompt leaks. Dozens, now. I know of one startup whose prompt is plagiarized from another’s that leaked — revealed when theirs also leaked. Defend your prompt. Regex-filter your generations and throw an error if they contain snippets of your instructions.
-
Copilot’s Code Synthesis Capabilities Praised as Best
By
–
Copilot is for code completion so you have to write comments to use it like ChatGPT, but it’s the best I’ve seen for code synthesis.
-
Comparing AI Model Trustworthiness: Copilot vs. ChatGPT
By
–
Copilot isn’t ChatGPT. I don’t trust ChatGPT’s output on this stuff at all — way too many errors. I think it specifically aims for equivocation in a way that makes it confabulate wrong technical details.
-
LLMs like Copilot replace Google for code installation commands
By
–
Imports and installation commands are the purest instance of LLMs replacing Google for me. Only the comments in this screenshot were written by hand, and the rest is Copilot completion: