There have been a bunch of research/demo attacks, but I haven't seen a real-world malicious attack that caused actual damage yet – beyond producing embarrassing screenshots or leaking system prompts
AI
-
51 Posts on Prompt Injection: Complete Collection
By
–
Here are all 51 of my posts on prompt injection so far – love having tags on my blog!
-
Streaming API Usage JSON Bug Report and Feature Request
By
–
That's great, thanks! I'll continue to hold out on my dream for daily spending limits – I may have to implement that myself, though it would be easier if you fix the bug where streaming responses don't get valid "usage" JSON blocks
-
Fine-tuned Models Still Vulnerable to Adversarial Attacks
By
–
TLDR version: the fine-tuned model they describe improves things, but I still don't think "improves" is good enough If you are facing an adversarial attacker then reducing the chance that they might find an exploit just means they’ll try harder until they find one that works
-

OpenAI releases detailed prompt injection evaluation paper
By
–
New paper from @OpenAI on prompt injection – it's the most detailed evaluation of the problem I've seen from them so far, and has some very interesting details Posted some of my notes on the paper on my log here: https://
simonwillison.net/2024/Apr/23/th
e-instruction-hierarchy/
… -
Experimenting with thinking in other languages for AI research
By
–
Thinking in other languages is a fascinating idea. I want to experiment with that. Very clever.
-

ChatGPT struggles with complex visual scene generation
By
–
ChatGPT struggles a bit:
"Visual Elements: Towering trees, a dimly lit path splitting into two, fading dusk light, shadows moving slightly with the wind." Its code drew this (to be fair, I think it "wanted" the tress to be vertical cones) -

Claude 3 Fantasy Game with p5js 3D Animation Scenes
By
–
"Claude 3, we are going to play a fantasy game. you are the dungeon master. you will give me a scenario and illustrate each scene with a p5js 3D animation I can just paste right into an editor…."
— Ethan Mollick (@emollick) 23 avril 2024
Claude: "You soon find yourself in a circular grove, surrounded by ancient trees" pic.twitter.com/MMkUNGu6vy"Claude 3, we are going to play a fantasy game. you are the dungeon master. you will give me a scenario and illustrate each scene with a p5js 3D animation I can just paste right into an editor…." Claude: "You soon find yourself in a circular grove, surrounded by ancient trees"
-
Larger Models Required for Quality Content Creation
By
–
For content creation specifically we need that magic that only comes from bigger models
-
Fine-tuning vs RAG: Choosing the Right Approach
By
–
If you get that working I'd love to hear about it! I've been mostly put off fine-tuning for this kind of thing because RAG feels easier to get results out of