Yes, you can run prompts like this: llm -m Meta-Llama-3-8B-Instruct -o temp 0.1 "3 names for a pet rhino" https://
github.com/simonw/llm-gpt
4all?tab=readme-ov-file#model-options
…
CODE
-
Running Meta-Llama-3-8B-Instruct with LLM CLI Tool
By
–
-
Data contamination detection script for training datasets
By
–
Just provide a script that will produce a number from 0 to 1 to be run on your training data on how contaminated it is. Everyone runs it and reports it as the first column of results.
-
51 Posts on Prompt Injection: Complete Collection
By
–
Here are all 51 of my posts on prompt injection so far – love having tags on my blog!
-
Streaming API Usage JSON Bug Report and Feature Request
By
–
That's great, thanks! I'll continue to hold out on my dream for daily spending limits – I may have to implement that myself, though it would be easier if you fix the bug where streaming responses don't get valid "usage" JSON blocks
-
OpenAI releases detailed prompt injection evaluation paper
By
–
New paper from @OpenAI on prompt injection – it's the most detailed evaluation of the problem I've seen from them so far, and has some very interesting details Posted some of my notes on the paper on my log here: https://
simonwillison.net/2024/Apr/23/th
e-instruction-hierarchy/
… -
ChatGPT struggles with complex visual scene generation
By
–
ChatGPT struggles a bit:
"Visual Elements: Towering trees, a dimly lit path splitting into two, fading dusk light, shadows moving slightly with the wind." Its code drew this (to be fair, I think it "wanted" the tress to be vertical cones) -
Claude 3 Fantasy Game with p5js 3D Animation Scenes
By
–
"Claude 3, we are going to play a fantasy game. you are the dungeon master. you will give me a scenario and illustrate each scene with a p5js 3D animation I can just paste right into an editor…."
— Ethan Mollick (@emollick) 23 avril 2024
Claude: "You soon find yourself in a circular grove, surrounded by ancient trees" pic.twitter.com/MMkUNGu6vy"Claude 3, we are going to play a fantasy game. you are the dungeon master. you will give me a scenario and illustrate each scene with a p5js 3D animation I can just paste right into an editor…." Claude: "You soon find yourself in a circular grove, surrounded by ancient trees"
-
Fine-tuning vs RAG: Choosing the Right Approach
By
–
If you get that working I'd love to hear about it! I've been mostly put off fine-tuning for this kind of thing because RAG feels easier to get results out of
-
Fine-tuning vs RAG: Best Practices for Model Knowledge
By
–
Not that I've seen yet, but you probably don't want to do that – as a general rule fine-tuning on a small number of documents isn't an effective way to "add knowledge" to a model – you should look at implementing RAG instead Some notes on that here:
-
Implementation Discovery of Speed Enhancement Through EvoSDXL-JP Model Merging
By
–
Wow, this is amazing! I tried to download a model from HuggingFace and run it, but CUDA ran out of memory. That's odd, so I looked at the contents of the .py file and found that it appears to be implemented as "Download 4 ingredient models and merge synthesize EvoSDXL-JP on your end"…! So you can actually achieve speed enhancement just by merging…! x.com/iwiwi/status/1…