I haven’t been using it for deep coding as I am not coder, but it builds cool little working websites and tools for me all the time. It is slow, but I find it quite capable, if limited by GPT-4 brains.
PROMPT ENGINEERING
-
Suggestion to try Gemini with Twitter integration magic
By
–
throw it into gemini maybe 🙂 cc @altryne who has some twitter ripping magic
-
LLM as Ultimate Compiler: From Pseudocode to Execution
By
–
Fair 🙂 I love the idea of an LLM as the ultimate compiler. Humans only write something like Python code, but even then it's just the prompt to get the idea across. So it's more like psuedocode and doesn't even have to be valid Python. Actually I already do this once in a while
-

LLMs Vulnerable to Short Token Sequences Manipulation Study
By
–
This is an important paper that demonstrates empirically something that folks like @goodside & I have been warning about. LLMs are easy to fool, and this paper shows that short token sequences are enough to alter the advice of AIs about what product to buy. SEO for AI is here
-
Programming: Thinking Over Syntax, Outsourcing Thinking Fails
By
–
Programming is thinking + syntax. Maybe 90% thinking and 10% syntax. While you can automate away syntax, you can only ever outsource thinking to someone/something that can think. Attempts to outsource thinking to a syntax generator do not end well.
-

Python Interpreter Prompt Format for Mixtral 8x22B
By
–
This system uses the Python interpreter-style prompt format I describe in the article. It's flexible, and works well for most tasks. If you're building w/ Mixtral 8x22B, you NEED to try this.
-
Instruct Prompt to Base Model Converter Notebook
By
–
If you'd like to try it or contribute, check out the Github repo. Use the `Instruct_Prompt_>_Base_Model_Prompt_Converter.ipynb` notebook.
-
Open-source tool converts chat prompts for Mixtral base model
By
–
Introducing `instruct-to-base-prompt-converter` ✍️
— Matt Shumer (@mattshumer_) 12 avril 2024
Prompting base models like Mixtral 8x22B is insanely hard.
Now, AI can do it for you!
Uses Claude 3 Opus to automatically convert a chat prompt to a prompt that works with the Mixtral-8x22B base model!
And it's open-source! pic.twitter.com/rKAgkXxidnIntroducing `instruct-to-base-prompt-converter` Prompting base models like Mixtral 8x22B is insanely hard. Now, AI can do it for you! Uses Claude 3 Opus to automatically convert a chat prompt to a prompt that works with the Mixtral-8x22B base model! And it's open-source!
-
Claude 3 Prompt Engineering for Base Models Guide
By
–
This repo was inspired by this article I wrote, explaining how to prompt Mixtral 8x22B. Turns out, Claude 3 is quite good at prompting base models, if you set it up correctly.
-

Fine-tuning Open Source LLMs to Outperform GPT-4
By
–
There's a common belief that #opensource LLMs aren't as performant as #GPT4. Well, oftentimes they're not… unless you #finetune! Join our upcoming virtual workshop to learn how you can fine-tune OSS #LLMs to outperform GPT-4: https://
pbase.ai/3xAPXuV