This is an important paper that demonstrates empirically something that folks like @goodside & I have been warning about. LLMs are easy to fool, and this paper shows that short token sequences are enough to alter the advice of AIs about what product to buy. SEO for AI is here
LLMS
-
Cohere Command R+ Achieves 111 Tokens Per Second
By
–
Cohere's Command R+ at 111 tokens/s 😲 https://t.co/swbaGtzsID
— Hugging Face (@huggingface) 12 avril 2024Cohere's Command R+ at 111 tokens/s
-
llm.c versus PyTorch: speed and simplicity comparison
By
–
…"in that llm.c will never be as fast nor as simple as pytorch"
-
Programming: Thinking Over Syntax, Outsourcing Thinking Fails
By
–
Programming is thinking + syntax. Maybe 90% thinking and 10% syntax. While you can automate away syntax, you can only ever outsource thinking to someone/something that can think. Attempts to outsource thinking to a syntax generator do not end well.
-
LangSmith Achieves SOC2 Type 1 Certification for LLM Development
By
–
We're excited to announce that LangSmith — our solution for LLM application development, monitoring, and testing — has now received SOC2 Type 1 Certification. After a rigorous audit process, LangSmith has been certified to conform to industry best-practices for the protection of
-
Python Interpreter Prompt Format for Mixtral 8x22B
By
–
This system uses the Python interpreter-style prompt format I describe in the article. It's flexible, and works well for most tasks. If you're building w/ Mixtral 8x22B, you NEED to try this.
-
Instruct Prompt to Base Model Converter Notebook
By
–
If you'd like to try it or contribute, check out the Github repo. Use the `Instruct_Prompt_>_Base_Model_Prompt_Converter.ipynb` notebook.
-
Open-source tool converts chat prompts for Mixtral base model
By
–
Introducing `instruct-to-base-prompt-converter` ✍️
— Matt Shumer (@mattshumer_) 12 avril 2024
Prompting base models like Mixtral 8x22B is insanely hard.
Now, AI can do it for you!
Uses Claude 3 Opus to automatically convert a chat prompt to a prompt that works with the Mixtral-8x22B base model!
And it's open-source! pic.twitter.com/rKAgkXxidnIntroducing `instruct-to-base-prompt-converter` Prompting base models like Mixtral 8x22B is insanely hard. Now, AI can do it for you! Uses Claude 3 Opus to automatically convert a chat prompt to a prompt that works with the Mixtral-8x22B base model! And it's open-source!
-
Claude 3 Prompt Engineering for Base Models Guide
By
–
This repo was inspired by this article I wrote, explaining how to prompt Mixtral 8x22B. Turns out, Claude 3 is quite good at prompting base models, if you set it up correctly.
-
Claude 3 Opus now available on Google Cloud Vertex AI
By
–
Claude 3 Opus, our most capable model for highly complex tasks, is now in public preview on @googlecloud
's Vertex AI. The addition of Opus means businesses can optimize intelligence, speed, and cost across the full Claude 3 model family. Get started: https://
cloud.google.com/vertex-ai