On APIs, it’s hard but if you’re going after a specific use-case it just takes a bit of tinkering with the prompt. If not, just do a qLoRA with a couple hundred negative examples and you’re all set.
GENERATIVE AI
-
Prompt First: When to Fine-tune AI Models
By
–
Always, always try prompting first. The only time you should fine-tune is when you NEED to.
-
High-Quality Data Training for AI Models
By
–
Really good data with that style. You don’t need a ton of it (few hundred examples is totally fine), just make sure it’s really high-quality.
-
HyperWrite Internal Model A/B Testing in Production
By
–
Yes! One of our most recent internal HyperWrite models is trained for this. We’re currently A/B testing this in production, so if you’re lucky, you’ll get this! cc @JasonKuperberg more validation we should improve this 🙂
-
Good Prompts Prevent AI Model Failures Without Additional Safeguards
By
–
I’ve never tried it or had a need to. If you write good prompts, you don’t need to worry about the model going off the rails.
-
Axolotl and Mistral for Synthetic Data Generation
By
–
Axolotl. Fucking awesome. Shoutout to @winglian
. For synthetic data, Mistral models are great. Pair that with some real-world data for grounding/diversity/inspiration for good results. @csahil28 is building an even better solution here. Costs depend on the task at hand. Can be -
Fine-tuning Open-ended LLM Agents: Challenges and Personality Experiments
By
–
The most fun, but frustrating to do (due to data challenges) are open-ended agent fine-tunes. Easier ones are more chat/tool-use focused. A really fun one was experimenting with changing a LLM’s personality significantly. Made it “sassy” lol
-
Pre-training vs Fine-tuning: Learning Strategies in AI Models
By
–
When you’re pre-training, you basically learn from everything in the dataset. When fine-tuning, you often only want the model to learn from the text in the output, not the prompt itself.
-
LLM Prompting and Fine-tuning Questions and Answers
By
–
Ask me your LLM prompting/fine-tuning questions. Have an hour, will answer as many as I can.
-
Mistral 7B Improvements Enable Better Fine-Tuning Capabilities
By
–
This is huge news. Mistral 7B was already the best model in its size class, and these improvements are a huge step up. I’ll be re-training many of my current fine-tunes over this model ASAP.