Usually stringing smaller prompt outputs together with code is better, but mega prompts are a close and easier second.
AI
-
Fine-tuning AI models in 10 minutes with Runpod
By
–
10 minutes? Pretty doable actually, if the data is ready. Spin up a Runpod machine. While that’s starting, upload dataset to huggingface. Then write a yaml for the run config (Axolotl) and upload to Gist. By that time the machine is ready. Run this command: pip uninstall -y
-
Good Prompts Prevent AI Model Failures Without Additional Safeguards
By
–
I’ve never tried it or had a need to. If you write good prompts, you don’t need to worry about the model going off the rails.
-
Axolotl and Mistral for Synthetic Data Generation
By
–
Axolotl. Fucking awesome. Shoutout to @winglian
. For synthetic data, Mistral models are great. Pair that with some real-world data for grounding/diversity/inspiration for good results. @csahil28 is building an even better solution here. Costs depend on the task at hand. Can be -
Fine-tuning Open-ended LLM Agents: Challenges and Personality Experiments
By
–
The most fun, but frustrating to do (due to data challenges) are open-ended agent fine-tunes. Easier ones are more chat/tool-use focused. A really fun one was experimenting with changing a LLM’s personality significantly. Made it “sassy” lol
-
Pre-training vs Fine-tuning: Learning Strategies in AI Models
By
–
When you’re pre-training, you basically learn from everything in the dataset. When fine-tuning, you often only want the model to learn from the text in the output, not the prompt itself.
-
LLM Prompting and Fine-tuning Questions and Answers
By
–
Ask me your LLM prompting/fine-tuning questions. Have an hour, will answer as many as I can.
-

The Little Book of Deep Learning by Kirk D. Borne
By
–
The Little Book of #DeepLearning
by @KirkDBorne Read more: https://
buff.ly/42dUTQa #ArtificialIntelligence #ML #MachineLearning cc: @ravikikan @yvesmulkers @pbalakrishnarao -
Upcoming open-source project launch announcement
By
–
May do this next week! Will open-source of course
-

Mistral 7B Improvements Enable Better Fine-Tuning Capabilities
By
–
This is huge news. Mistral 7B was already the best model in its size class, and these improvements are a huge step up. I’ll be re-training many of my current fine-tunes over this model ASAP.