Here is an insanely useful Claude 3 prompt for engineers. Use it to automatically generate unit tests for your code: — You are an expert software tester tasked with thoroughly testing a given piece of code. Your goal is to generate a comprehensive set of
@mattshumer_
-
Full Fine-Tuning vs Other Methods: Overfitting Prevention
By
–
Not necessarily. Done right, full fine-tuning is usually better… my assumption for why this prevents overfitting is it’s not really affecting the parameters as much as a FT. Total speculation, I may be wrong.
-
LoRA QLoRA Fine-tuning Prevents Overfitting Better
By
–
While LoRA/QLoRA isn’t as powerful as full fine-tuning, it often can prevent overfitting from suboptimal tuning
-
Mistral 7B Extended Context Training and Dataset Improvements
By
–
On the model side, longer context length for the 7B! If you could train over the new Mistral 7B w/ 32K that’d be awesome. As for the dataset, I haven’t found many issues with it 🙂
-
Developer Credits Training Code Repository Contribution
By
–
I pulled the training code from one of my old notebooks from over a year ago, which was based on yours. I’m so sorry, I totally forgot where I got the training code from. Will absolutely add credit to the repo — love your work (esp. LazyMergeKit!!)
-
Claude-Investor Transformed Into Mobile App by Martin
By
–
Crazy… Martin turned Claude-Investor into an app! https://t.co/NXmuZpyUjN
— Matt Shumer (@mattshumer_) 27 mars 2024Crazy… Martin turned Claude-Investor into an app!
-
Community Platform Launches Digital Clone Feature at Lower Cost
By
–
Community with a digital clone and cheaper. https://t.co/ryw3mA1O82
— Matt Shumer (@mattshumer_) 27 mars 2024Community with a digital clone and cheaper.
-
Switch from Old OpenAI Version to New Claude Notebook
By
–
Seems like you're using the old OpenAI version — make sure you use the new Claude notebook!
-
System Control and Latency Cost Optimization in AI
By
–
Not always — often, it's more of a way to control the system more and cut latency/cost.
-
Train Fully Capable AI Models in Minutes
By
–
You can go from an idea to a fully trained model in a matter of minutes. And the resulting models are really capable!