If you are interested in learning more about fine-tuning models locally, consider following me. I will post a tutorial on how I did this fine-tuning, how I formatted the data, etc.
@skirano
-
Reddit Instruct Dataset Released for AI Research
By
–
Huge thanks to @teknium for their work and to @Euclaise_ for providing the dataset! https://
huggingface.co/datasets/eucla
ise/reddit-instruct-curated
… -
Model Trained Locally on M3 Max Over 9000 Iterations
By
–
This model was trained locally on M3 Max over 9k iterations. Link to the model
-
NousHermes-Mixtral-8x7B-Reddit: Fine-tuned LLM Model Released
By
–
Introducing NousHermes-Mixtral-8x7B-Reddit A fine-tune of the legendary model by @teknium on 10k Reddit threads. Including subreddits like:
– AskAcademia
– AskComputerScience
– AskEconomics
– ELI5 And many more! Optimized for MLX. -
ChatGPT Now Offers Dual Response Options via Direct RLHF
By
–
Wow, my ChatGPT now provides me with two options to choose from for the answer, and they were generated at the same time. OpenAI is doing RLHF directly in the chat now!
-
Customizing prompts with your own instructions
By
–
You can also rewrite some parts of this prompt into your custom instructions and change them to what you want.
-
DesignerGPT Hits 110K Users in First Month Post-Launch
By
–
According to @replit deployments, DesignerGPT had 110,449 unique visitors last month with an average of 16k new ones each week. These are pretty bonkers numbers for an app that just launched a month ago. Top country: USA, understandable since GPTs are a premium-only feature.
-
ChatGPT Image Generation Feature Awareness Gap
By
–
I truly believe people don’t know they can just generate images in ChatGPT on default.
-
Fine-tuning Language Models with Predefined Prompt Structures
By
–
Also, a question: When you fine-tune a model that had a predefined prompt structure, like, let's say, Mistral for instance with its [INST] Instruction [/INST] do you use that in the fine-tuning process too when you're feeding the new strings?