I actually talk about a "real" use case in my book. For synthetic data generation, I recommend checking distilabel by @argilla_io
OPEN SOURCE
-
Research Papers Optimizing vLLM Performance Further
By
–
A cool collection of research papers that build on top of vLLM and optimize it further:
-
Unsloth TRL Rewrite: Improved Performance for AI Model Training
By
–
Thanks Daniel! I originally had the entire code in classic TRL and decided to rewrite it with Unsloth two days ago. I don't regret it, it's super performant and convenient. Great work! 🙂
-
Integrating Hugging Face Papers into AI Research Workflows
By
–
would be cool to integrate with http://
huggingface.co/papers! -
Fine-tuning LLMs with TRL and Axolotl alternatives
By
–
In Unsloth? I don't know, I'm not part of the dev team. You can still fine-tune with TRL or Axolotl.
-
FineLlama-3.1-8B Model Deployment Issues on Hugging Face
By
–
I've also made a Hugging Face Space to chat with the FineLlama-3.1-8B model we build in the article.
— Maxime Labonne @ ICLR (@maximelabonne) 29 juillet 2024
The model looks good but the space tends to crash after one answer. I'm interested if you know how to fix it!
🤗 Space: https://t.co/6bDNLHShqh pic.twitter.com/PLjzajao0xI've also made a Hugging Face Space to chat with the FineLlama-3.1-8B model we build in the article. The model looks good but the space tends to crash after one answer. I'm interested if you know how to fix it! Space: https://
huggingface.co/spaces/mlabonn
e/FineLlama-3.1-8B
… -
FineTome-100k: High-Quality Filtered Dataset Release
By
–
I'm also releasing FineTome-100k, a refiltered subset of arcee-ai/The-Tome using fineweb-edu-classifier. It's super high-quality data, perfect when you need extra samples to concatenate with a dataset. FineTome: https://
huggingface.co/datasets/mlabo
nne/FineTome-100k
… -
Fine-tune Llama 3.1 Ultra-Efficiently with Unsloth
By
–
Fine-tune Llama 3.1 Ultra-Efficiently with @UnslothAI New comprehensive guide about supervised fine-tuning on @huggingface
. Over the last year, I've done a lot of fine-tuning and blogging. This guide brings it all together. Article: https://
huggingface.co/blog/mlabonne/
sft-llama3
… -
PEFT v0.12.0 Release: OLoRA, X-LoRA, FourierFT Methods
By
–
in case you missed it last week: peft v0.12.0 just dropped With some cool new param-efficient methods like OLoRA, X-LoRA, FourierFT, and more