That's great news! Have you tested it with peft *and* deepspeed zero3 together? If you, could you provide a complete example showing how to make that work?
OPEN SOURCE
-
Llama 2 LLMs Now Available on Databricks Marketplace
By
–
Llama 2 #GenAI models are now available on Databricks Marketplace! Enjoy access to Llama 2’s chat-oriented #LLMs with centralized governance and lineage tracking, easily usable through MLflow. Deploy it on LLM-optimized GPU endpoints in just one click
-
Fine-tuning Open-Source LLMs: Best Practices and Live Demo
By
–
When should you fine-tune an open-source LLM? and what's the best way to do it? Last chance to save your spot for our webinar this Thursday during which we'll cover all things fine-tuning including a live demo. Don't miss it! https://
pbase.ai/48KpA3H -
Acquia Migrate Accelerate becomes open source
By
–
Start spreading the news! @acquia Migrate: Accelerate (created by the awesome @webchick
) is now open source! Thanks for the write-up, @wimleers https://
dev.acquia.com/blog/acquia-mi
grate-accelerate-now-open-source
… #drupal #opensource -
Open-source Plans for AI Project Under Consideration
By
–
Thank Clement! We don't have an open-source plan for now, but we'll keep your interest in mind for future updates.
-
Transformers Library Bug Breaks Training Arguments in Latest Version
By
–
FYI I think the latest Transformers from main might have broken this, since I get
“` File "transformers/src/transformers/training_args.py", line 1513, in __post_init__ if self.half_precision_backend != "apex" and len(self.sharded_ddp) == 0:
TypeError: object of type 'bool' -
Open Source Research Servers and Ex-OpenAI Contributors
By
–
Depends what you're looking for. Each group of open source research projects has a separate server. There are ex-OAI people on them, but haven't seen a current-OAI person on any frankly…
-
Try LLaVA chatbot, free open source alternative to GPT-4V
By
–
Don’t have access to GPT-4V yet? Try LLaVA chatbot, a free open source model hosted on HuggingFace: http://
llava.hliu.cc -
Zoofs: Nature-Inspired Feature Selection Python Library
By
–
zoofs is a python library for performing feature selection using a variety of nature-inspired wrapper algorithms. From swarm-intelligence to physics-based to Evolutionary. https://
bit.ly/3F31Om1 #AI #MachineLearning #DeepLearning #LLMs #DataScience