Full repo: https://
github.com/dvmazur/mixtra
l-offloading/tree/master?tab=readme-ov-file
…
OPEN SOURCE
-
Mixtral Offloading Repository Release and Documentation
By
–
-
Fast Inference of Mixture-of-Experts Models via Offloading
By
–
6/ Fast Inference of Mixture-of-Experts – achieves efficient inference of Mixtral-8x7B models through offloading; designs a MoE-specific offloading strategy that enables running Mixtral-8x7B on desktop hardware and free-tier Google Colab instances.
-
LLaMA Pro: Post-Pretraining Method Without Catastrophic Forgetting
By
–
4/ LLaMA Pro – proposes a post-pretraining method to improve an LLM’s knowledge without catastrophic forgetting; it achieves this by tuning expanded identity blocks using only new corpus while freezing the inherited blocks.
-
CS230 VIP Cheatsheets: Data Science and Machine Learning Resources
By
–
CS230: VIP Cheatsheets! #BigData #Analytics #DataScience #AI #MachineLearning #IoT #IIoT #PyTorch #Python #RStats #TensorFlow #Java #JavaScript #ReactJS #GoLang #CloudComputing #Serverless #DataScientist #Linux #Programming #Coding #100DaysofCode https://
geni.us/CS230-Cheat-Sh
eets
… -
All of Statistics: Comprehensive Guide to Data Science
By
–
All of Statistics! #BigData #Analytics #DataScience #AI #MachineLearning #IoT #IIoT #PyTorch #Python #RStats #TensorFlow #JavaScript #ReactJS #GoLang #CloudComputing #Serverless #DataScientist #Linux #Statistics #Books #Programming #Coding #100DaysofCode https://
geni.us/All-of-Stats -
Unit Testing Best Practices for Data Science Applications
By
–
Unit Testing for #DataScience! #BigData #Analytics #DataScience #AI #MachineLearning #IoT #IIoT #PyTorch #Python #RStats #TensorFlow #Java #JavaScript #ReactJS #GoLang #CloudComputing #Serverless #DataScientist #Linux #Programming #Coding #100DaysofCode https://
geni.us/Unit-Testing-D
Sci
… -
Free Data Management with Data Science Tools and Technologies
By
–
Free #DataManagement with #DataScience! @kdnuggets #BigData #Analytics #AI #MachineLearning #IoT #IIoT #PyTorch #Python #RStats #TensorFlow #JavaScript #ReactJS #CloudComputing #Serverless #DataScientist #Linux #Programming #Coding #100DaysofCode https://
geni.us/DM-DSci -
Which big tech will lead open-source AI in 2024?
By
–
Which big tech will be leading open-source AI in 2024?
-
Open-Source Developers Could Build the Real Holodeck
By
–
Maybe the REAL holodeck will come from open-source developers? lol
-
Community Rapidly Adopts PyTorch and JAX Backends
By
–
Really impressive how quickly the community has been adopting the PyTorch and JAX backends!