One of the big bottlenecks with LLMs & Vision Transformers is GPU memory on consumer devices. Wrote about my favorite techniques for reducing peak memory in PyTorch: https://
lightning.ai/pages/communit
y/tutorial/pytorch-memory-vit-llm/
… Focused on techniques that don't require architecture changes! Suggestions welcome!
OPEN SOURCE
-
Reducing GPU Memory for LLMs and Vision Transformers in PyTorch
By
–
-
Local h2oGPT Installation: Private and Secure Chat
By
–
Dive into @h2oai's @Rob_Mulla's latest video tutorial, where he showcases how to install #h2oGPT directly on your local computer! 100% private, 100% local chats with a GPT! https://bit.ly/3NCxnGP #AI #datascience #privacy #tutorial
-
GitHub Resources for Open and Unlimited AI
By
–
GitHub – jennyzzt/awesome-open-ended: Awesome Open-ended AI
https://bit.ly/3pbGMx5
#AI #MachineLearning #DeepLearning #LLMs #DataScience -
Frontend Roadmap: Modern Web Development Stack Guide
By
–
Frontend Roadmap! @brijpandeyji #BigData #Analytics #DataScience #AI #IoT #IIoT #Python #RStats #TensorFlow #JavaScript #ReactJS #CloudComputing #Serverless #DataScientist #Linux #Books #Programming #Coding #100DaysofCode https://
geni.us/Frontend-Roadm
ap
… -
Essential Linux Commands for Data Science and Cloud Computing
By
–
Linux Basic Commands! #BigData #Analytics #DataScience #AI #MachineLearning #IoT #IIoT #PyTorch #Python #RStats #TensorFlow #Java #JavaScript #ReactJS #GoLang #CloudComputing #Serverless #DataScientist #Linux #Programming #Coding #100DaysofCode https://
geni.us/LinuxCom -
AutoGPT, LangChain and Top AI Skills for Data Scientists
By
–
KDnuggets Top Posts for March 2023: AutoGPT: Everything You Need To Know: AutoGPT: Everything You Need To Know • Top 19 Skills You Need to Know in 2023 to Be a Data Scientist • 8 Open-Source Alternative to ChatGPT and Bard • LangChain 101: Build Your… https://
kdnuggets.com/2023/05/top-po
sts-apr-2023.html?utm_source=dlvr.it&utm_medium=twitter&utm_campaign=kdnuggets-top-posts-for-march-2023-autogpt-everything-you-need-to-know
… -
LeanDojo: Open-Source Toolkit for AI Theorem Proving
By
–
1/ LeanDojo – an open-source Lean playground consisting of toolkits, data, models, and benchmarks for theorem proving; also develops ReProver, a retrieval augmented LLM-based prover for theorem solving using premises from a vast math library.
-
Extending LLM Context Windows to 32K with Minimal Fine-tuning
By
–
2/ Extending Context Window of LLMs – extends the context window of LLMs like LLaMA to up to 32K with minimal fine-tuning (within 1000 steps); attains good performance on several tasks while being more efficient and cost-effective.
-
Tinygrad: Training Simple Neural Networks Guide
By
–
Tinygrad: Training a Simple Neural Network! #BigData #Analytics #DataScience #AI #MachineLearning #IoT #IIoT #Python #RStats #TensorFlow #Java #JavaScript #ReactJS #CloudComputing #Serverless #DataScientist #Linux #Programming #Coding #100DaysofCode https://
geni.us/Tinygrad-Netwo
rk
…
