One of the big bottlenecks with LLMs & Vision Transformers is GPU memory on consumer devices. Wrote about my favorite techniques for reducing peak memory in PyTorch: https://
lightning.ai/pages/communit
y/tutorial/pytorch-memory-vit-llm/
… Focused on techniques that don't require architecture changes! Suggestions welcome!
COMPUTING
-
Reducing GPU Memory for LLMs and Vision Transformers in PyTorch
By
–
-
AI Reshaping Database Market Through Recursive Question-Asking
By
–
Big changes are coming to the database market because of AI The recursive movement of question-asking in AI is going to shake things up. https://
thetechnologyletter.com/the-posts/big-
changes-are-coming-to-the-database-market-because-of-ai
… $SNOW $ORCL @databricks @MosaicML $MSFT #database #investing #bigdata #AI -
Cleve Moler MathWorks Co-Founder Spotted at Moler A
By
–
Spotted: Cleve Moler in Moler A #MathWorks #MathWorksCoFounder
-
Manhattan Population Flow: Data Visualization of Urban Dynamics
By
–
Unveiling the pulse of Manhattan with the finest #dataviz I have ever seen!
— Pascal Bornet (@pascal_bornet) 3 juillet 2023
Hourly influx, reflecting the weekly population swing from 2M to 4M at peaks. The heartbeat a city that never sleeps!
Crdt: J. Fung#data #analytics #NYC #tech #innovation pic.twitter.com/pvo7gcFcmZUnveiling the pulse of Manhattan with the finest #dataviz I have ever seen! Hourly influx, reflecting the weekly population swing from 2M to 4M at peaks. The heartbeat a city that never sleeps! Crdt: J. Fung
#data #analytics #NYC #tech #innovation -
Quantum Computing: Commercial Scale Expected in 2030s
By
–
Quantum Computing will continue to achieve hyped headlines with research breakthroughs but don’t expect quantum computing at mass commercial scale until sometime in the 2030s. http://
mckinsey.com/featured-insig… For now it is a national security race as China vs the US as whomever gets -
Following 70K in AI: Spatial Computing Pioneer Before Apple
By
–
I follow 70,000 in AI and am the only human to do so. Plus wrote two books on spatial computing before Apple announced its spatial computer.
-
Smiley Public Library AI and Data Science Resources Guide
By
–
AI Best: Smiley Public Library. #BigData #Analytics #DataScience #AI #MachineLearning #IoT #IIoT #PyTorch #Python #RStats #TensorFlow #Java #JavaScript #ReactJS #GoLang #CloudComputing #Serverless #DataScientist #Linux #Programming #Coding #100DaysofCode https://
geni.us/Smiley-Public-
Library
… -
Machine Learning Education: Python, TensorFlow, PyTorch Tools
By
–
Machine Learning for Kids. #BigData #Analytics #DataScience #AI #MachineLearning #IoT #IIoT #PyTorch #Python #RStats #TensorFlow #Java #JavaScript #ReactJS #CloudComputing #Serverless #DataScientist #Linux #Books #Programming #Coding #100DaysofCode https://
geni.us/MLKids -
Frontend Roadmap: Modern Web Development Stack Guide
By
–
Frontend Roadmap! @brijpandeyji #BigData #Analytics #DataScience #AI #IoT #IIoT #Python #RStats #TensorFlow #JavaScript #ReactJS #CloudComputing #Serverless #DataScientist #Linux #Books #Programming #Coding #100DaysofCode https://
geni.us/Frontend-Roadm
ap
… -
Fractal Analysis in Big Data and Machine Learning
By
–
Fractal Analysis. #BigData #Analytics #DataScience #AI #MachineLearning #IoT #IIoT #Python #RStats #TensorFlow #Java #JavaScript #ReactJS #GoLang #CloudComputing #Serverless #DataScientist #Linux #Mathematics #Books #Programming #Coding #100DaysofCode https://
geni.us/FractalsAnalys
is
…