Am hanging out in airport with family headed to New York for a wedding and road trip. My Apple AirPods just got better. But I am running developer beta of iOS 17. Dolby Atmos is way better. Way better bass. While I was dragging suitcases around Irena started a new
SOFTWARE
-
PyTorch Distributed Training and Tensor Sharding with Fabric
By
–
None of these: just PyTorch with distributed training and tensor sharding. Optionally with CPU offloading for really big LLMs. I use Fabric as a convenient wrapper here.
-

PyTorch DataLoader: Features, Benefits, and Usage Guide
By
–
PyTorch DataLoader: Features, Benefits, and How to Use it | Saturn Cloud Blog https://
bit.ly/439ciKs #AI #MachineLearning #DeepLearning #LLMs #DataScience -

Tesla FSD Achieves Extraordinary Improvements in Autonomous Driving
By
–
Tesla’s FSD drove me from SF to @jowyang
’s house last night dropped him off then continued driving to San Jose. Extraordinary improvements. Still not perfect but the rate of improvements have increased. I feel the same way. It is the most extraordinary software of my life. -
Advanced Microphone Technology Excels in Noisy Recording Conditions
By
–
It is extraordinary. Worked last night in very noisy conditions with microphone two feet from our mouths. Recorded groups perfectly in very very noisy situations.
-
Replit Support Offers Help With Your Project URL
By
–
Hey! We can take a look if you dm us your repl URL or email us at support@replit.com
-

DeepSpeed Stage 3 LoRA Bug and FSDP Migration Plans
By
–
Theoretically, you can get it to work if you use deepspeed stage 3 with offloading. But I see there is currently a little bug for stage 3 and LoRA. I think we watned to switch from DeepSpeed to FSDP anyway though. PS: Glad you like my book!
-

John Tukey Birthday: Pioneer of Software and Bit Computing
By
–
Happy birthday to the late John Tukey, who coined the terms “software” and “bit” (short for “binary digit”). He would have turned 1101100 today: https://
nyti.ms/2X7cxr5 v/
@nytimes
, photo by Alfred Eisenstadt -

Analytics and AI Accelerate Drug Development Processes
By
–
Meet with our life sciences experts at #DIA2023 in Boston and learn how analytics and AI can speed up your drug development processes. http://
2.sas.com/6013O9mO1 -

Microsoft Teams Adds Discord-like Communities and AI Art Tool
By
–
Microsoft Teams on Windows 11 gets Discord-like communities and an AI art tool The built-in Teams app will now include support for Microsoft’s communities feature inside Teams, the company’s answer to Facebook and Discord. https://
bit.ly/3Cxwp9W