So here Apple has basically said, screw it, let's focus on the long tail of developers and leave the huge foundation model development to Nvidia. But that was really how it was always going to play out given the big Cuda dependency most large model training has.
AI HARDWARE
-
Apple’s ML Strategy: Fine-tuning and Quantizing Models for Production
By
–
Based on the announcements, as well as some descriptions from WWDC sessions, we can see a potential ML development route Apple is targeting: fine-tuning and quantizing ML models to put into prod.
-
Meta’s MTIA AI Inference Accelerator: Key Problems Solved
By
–
3️⃣ Important problems that MTIA, our first-generation AI inference accelerator solves. A closer look from Mahesh Maddury, Roman Levenstein & Linda Cheng; part of the team behind this work.
— AI at Meta (@AIatMeta) 6 juin 2023
Details on Meta Training and Inference Accelerators ➡️ https://t.co/9A4I1iwNGp pic.twitter.com/aQmJ4wqwN4Important problems that MTIA, our first-generation AI inference accelerator solves. A closer look from Mahesh Maddury, Roman Levenstein & Linda Cheng; part of the team behind this work. Details on Meta Training and Inference Accelerators https://
bit.ly/42sAnv9 -
Cutting-edge AI solutions presented at Holst Centre Innovation Day
By
–
Save the date! We will be attending the
@HolstCentre Innovation Day! On June 21, Eindhoven, Netherlands. Our team will present our cutting-edge AI solutions that offer industry-leading performance and usability at a fraction of the cost of existing solutions. #ID23 #edgeAI -
Cerebras Leads AI Hardware Startups with Research Citations
By
–
Cerebras is now the leading AI hardware startup as measured by research paper citations! Cerebras-GPT is just the start – we have so much cool research that we can't wait to share with you all. Stay tuned!
h/t: @nathanbenaich -
Ambi Robotics Deploys AI-Powered Robots for Advanced Logistics Operations
By
–
Congrats to the entire @AmbiRobotics team for implementing our new series of AI-powered robots for automated induction, middle-mile sortation, and reverse (customer returns) logistics at 1200 parcels per hour! https://t.co/w0lRYdsgF6
— Ken Goldberg (@Ken_Goldberg) 6 juin 2023Congrats to the entire @AmbiRobotics team for implementing our new series of AI-powered robots for automated induction, middle-mile sortation, and reverse (customer returns) logistics at 1200 parcels per hour!
-
Cerebras Gains Ground but NVIDIA Dominates AI Chip Market
By
–
With regards to AI chip startups, Cerebras is seeing an uptick. Still, the sum papers that use any of the 5 major AI chip startups is 113x less than any NVIDIA chip.
-
NVIDIA A100 dominates GPU market, H100 emerging
By
–
You can see the inflection in NVIDIA A100 usage vs. the older V100. The H100 is still super early so doesn't register much. Huawei is not making many inroads. All roads lead to NVIDIA.
-
State of AI Compute Index tracks hardware chipsets in research
By
–
We've refreshed our @stateofai Compute Index w/new data thanks to @ZetaVector! As a reminder, we track all open source AI papers that mention the use of a specific hardware chipset in their papers. We then enumerate them by vendor and card type to show you trends:
-
Groq CEO discusses LLMs proliferation at Six Five Summit
By
–
Don't miss @GroqInc CEO, @JonathanRoss321
, today at 9:30 PT, in a compelling discussion with @danielnewmanUV about the rapid proliferation of Large Language Models (LLMs). #SixFiveSummit https://
thesixfivesummit.com/sessions/beyon
d-the-hype-llms-inference-processors-and-groq/
…