Yep, but models will get smaller and GPUs bigger esp now that AI is so popular I think
AI HARDWARE
-
GPU and Internet Requirements for Local AI Model Deployment
By
–
That should NEVER even end up at tech suport You should check if user has 1) GPU to run it fast 2) internet speed to download model fast If not you should not even let them use it and just give them the cloud version instead
-
Client-Side AI Execution: GPU and Model Size Constraints
By
–
Essentially there's nothing you can NOT run client-side now The only limit is GPU size and model size to download
-
Distributing 70B Model Files: Infrastructure Challenges
By
–
Yep but there's 70B too, issue is how do you get that 40GB file to the user
-
Running Llama 3 Locally in Browser with WebGPU GPU
By
–
I got Llama 3 running in my browser using only my GPU with my Wi-Fi switched OFF completely client-side
— @levelsio (@levelsio) 11 mai 2024
WebGPU is a new feature in browsers where JS can use the GPU of the device and apparently you can run LLMs on it too, and it's fast!
My end goal for 🧠… pic.twitter.com/iz1oxeUQNpI got Llama 3 running in my browser using only my GPU with my Wi-Fi switched OFF completely client-side WebGPU is a new feature in browsers where JS can use the GPU of the device and apparently you can run LLMs on it too, and it's fast! My end goal for
-
Cerebras Engineer Discusses AI Accelerators for HPC Applications
By
–
Join Cerebras HPC Solutions Engineer, Leighton Wilson, as he speaks on a panel at ISC discussing democratizing AI accelerators for HPC applications. Date: May 14th 2024 Time: 2:15pm to 3:15pm Local Time Location: ISC 2024 in Hamburg, Germany, Hall E 2nd Floor For more
-
Athena Intelligence Uses Groq to Power Fast Olympus Analytics Platform
By
–
Athena Intelligence, whose AI-native analytics platform, Olympus, is powered by Groq to deliver “wow” fast interactivity, helping data scientists write code & queries to dive into structured data. https://
hubs.la/Q02wPjWC0
More GroqThoughts use cases coming soon. -
Cerebras SVP discusses sustainable supercomputing design challenges
By
–
Join Cerebras SVP of Product and Strategy, Andy Hock, as he speaks on a panel at the Sustainable Supercomputing Workshop where he discussed the opportunities and challenges in designing sustainable supercomputing systems from hardware to software. Date: May 16th 2024 Time:
-
Festo’s BionicBee: Autonomous Robotic Swarm Technology Innovation
By
–
Festo has unveiled BionicBee, a #robotic innovation that mimics bee swarming behavior autonomously. This biomimetic swarm #technology has vast potential applications across civilian and military sectors. #AI #IoT #5G @SpirosMargaris @gvalan @Hal_Good
-
Chinese real-time 360° multi-person image processing technology
By
–
Y déjà a une technologie chinoise qui fait ça en temps réel avec 200 personnes en même temps à l'image… Et une technologie qui assure la rotation fluide 360⁰ sur l'axe vertical également.