We are happy to announce that we have brought up support for Llama-3.1-70B inference on Tenstorrent’s 8-chip systems, the TT-QuietBox and the TT-LoudBox. The source code for Llama-3.1-70B and other models that are supported is on our GitHub —>
COMPUTING
-
AI Investment Focus: Nvidia Clusters Over Current DoE Infrastructure
By
–
I wish they would spend their AI money on buying megaclusters of Nvidia instead. Even the clusters at DoE labs seem small compared to what is being built in the commercial world.
-
Researcher Presents Parabolic PDE Talk at SIGGRAPH 2024
By
–
Next week I'll be attending (and giving a talk!) at #SIGGRAPH2024. If you happen to be going, let's grab coffee and talk more about research! You can check information about my talk (location and time) here https://
tinyurl.com/parabolic-pde -
GPU Configuration and Memory Optimization for Model Fine-tuning
By
–
The process of fine-tuning and evaluation involves several technical challenges: • Configuring GPU computing environments
• Optimising memory usage and finding the optimal batch size
• Setting up model configurations for specific requirements -
AI Transforming Manufacturing: Interview with Linda Yao Lenovo
By
–
How AI is Transforming Manufacturing and Other Industries: Interview with Linda Yao, @Lenovo https://
cognilytica.com/how-ai-is-tran
sforming-manufacturing-and-other-industries-interview-with-linda-yao-lenovo-ai-today-podcast/?utm_source=dlvr.it&utm_medium=twitter
… #CIOs #Podcast #Lenovo -
Efficient scaling: training compute versus inference compute gains
By
–
I'd be interested too but I don't expect much. Still a cool approach, with lots of potential gains in scaling more efficiently (training compute =>> inference compute)
-
Toronto researchers develop single-photon camera for advanced imaging
By
–
Researchers at the University of Toronto have developed a single-photon camera (SPAD) that captures and reconstructs light at any timescale. Explore the research [
https://
spr.ly/6018gqs3y -
Six Petabytes of Data Per Day Driving AI Infrastructure
By
–
6… petabytes… of data… per day… h/t @_philschmid
-
Metis AIPU Edge AI Vision Technology Showcased at Summit
By
–
Check out Bram Verhoef showcasing our edge AI and vision technology from the 2024 Embedded Vision Summit – @edgeaivision ! See the Metis AIPU's 200+ TOPs and high-performance computer vision solutions. Watch now: https://
youtube.com/watch?v=mNkL_J
ADTm4
…
#AI #ComputerVision #Innovation -
Jensen Huang Named Top 35 HPC Legend by HPCWire
By
–
We are honored to share that our CEO, Jensen Huang, has been named a top 35 #HPC legend by @HPCWire for his visionary leadership and groundbreaking advancements in accelerated computing. https://
nvda.ws/4fgsbFP