*fancy index lookups in embedding layers followed by fancy batch matrix-matrix products
COMPUTING
-
NVIDIA GPU and CUDA Manual Confusion in Molecular Dynamics Lab
By
–
Can confirm: I was interning at a molecular dynamics lab ~10 years ago. NVIDIA gave us a Tesla GPU, which came with a ~500-page CUDA manual — no one knew what to do with it
-
Jensen Huang Keynotes SIGGRAPH 2023 Graphics Conference
By
–
Our founder and CEO Jensen Huang returns to the stage of the world's largest professional graphics conference #SIGGRAPH2023 on August 8 to deliver a live keynote. https://
nvda.ws/3DJ8R2k -
Replit Upgrades Infrastructure with Google Cloud Premium Network
By
–
We've made a major upgrade to improve your experience on Replit. All users can now enjoy fewer restarts and faster networking, even on the free tier. Read how we did it with our next-gen storage system and Google Cloud’s Premium tier network service:
-
CoreWeave: Largest Private GPU Operator in North America
By
–
"With over 45,000 GPUs in our fleet, we are the largest private operator of GPUs in North America." Numbers feel right to me https://
coreweave.com/blog/we-are-co
reweave
… -
AWS Security Assessment with Senior Cloud Consultant
By
–
Join me as I delve deep into the world of AWS cloud security with the brilliant Artur Schneider, Senior Cloud Consultant at T-Systems. Tune in now be guided through the realm of AWS Security Assessment. Click the link below to listen now: https://
podcasts.bernardmarr.com/1045873/132927
09-aws-security-assessment
… -
Groq Language Processor Llama2 70B Performance Spotlight Event
By
–
If you are interested in throughput and low latency for large language models, don't miss our next GroqSpotlight: Groq Language Processor™ Llama2 70B Sneak Peek. http://
groq.link/gsaugust
#LLM #llama2 #largelanguagemodel -
Cerebras Condor Galaxy 1: First 4 ExaFLOPS AI Supercomputer
By
–
Cerebras Tech Talk! Join us on August 9th at 11:00 AM PT as we will share details about Condor Galaxy 1 (CG-1), the first of nine interconnected 4 exaFLOPS AI supercomputers to be built in partnership with G42. Register here: https://
hubs.li/Q01Z-ghM0 -
GPU Power Consumption: High Current Flow at Low Voltage
By
–
I didn’t really appreciate that, because they operate at under one volt, high end GPUs are continuously flowing over 500 amps through the die at full load.
-
NVIDIA’s 55x Growth Since 2015: GPUs Dominating AI Market
By
–
Overheard in the hallowed hallways of AI compute: "I have been hearing GPUs are not designed for AI since 2015 – during that time NVIDIA 10x (at least) its market cap" I actually checked. It's not 10x since 2015, it's…55x!