Inflection-2 was trained on 5,000 NVIDIA H100 GPUs in fp8 mixed precision for ~10²⁵ FLOPs. The goal was to beat Google’s flagship PaLM 2 Large on all the standard LLM benchmarks including MMLU, TriviaQA, HellaSwag & GSM8k.
AI HARDWARE
-
Nvidia’s GPU Dominance in AI Data Center Expansion
By
–
Nvidia rising: Still underestimated Nvidia CEO Jensen Huang made the case that the use of his company’s GPU chips is proliferating as more countries and companies feel compelled to build their own artificial intelligence data centers. It’s probably the case investors still
-
AI Edge Computing Acceleration at Advantech World Partner Conference
By
–
Only 8 days left until @Advantech_eIoT World Partner Conference in Taiwan! Join @FabAroundEU presentation "Breaking Boundaries in AI: Elevating Edge Computing with High-Performance, Cost and Energy Efficient Acceleration Solutions" on Dec 1 at 13:50 https://
wpc.advantech.com/en-us/embedded
-iot/agenda
… -
Running AI Models on A40 GPU in Cloud Infrastructure
By
–
No, I'm running on an A40 GPU in the cloud.
-
Stability AI Extensions Coming Soon for Comfy and A1111
By
–
Comfy and A1111 extensions will probably come soon.
I'm sunning the Stability AI repo and example python scripts on a GPU. I'm sure @camenduru is already working on a colab. -
SVD-XT 25 Frames Benchmark on A40 GPU
By
–
Here's the longer SVD-XT 25 frames version.
— fofr (@fofrAI) 21 novembre 2023
This took 159s to run on an A40. pic.twitter.com/7PjACUcsiCHere's the longer SVD-XT 25 frames version.
This took 159s to run on an A40. -
NVIDIA RAPIDS Accelerates Apache Spark Pipelines on AWS EMR
By
–
At #AWSreinvent, learn how enterprises can accelerate Apache Spark pipelines for data processing up to 30% by deploying the NVIDIA RAPIDS Accelerator on Amazon EMR with EC2 and EKS. Wed., Nov 29 at 4 pm Venetian Data Zone Lightning Theater #5 https://
nvda.ws/3MUflR8 -
Chip Shortage Ends: Quarter Point for Tech Hardware Predictions
By
–
Looks like this quarter’s point goes to the chip-shortage-ends-next-year crowd.
-
Nvidia Beats Revenue Forecast, Shares Rise Modestly
By
–
Nvidia shares rise slightly on 11% beat on forecast Revenue came in two billion dollars higher than expected, a twelve-percent beat, and the forecast was eleven percent higher as well. The shares showed some modest after-hours gain. It’s a muted reaction, not almost a