As @MosaicML showcased in April, on GPT training H100 is ~3x the speed of A100, if you use FP8 training, which is both seriously impressive and grounds you in relative improvement versus the previous generation! https://
mosaicml.com/blog/coreweave
-nvidia-h100-part-1
…
GENERATIVE AI
-
H100 Training Speed Triples A100 with FP8 Optimization
By
–
-
Model Distillation Performance Trade-offs in Large Language Models
By
–
But yeah, modeling performance-wise you'll probably take a hit. Same thing that happened when they distilled ChatGPT GPT-3.5 and later GPT-4
-
Making LLM serving affordable through pruning and quantization
By
–
Fair point, but I think the appeal is more in trying to make running LLM more affordable (via pruning and quantization) to reduce the number of GPUs required for serving.
-
MLPerf GPT-3 Training Results Clarification Explained
By
–
Context: People are misunderstanding the GPT-3 – 11 minutes training result from the latest MLPerf.
reference: -
GPT-3 Training Speed: Clarifying the 11-Minute Claim
By
–
No, GPT-3 wasn't trained in 11 minutes. The GPT-3 architecture was trained on the C4 dataset to 2.69 log-probability in 11 minutes on 3584 H100 GPUs. Don't focus on the "11 minutes" — because it's like saying "ResNet-50 was trained in 5 seconds on MNIST to 80% accuracy"
-
The Future Internet Book Now Available
By
–
I'm thrilled to announce that my new #book, 'The Future Internet' is now available! Get your copy now from: Amazon (UK): https://
lnkd.in/ePAwVG_K Amazon (UK): https://
lnkd.in/egyr4dvp Website: https://
lnkd.in/e7_gScnG #FutureInternet #Web3 #AI #Tech #Metaverse -
Global Generative AI Regulation: Countries Navigate Policy Challenges
By
–
New Report Alert "Regulating Generative AI Around the World" by @CullenInt unravels the global #AI regulatory landscape Learn how countries are navigating the challenges of #GenerativeAI. Don’t miss out! https://
x.com/CullenInt/stat
us/1667107785761234944?s=20&utm_source=Twitter&utm_medium=BernardMarr&utm_campaign=GT-AI
… #AIRegulation #TechPolicy #AIPolicy -
LLMs Transform eCommerce and Retail Information Access
By
–
"LLMs change the way we can access information and that enables exciting possibilities for retailers." Tune in to find out how LLMs are transforming the eCommerce game: https://
open.spotify.com/episode/0p1EIK
dbAYUqZMcYsCTV62
… #llm #ecommerce #retail #aibusiness -
Generative AI Transforms Advertising and Marketing Industry
By
–
Generative #AI comes for advertising https://
bit.ly/3qyemha #marketing #FutureofWork -
H2O Wave 0.26 Released with LLM Chatbot and New Features
By
–
#H2O Wave 0.26 is out with exciting features! Chatbot card for #LLMs Waved file configuration By-name component access Public demos of core apps on @huggingface Markdown code syntax highlighting and more! Details: