> E.g. Llama 3 405B used 30.8M GPU-hours, while DeepSeek-V3 looks to be a stronger model at only 2.8M GPU-hours (~11X less compute). Super interesting! And DeepSeek was trained in H800’s which are probably also a tad (or noticeably?) slower than Meta’s H100’s.
COMPUTING
-
Time Series Data in Smart Grid IIoT Solutions
By
–
The Role of Time Series Data in Smart Grid IIoT Solutions https://
buff.ly/4hVGT6y #sponsored #influxdata_iiot #InfluxDB #IIoT #SmartGrid #Industry40 -
Strong IIoT Platform Capabilities for Industry 4.0
By
–
Capabilities of a Strong IIoT Platform >> https://
buff.ly/4dGxQUg #sponsored #influxdata_iiot #InfluxDB #Industry40 #IIoT @MHiesboeck @jblefevre60 via @fogoros -
January 2025 Industrial IoT ICS Cybersecurity Events Overview
By
–
January 2025 Industrial IoT & ICS Cybersecurity Events
>> https://
buff.ly/4iGp7nY #CES2025 #WFES25 #IIoT #Industry40 @IIoT_World @gp_pulipaka @Ronald_vanLoon via @fogoros -
Four Major Benefits of Time Series Databases
By
–
The Four Major Benefits of Time Series Databases
>> https://
buff.ly/4dGxQUg #sponsored #influxdata_iiot #InfluxDB #TimeSeries #DataManagement @lucianilie15 via @fogoros -
InfluxDB Streamlines Data Management for Modern Businesses
By
–
As technology advances, effective #datamanagement becomes increasingly vital. @InfluxDB helps businesses stay ahead, making data handling efficient and cost-effective. https://
buff.ly/489irdl #sponsored #influxdata_iiot #InfluxDB @GregorianCT1 @lucianilie15 via @fogoros -
Knuth on Code Verification: Proving Correctness vs Testing
By
–
"Beware of bugs in the above code; I have only proved it correct, not tried it." — Donald Knuth, Turing winner & author of "The Art of Computer Programming"
-
Frontier Model Development Cost Drops to 5.5 Million USD
By
–
Scarcity breeds Innovation – cost to build a frontier model – 5.5 Million USD In a way, it's the maximum it'd be (Note: H800s have ~2x slower chip-to-chip data transfer) This cost, will only go down further and further as we continue to find newer walls to scale!
-
W3C Ethical Web Principles Guide Industry Standards
By
–
The W3C recently put out a statement on Ethical Web Principles. These guidelines are intended to promote ethical thinking across the web industry and to create a web that is beneficial for all society https://
bit.ly/3ZKWbmj #w3c #a11y #accessibility #openweb -
GPU costs and hidden expenses in AI model training
By
–
100%. And even if they didn't own the GPUs, they would get discounts. But on the flipside, it doesn't include costs for failed runs, hyperparameter tuning, and researchers and engineer salaries etc.