you mean this? I was hoping for a bit more Balaji style deep dive and thoughts on what it means for the western closed source labs.
RESEARCH
-
Hugging Face collaborates with major Chinese AI labs on open science
By
–
FWIW – we work quite closely with all major Chinese labs, we don't distinguish between any. Wherever there's open source/ science, HF is there.
-

Four Critical Perspectives for Effective AI Strategy Alignment
By
–
AI Strategy: 4 Critical Perspectives Business: Maximize ROI & future-proof your org. Usage: Trustworthiness, ethics & AI for good. Functional: System architecture & learning techniques. Implementation: Design, latency, data & technical debt. Align these
-

Knuth on Code Verification: Proving Correctness vs Testing
By
–
"Beware of bugs in the above code; I have only proved it correct, not tried it." — Donald Knuth, Turing winner & author of "The Art of Computer Programming"
-
DeepSeek’s 5.5M USD Breakthrough: Frontier AI Cost Revolution
By
–
Agreed. On a similar note, what are your thoughts on the recent DeepSeek release? The frontier *just* costs 5.5M USD (+ a cracked team) – and I'm here for it!
-
FP8 Precision Format Discussion in Machine Learning
By
–
My understanding from the paper is that it's fp8. Maybe @zizhpan can confirm
-

Frontier Model Development Cost Drops to 5.5 Million USD
By
–
Scarcity breeds Innovation – cost to build a frontier model – 5.5 Million USD In a way, it's the maximum it'd be (Note: H800s have ~2x slower chip-to-chip data transfer) This cost, will only go down further and further as we continue to find newer walls to scale!
-

Open Science Momentum Builds Into 2025
By
–
4 days to the end of 2024, open science is winning! Bring it on in 2025!
-
Llama 3 Training Challenges: Outages and Checkpoint Recovery
By
–
That's true. But looking at the Llama 3 report, there's still a lot of work going into dealing with outages, recovering checkpoints during training, etc. If I recall correctly, they had like 500 interruptions. It's really hard to train a model on that scale.