An updated back-of-the-envelope calculation of LLM pretraining costs based on the just-released DeepSeek-v3 report.
And that doesn't even account for hyperparameter tuning, failed runs, or personnel costs. It really makes me appreciate the value of openly shared model weights!
GENERATIVE AI
-
LLM Pretraining Costs Calculation Based on DeepSeek-v3
By
–
-
GPU Rental Costs and DeepSeek V3 Technical Report
By
–
Of course, this is the sticker price of rental GPUs. Lots of bigger companies have their in-house clusters or discount deals with cloud providers. But still…
Btw the full report is here: https://
github.com/deepseek-ai/De
epSeek-V3/blob/main/DeepSeek_V3.pdf
… -
GPU Deployment Challenges for AI Model Infrastructure
By
–
Not sure if we have the spare GPUs atm, doesn’t look as likely in the short term tho – since it might need some updates in TGI. Folks from @hyperbolic_labs mentioned (on shared slack) they might deploy it!
-
Enterprise MLOps and LLMOps Platforms by Abacus AI
By
–
#Statistics & #MachineLearning #infographics from @AbacusAI Learn about their incredibly complete Enterprise #MLOps & #LLMOps Platforms and Solutions at http://
abacus.ai
—————
#DataScience #AI #ML #DeepLearning #DataScientists #LLMs #GenerativeAI #RAG #GenAI #VectorDB -
DeepSeek V3: 3x Faster, More Capable
By
–
BREAKING : A new DeepSeek V3 model is now available on the web and it is 3 times faster In addition to being much more capable now
-
Training #1 AI Models for $6M: Three Parallel Futures
By
–
When I see reports like this (suggesting that a #1 model can be trained for just $6M), it makes me envision three parallel futures: 1) Intelligence as a Utility: Cheap, abundant, and high-capability—easily replicable, much like producing fire today. 2) The Automation of
-
Create AI Agents Using Natural Language with Abacus ChatLLM Teams
By
–
With @AbacusAI ChatLLM Teams, use your natural spoken language as a programming language (guided with the embedded #AI Assistant) to create AI Agents for a variety of different business tasks and processes.
— Kirk Borne (@KirkDBorne) 26 décembre 2024
🌟🌟🌟
Start FREE TRIAL at https://t.co/73VwIlbKFB#GenAI #GenerativeAI pic.twitter.com/uxnBiCOVhyWith @AbacusAI ChatLLM Teams, use your natural spoken language as a programming language (guided with the embedded #AI Assistant) to create AI Agents for a variety of different business tasks and processes. Start FREE TRIAL at https://
chatllm.abacus.ai/?token=kirk #GenAI #GenerativeAI -
AI Deepfakes Reach Photorealism: Are Doomers Wrong?
By
–
AI deepfakes have reached photorealism and I haven't seen society collapse yet.
— Marek Rosa | European🇪🇺 | South African🇿🇦 (@marek_rosa) 26 décembre 2024
Maybe the AI doomers were wrong after all? Hehe. pic.twitter.com/43WHlWptTgAI deepfakes have reached photorealism and I haven't seen society collapse yet. Maybe the AI doomers were wrong after all? Hehe.
-
Meta Llama’s Acceptable Use Policy: Comparable to Industry Standards
By
–
Note: Meta Llama comes with the same if not harsher AUP
