That's true. But looking at the Llama 3 report, there's still a lot of work going into dealing with outages, recovering checkpoints during training, etc. If I recall correctly, they had like 500 interruptions. It's really hard to train a model on that scale.
LLMS
-
Future of RAG: Predictions and Implications for AI Systems
By
–
Predictions for the Future of RAG – Jason Liu https://
bit.ly/4hYi0ap
#AI #MachineLearning #DeepLearning #LLMs #DataScience -
TGI Native Support Available Through Version 2.5
By
–
We do support it natively in TGI (till v2.5) – top of the list
-
Cost-effective AI model training under $6 million
By
–
Looks pretty good, considering the cost-to-train is under $6m. Needs a vibe-check.
-
LLM Pretraining Costs Calculation Based on DeepSeek-v3
By
–
An updated back-of-the-envelope calculation of LLM pretraining costs based on the just-released DeepSeek-v3 report.
And that doesn't even account for hyperparameter tuning, failed runs, or personnel costs. It really makes me appreciate the value of openly shared model weights! -
GPU Rental Costs and DeepSeek V3 Technical Report
By
–
Of course, this is the sticker price of rental GPUs. Lots of bigger companies have their in-house clusters or discount deals with cloud providers. But still…
Btw the full report is here: https://
github.com/deepseek-ai/De
epSeek-V3/blob/main/DeepSeek_V3.pdf
… -
DeepSeek API Direct Consumption Performance Evaluation
By
–
That said, what’s wrong w/ consuming directly from DeepSeek API, it looks pretty fkn fast to me.
-
GPU Deployment Challenges for AI Model Infrastructure
By
–
Not sure if we have the spare GPUs atm, doesn’t look as likely in the short term tho – since it might need some updates in TGI. Folks from @hyperbolic_labs mentioned (on shared slack) they might deploy it!
-
Enterprise MLOps and LLMOps Platforms by Abacus AI
By
–
#Statistics & #MachineLearning #infographics from @AbacusAI Learn about their incredibly complete Enterprise #MLOps & #LLMOps Platforms and Solutions at http://
abacus.ai
—————
#DataScience #AI #ML #DeepLearning #DataScientists #LLMs #GenerativeAI #RAG #GenAI #VectorDB -
Understanding AI Inference: A Beginner’s Guide to Machine Learning Basics
By
–
To be better equipped to explore the world of AI and its many applications (from language translation & text summarization to image recognition & speech synthesis), one must grasp the basics of inference.
Read our latest blog for a primer on inference.