Explore "Pretraining LLMs," a short course developed with @upstageai. DeepLearning.AI (@DeepLearningAI) Explore "Pretraining LLMs," a short course developed with @upstageai. While prompting or fine-tuning existing models is effective for many general language tasks, pretraining becomes essential for specialized domains or underrepresented languages in current models. This course guides you through the LLM pretraining pipeline—from data preparation to model evaluation—and introduces depth up-scaling, an innovative technique used by Upstage to train their Solar model family, cutting pretraining compute costs by up to 70%. Take the course for free: hubs.la/Q03kT_FP0 — https://nitter.net/DeepLearningAI/status/1918365268293607723#m

→ View original post on X — @hunkims, 2025-05-02 19:09 UTC