“SlimQwen: Exploring the Pruning and Distillation in Large MoE Model Pre-training” This new Qwen paper shows that pruning a pretrained MoE is much better than training the smaller MoE from scratch. All you need to do is prune depth, width, and experts, preserve some experts
AI
-
The Rise of Vibe-Coded AI Dashboards as a Social Trend
By
–
My favorite 2026 trend is friends casually showing each other their vibe-coded life/work dashboards and AI setups. Ngl it feels exactly like bringing your Magic: The Gathering binder to school as a teen.
-
Avoid training AI on its own actions to prevent delusions
By
–
Actions persist in history and can affect the world. However, we shouldn’t train on our own actions. Training on our own actions as if they were evidence is what can cause delusions.
-
On model choice and training dynamics
By
–
You don’t remove any information. You just use the right model. The action distribution is a delta function for your own actions. You still train on how the world is affected by or reacts to your actions
-
Coding with o3 model to avoid AI slowdown
By
–
If you feel like AI is slowing down, try coding with o3 – best model only a year ago
-
Educational Resource: Deep Learning Mathematics and Modeling
By
–
“Inside Deep Learning — Math, Algorithms, and Models” available at http://
amzn.to/3wDJEmc
—————
#DataScience #AI #MachineLearning #ML #NeuralNetworks #Mathematics #DataScientist #Python -
Developing and Debugging Machine Learning and Deep Learning Models
By
–
Develop and Debug high-performance, low-bias, and explainable Machine Learning and Deep Learning Models with Python : http://
amzn.to/3u2JiIB by @AliMLearning via @PacktDataML —————
#DataScientist #DataScience #AI #ML -
Educational Resource: The Hundred-Page Language Models Book
By
–
The Hundred-Page Language Models Book — Hands-on with PyTorch: http://
amzn.to/4sJl7YC by @burkov -
Illustrated Guide to Neural Networks and AI with PyTorch
By
–
Illustrated Guide to Neural Networks and AI — With hands-on examples in PyTorch: http://
amzn.to/4tdA2dc -
Machine Learning with PyTorch and Scikit-Learn Book Promotion
By
–
Massive 774-page book by @rasbt "#MachineLearning with #PyTorch and Scikit-Learn: Develop #ML and #DeepLearning models with #Python” at http://
amzn.to/4oGqtBP
—————
#DataScience #AI #NeuralNetworks #ComputerVision #DataScientist