Why this matters for open source: Dense models: Entire model needs retraining if you want to change anything
MoE models: Swap experts, add capabilities, fine-tune components independently Meta released Llama 405B (dense) – $50M+ training cost
DeepSeek released V3 (MoE) – $5.6M,
INNOVATION
-

MoE vs Dense Models: Cost Efficiency
By
–
-

MoE’s Hidden Potential: New Training Strategies
By
–
Here's the part nobody talks about: MoE doesn't just save compute. It enables entirely new training strategies. You can: → Add experts mid-training for new capabilities
→ Replace underperforming experts without retraining everything
→ Fine-tune individual experts on -

MoE Architecture: 5-10x More Parameters
By
–
The modern MoE architecture is insane: > Mixtral 8x7B: 47B total params, only 13B active per token
> DeepSeek-V3: 671B params, 37B active – beats GPT-4 at 1/10th cost
> Grok-1: 314B params, trained faster than any dense model of similar quality Pattern: 5-10x more parameters. -
Claude Opus 4.5 Powers Space Engineers 2 Game Development
By
–
Claude Code (Opus 4.5) is coding Space Engineers 2
— Marek Rosa | European🇪🇺 | South African🇿🇦 (@marek_rosa) 3 janvier 2026
I asked Claude to:
– add a starfield effect to the main screen background
– a small mockup chatbot window for Goodbot3
All done in a few minutes, directly in the real SE2 codebase.
This is a game changer – yes, pun intended! pic.twitter.com/2KTwV9TkCqClaude Code (Opus 4.5) is coding Space Engineers 2 I asked Claude to:
– add a starfield effect to the main screen background
– a small mockup chatbot window for Goodbot3 All done in a few minutes, directly in the real SE2 codebase. This is a game changer – yes, pun intended! -

Microteam Success: Automation, Talent, and Growth Strategies
By
–
The microteam meta lesson from 22 success stories: Automation + versatile talent = disproportional output Controversy + cross-platform leverage = free marketing at scale Quality + advocacy > paid growth Sweat the details https://
scalebrate.com/podcast/what-c
an-you-learn-from-22-microteam-success-stories-plus-1
… -
SAS Leaders Predict AI Coming of Age Through Data Management
By
–
Data and AI leaders at SAS predict an AI coming of age . Embracing the fundamentals of data management and trustworthy AI is the only way for this technology to achieve its full potential to benefit humans, empower organizations and accelerate innovation. Which one of these
-
FSD now safer and smoother than human driving
By
–
And FSD now is way safer than letting a human drive. Certainly is way smoother.
-
Tesla asserts its self-driving is earlier than any 2008 or 2018 car
By
–
Show me a 2008 car that can drive itself. Even a 2018. My Tesla does. Everywhere. No one else was earlier.
-
Self-driving car older than Chinese rivals, Tesla’s no-patent stance
By
–
My car self drives. Which is its best feature. It's eight years old. And is still smoother and better than what the Chinese have. Tesla doesn't believe in patenting things. But you are right. Now China is pulling ahead and will stay that way. One of the advantages of having 1.3