High workload, running 120b models locally.
SOFTWARE
-
Scaling PEFT: Towards Million Personal Models of Trillion Parameters
By
–
"On the Scaling of PEFT: Towards Million Personal Models of Trillion Parameters" Right now LLM personalization mostly means prompts, memory, or retrieval on top of one shared assistant. This paper instead keeps one trillion-parameter base model shared, and give each user a tiny
-
Ideogram v4: Open weights, crisp and fresh images.
By
–
Ideogram v4 is really good, and open weights. Images are crisp and feel fresh. https://t.co/lHhPwcLcWF pic.twitter.com/8S1P4Rz9FB
— fofr (@fofrAI) 3 juin 2026Ideogram v4 is really good, and open weights. Images are crisp and feel fresh.
-
Benchtalks #2 discusses ProgramBench where frontier models scored 0%
By
–
Benchtalks #2 is up with @vincentsunnchen. @jyangballin of @stanfordnlp, creator of @SWEbench, on ProgramBench, the benchmark every frontier model scored 0% on at launch.
— Snorkel AI (@SnorkelAI) 3 juin 2026
They dive into end-to-end code generation, why models reward-hack once they get internet access, and the… https://t.co/WZmhUqa8yaBenchtalks #2 is up with @vincentsunnchen
. @jyangballin of @stanfordnlp
, creator of @SWEbench
, on ProgramBench, the benchmark every frontier model scored 0% on at launch. They dive into end-to-end code generation, why models reward-hack once they get internet access, and the -
Open-source models: Faster, cheaper, more control, and privacy
By
–
Routing and post-training open-source models won't only give you more accurate systems but also meaningfully faster and cheaper systems as most companies are currently learning (in addition to giving you more control and privacy). The idea that a "frontier" model (by frontier we
-
AI-Enabled Cyberattacks vs. Security Community Techniques: An Analysis
By
–
How well do the security community's techniques hold up against AI-enabled cyberattacks? We examined 832 malicious accounts and mapped their activity onto a longstanding database of tactics and techniques used by threat actors. Here's what we learned:
-
Gemma 4 hits 150M+ downloads with new, powerful 12B model for local use
By
–
Celebrating the milestone of a massive 150+ million downloads of Gemma 4 with the release of the new Gemma 4 12B model! It's incredibly powerful for such a small model and it’s tiny enough to run locally on a laptop with just 16GB VRAM. Apache 2.0 license – happy building!
-
Gemma 4 12B released, runs comfortably on 16GB VRAM for LFM newcomers
By
–
They should all run comfortably (if you have ~16 GB VRAM). I am quite new to LFM's, and Gemma 4 12B just came out today, so time will tell…
-
Four additions to open-weight local LLM on consumer hardware
By
–
It's been a while! 4 nice additions to the open-weight local-LLM-on-consumer-hardware ecosystem:
-
NVIDIA Local AI Agents Level Up with OpenShell and RTX Updates
By
–
Local AI Agents are leveling up across DGX Spark & RTX PCs. NVIDIA OpenShell is coming to Windows alongside new agentic AI optimizations and creator app updates—including NVIDIA Broadcast 2.2, plus upcoming RTX acceleration for Adobe apps and Blender. Learn More: