High workload, running 120b models locally.
COMPUTING
-
Scaling PEFT: Towards Million Personal Models of Trillion Parameters
By
–
"On the Scaling of PEFT: Towards Million Personal Models of Trillion Parameters" Right now LLM personalization mostly means prompts, memory, or retrieval on top of one shared assistant. This paper instead keeps one trillion-parameter base model shared, and give each user a tiny
-
Open-source models: Faster, cheaper, more control, and privacy
By
–
Routing and post-training open-source models won't only give you more accurate systems but also meaningfully faster and cheaper systems as most companies are currently learning (in addition to giving you more control and privacy). The idea that a "frontier" model (by frontier we
-
16GB VRAM Doable for Standard Hardware Except Long Context Tasks
By
–
Maybe for very long context agent tasks, but otherwise, 16GB VRAM is pretty doable on standard hardware
-
Gemma 4 12B released, runs comfortably on 16GB VRAM for LFM newcomers
By
–
They should all run comfortably (if you have ~16 GB VRAM). I am quite new to LFM's, and Gemma 4 12B just came out today, so time will tell…
-
NVIDIA Local AI Agents Level Up with OpenShell and RTX Updates
By
–
Local AI Agents are leveling up across DGX Spark & RTX PCs. NVIDIA OpenShell is coming to Windows alongside new agentic AI optimizations and creator app updates—including NVIDIA Broadcast 2.2, plus upcoming RTX acceleration for Adobe apps and Blender. Learn More:
-
Build Multimodal AI Knowledge Base with Gemini Embedding 2
By
–
How to Build a Multimodal AI Knowledge Base With Gemini Embedding 2 https://
madebyagents.com/blog/build-mul
timodal-rag-gemini-embedding-2?utm_source=dlvr.it&utm_medium=twitter
… #ArtificialIntelligence #MachineLearning #DataScience #AIStrategy #DigitalTransformation #GenerativeAI #technology #ChiefDataOfficer -
Cosmos 3 tops seven physical AI leaderboards
By
–
🏆 Cosmos 3 just topped 7 physical AI leaderboards.
— NVIDIA (@nvidia) 3 juin 2026
NVIDIA Cosmos™ 3, the open omni-model for physical AI, ranks #1 across world generation, robot action policy, and industrial vision understanding.
🌎 World generation: Artificial Analysis, PAI-Bench, Physics-IQ, R-Bench
🤖… pic.twitter.com/ESrDfUjSJSCosmos 3 just topped 7 physical AI leaderboards. NVIDIA Cosmos™ 3, the open omni-model for physical AI, ranks #1 across world generation, robot action policy, and industrial vision understanding. World generation: Artificial Analysis, PAI-Bench, Physics-IQ, R-Bench
-
SambaNova post about Intel’s rack-scale agentic AI design
By
–
Agentic AI needs CPUs, GPUs, and AI accelerators working together. @TheRegister highlights @intel
's new rack-scale agentic AI designs and the first customer deployment of the Intel + SambaNova disaggregated inference blueprint through VC2. The result: GPUs handle prefill, -
Develop Physical AI Reasoning, World, and Action Models with NVIDIA
By
–
Develop Physical AI Reasoning, World, and Action Models with NVIDIA! #BigData #Analytics #DataScience #AI #MachineLearning #NLProc #LLM #IoT #IIoT #PyTorch #Python #RStats #TensorFlow #Java #JavaScript #ReactJS #GoLang #CloudComputing #Serverless #DataScientist #Linux