LOCAL AI MODELS Which model would you run on your own infrastructure? Qwen 3.7 Max DeepSeek V4 Gemma 3 GPT OSS Different strengths: Privacy Control Cost efficiency Performance What are you running today? #AI #LocalAI #LLM #Ollama #OpenSourceAI
HARDWARE
-
Apple’s new 20B on-device AFM 3 for iPhone 17 Pro
By
–
Apple's new foundation models are genuinely exciting. The standout is AFM 3 Core Advanced, a 20-billion (!) parameter model that runs entirely on-device. Read that again. 20-billion, on-device, iPhone 17 Pro. It pulls this off by keeping the full model in flash memory and
-
safetensors v0.8.0 loads directly to Metal on Apple Silicon
By
–
Timely development: On Apple Silicon, safetensors v0.8.0 now loads directly to Metal. Tensors are loaded directly into an MTLBuffer and passed to frameworks that support it (i.e. @pytorch) via DLPack, avoiding unnecessary copies.
-
Train Models Faster with JAX, MaxText, NVFP4 on NVIDIA Blackwell
By
–
Train Models Faster with JAX and MaxText Using NVFP4 on NVIDIA Blackwell! #BigData #Analytics #DataScience #AI #MachineLearning #NLProc #LLM #IoT #IIoT #PyTorch #Python #RStats #TensorFlow #Java #JavaScript #ReactJS #GoLang #Mathematics #CloudComputing #Serverless #DataScientist
-
Llama 3 8B and 405B trained with NVFP4, up to 1.73x faster
By
–
We trained Llama 3 8B and 405B with NVFP4 precision on the NVIDIA Blackwell platform. Here's what we found: 1.31–1.73× faster than FP8, with zero accuracy loss.
-
Nvidia and Apple partner on private AI with Google Cloud GPUs.
By
–
Proud to collaborate on the next frontier of private AI. Apple is expanding Private Cloud Compute to @GoogleCloud using NVIDIA GPUs.
-
Apple’s on-device AI model on iPhone 17 Pro unavailable in Europe
By
–
Apple: “Our most powerful on-device AI model runs on iPhone 17 Pro.” Me: Great, I have one. Apple: “Do you live in Europe?” Me: …
-
New Apple Intelligence Siri exclusive to iPhone 17 Pro, not in EU
By
–
Interesting: New Apple Intelligence Siri only available on iPhone 17 Pro. Of course not be available in the EU (god damn)
-
Apple Intelligence: Personal Understanding, Web Tools, On-Screen Awareness
By
–
Apple Intelligence: -Personal Understand in apps.
– Browse tools for web
– on screen Awareness
– in App usage -
Tau Scaling: AI inference as system-level time problem in post-Moore era
By
–
My takeaway: AI inference is no longer just a model problem. It's a system-level time problem. For enterprise leaders, AI performance and AI economics are becoming inseparable. Learn more about Tau Scaling and what it means for the post-Moore era: https://
chinaxiv.org/abs/202605.002
24?locale=en
… What