MLX is often better on Apple Silicon from my experience llama.cpp is my fallback method
@theahmadosman
-
Run Local AI Easily Using Codex CLI and Optimized Inference
By
–
Let me make local AI easy for you Give Codex Cli the tweet below & tell it: – Infer the right Inference Engine from your hardware + tweet content below
– Use uv+venv
– Pick the right kernels
– Tune flags, batching, KVCache, etc
– Optimize for your hardware & chosen model Enjoy -
LTX 2.3 Ready to Run on RTX PRO 6000 GPUs
By
–
Time to put LTX 2.3 on your RTX PRO 6000s and get them to work 😀
-
Teasing a Major New Data Center Construction Plan
By
–
Wait until you see the Data Center I am going to build
-
26TB AI Model Archive Preserved Against Potential Disappearance
By
–
More than 26TB of models 🙂 Just in case they vanish from the internet
-
Advocating for Open Source AI Model Releases
By
–
I will accept that invitation if I receive it btw Gonna use that as an opportunity to ask for “Open” AI releases for the opensource community
-
Discussion on Open AI and the democratization of AI capabilities
By
–
So am I invited? 🙂 Would love to hear more about “democratize a lot of super capable AI” and discuss what that means for the folks like me that believe in “Open” AI
-
Advocate for Running AI Locally on Personal GPUs
By
–
Imagine not inviting that crazy guy that keeps telling everyone to Buy a GPU and run your AI locally
-
Stop Using Chinese AI as a Geopolitical Scare Tactic
By
–
“Frontier. Open-source. In the West. I want this constant cloud of fear around "Chinese AI" to disappear. It shouldn't be a geopolitical scare tactic that gets pulled out whenever convenient.”
-
Tenstorrent CEO: Today’s LLMs Will Be Forgotten Like Llama 3
By
–
“Who remembers llama 3? These will be the same in a few years” — Tenstorrent CEO, Jim Keller