I have never been more confident that Local and Opensource AI are going to win. LFG.
@theahmadosman
-
Open source AI must confront the frontier beyond hype
By
–
Too much hype and noise in this space I am Opensource AI Must Win through and through but I will not shy away from where the frontier is at as well because how else would Opensource AI improve?
-
LLM Engineering Projects Roadmap 2026 Edition
By
–
The Ultimate Step-By-Step LLM Engineering Projects Roadmap (2026 Edition) – Build a tokenizer
– Learn embeddings
– Implement RoPE / ALiBi
– Hand-wire attention
– Build MHA
– Build a Transformer block
– Train a mini-former
– Compare objectives
– Build sampling
– Speculative -
Codex Cli makes local AI easy with hardware-aware optimization
By
–
Let me make Local AI easy for you Give Codex Cli the article below & tell it: – Infer the right Inference Engine from your hardware + article below
– Use uv+venv
– Pick the right kernels
– Tune flags, batching, KVCache, etc
– Optimize for your hardware & chosen model See? Easy -
User thanks for stating lack of sovereign AI progress
By
–
thank you for saying that out loud, saw so many celebratory reactions on this release that left me very confused nothing here to celebrate here in regards to sovereign / opensource ai
-
Switch from Ollama to llama.cpp and OpenClaw to Hermes
By
–
If you’re using Ollama switch to llama.cpp If you’re still on OpenClaw switch to Hermes These are basics at this point
-
Bay Area folks asked about another Local AI Get Together
By
–
Bay Area folks, should we run it back and do another Local AI Get Together?
-
Best investment was betting on local and open-source AI
By
–
Best bet and investment I’ve ever made in myself This was a crazy stupid thing to do back in 2023/2024 but I fully believed Local and Opensource AI were the future
-
Ollama slower, slop, code thieves; better alternatives listed
By
–
ollama > slower than llama.cpp on windows
> slower than mlx on mac
> slop useless wrapper
> literal code thieves alternatives? > lmstudio
> llama.cpp
> exllamav2/v3
> vllm
> sglang
> trt-llm literally anythingʼs better than ollama