The race for LLM "cognitive core" – a few billion param model that maximally sacrifices encyclopedic knowledge for capability. It lives always-on and by default on every computer as the kernel of LLM personal computing.
Its features are slowly crystalizing: – Natively multimodal

→ View original post on X — @karpathy,