Great reference ty. It still doesn’t get at more of theory of slop. As data lacking of insight. Filler. Something that “type checks” as information but isn’t. Style without substance. As something that, when attended to or trained on, does not aid compression of a world model.

→ View original post on X — @karpathy,