"Incompressible Knowledge Probes: Estimating Black-Box LLM Parameter Counts via Factual Capacity" This paper estimate close source LLM size from long-tail facts by using 1400 probes of obscure knowledge. The idea is that reasoning can be compressed, but factual storage can't.

→ View original post on X — @askalphaxiv,