lmsys is sitting on a gold mine. If they train on all of the preference data they’ve collected, they will have (by far) the best AI-agnostic reward model in the world. License that out to model developers — they’ll pay a ton, as more robust preference models = far better AIs.

→ View original post on X — @mattshumer_