This is why I still believe that seed averaging is a MUST for even the deployed models. It helps with accuracy AND reliability. Of course, it also requires more compute, but that might be the only way to overcome the current limitations of the LLM-based products.

→ View original post on X — @tunguz,