Knowing that Neural Architecture Search is a one-time cost per problem domain, not a per-problem cost was definitely widespread knowledge in the ML community at the time of the publication. So that 3261X error was avoidable by simply using their own actual measurements of the

→ View original post on X — @jeffdean