I have raised this exact point in the past with some Google authors, saying that it wasn't reasonable to use flawed estimates that were off by a factor of 3261X from the actual cost of training this language model, and that they should fix this before publishing. Sigh.
Google’s Flawed Training Cost Estimates Criticized by Researcher
By
–