I completely agree with this take. Indeed, these issues have plagued other prominent work in this field. As one prominent example, the heavily cited Strubell et al. work took a one-time Neural Architecture Search done on TPUs in an efficient, low carbon Google Data center …

→ View original post on X — @jeffdean