I'm just looking at the timeline: 2019 – honest mistakes in Strubell et al. paper (
https://
arxiv.org/abs/1906.02243) in assessing emissions cost of Evolved Transformer neutral architecture search (off by 88X: 19X from not understanding the search process done in the actual So et al.

→ View original post on X — @jeffdean