9. Formal Algorithms for Transformers This document provides a precise overview of transformer architectures and algorithms, covering what they are, how they are trained, what they are used for, their key components, and a preview of prominent models. https:// arxiv.org/abs/2207.09238