A Survey on Efficient Training of Transformers Transformers are the one architecture driving AI research in most modalities. They require large compute resources, but more and more efficient training approaches are being proposed. A survey on the topic: https://
arxiv.org/abs/2302.01107

→ View original post on X — @jeande_d,