I also think there was a will to experiments on too many aspects at the same time and in parallel in BS: try a new organisation, a multilingual model with low-ressources languages, a new way of building a dataset (crowd sourcing of sources), attempts to train in fp16, etc etc

→ View original post on X — @thom_wolf,