Fully agree that multimodal LLMs are the solution to robotics. This is why my team pioneered Gato (General AgenT One): https://
arxiv.org/pdf/2205.06175
.pdf
… which we built over two years since 2020 to 2022. One of the most important parts of Gato was the data and its engineering pipeline.

→ View original post on X — @nandodf,