Definitely wouldn't try it on real-world robots like this.
But, we did use GPT pretty successfully on RUMs ( https://
robotutilitymodels.com ) as an inference-time augmentation — bumped accuracy of tasks by a huge margin (10%+)

→ View original post on X — @soumithchintala