Can we teach a robot its limits to do chores safely & correctly? 🧵

To help robots execute open-ended, multi-step tasks, MIT CSAIL researchers used vision models to see what’s near the machine & model its constraints. An LLM sketches up a plan that’s checked in a simulator to… pic.twitter.com/u5HyfQwUic

— MIT CSAIL (@MIT_CSAIL) 12 décembre 2024

Can we teach a robot its limits to do chores safely & correctly? To help robots execute open-ended, multi-step tasks, MIT CSAIL researchers used vision models to see what’s near the machine & model its constraints. An LLM sketches up a plan that’s checked in a simulator to

→ View original post on X — @mit_csail