What happens when you purchase a robot for household tasks, but the bot fails? MIT framework helps non-technical users learn why using counterfactual explanations, then fine-tunes an ML algorithm so the robot can perform the task correctly: http://
bit.ly/3Q019Iw
ROBOTICS
-
MIT Framework Explains Robot Failures Using Counterfactual Explanations
By
–
-
PaLI-X advances robotics with real-world apple and banana sorting
By
–
This is cool! 🥳 Nice to see more impact from PaLI-X (ViT22B + 32B UL2) on robotics.
— Yi Tay (@YiTayML) 29 juillet 2023
Gotta admit the ability to move apples and bananas in the real world just hits different from any emergent language/vision tasks. https://t.co/izPwjiVEoMThis is cool! Nice to see more impact from PaLI-X (ViT22B + 32B UL2) on robotics. Gotta admit the ability to move apples and bananas in the real world just hits different from any emergent language/vision tasks.
-
Robot Motions as Language: Transformer Architecture for Action Understanding
By
–
Interesting idea: treat sequences of robot motions as sequences of words with a similar transformer architecture to link language, vision, and action.
-
RT-2 Robotics Transformer: Vision and Language to Action Model
By
–
RT-2 relevant links: Project page: https://
robotics-transformer2.github.io
Paper: https://
robotics-transformer2.github.io/assets/rt2.pdf
Blog: https://
deepmind.com/blog/rt-2-new-
model-translates-vision-and-language-into-action
… Other links:
RT-1: https://
robotics-transformer1.github.io
PaLI-X(direct scale up of PaLI): https://
arxiv.org/abs/2305.18565
PaLM-E: https://
arxiv.org/abs/2303.03378 Work from Google -
RT-2: Vision-Language-Action Models for Robotic Control
By
–
RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control RT-2(Robotic Transformer 2) is a new model in family of vision-language action models(VLAs). RT-2 builds up on RT-1 and vision-language models(VLMs). RT-2 makes use of pre-trained VLMs and is
-
Robots Creating Art While Humans Perform Low-Wage Manual Labor
By
–
A recent twist of fate: Humans are doing the hard manual labor on minimum wage, while the robots write poetry and paint.
-
LLM Overkill: Do We Really Need AI for Robot Vision Tasks?
By
–
while cool, I’m not sure you need an LLM to identify an extinct animal in an image, translate it’s coordinates to a robot arm that can then pick it up.
-
RT-2: Bridging Gap Between Data Analysis and Physical Robotics
By
–
Computers have long been great at complex tasks like analysing data, but not so great at simple tasks like recognizing & moving objects. With RT-2, we’re bridging that gap by helping robots interpret & interact with the world and be more useful to people.
-
Walmart’s Robotic Warehouse Automation with AI
By
–
Inside Walmart's Robotic Warehouse of the Future
#AI https://
wsj.com/articles/insid
e-walmarts-warehouse-of-the-future-6f17d17a
… via @WSJ -
IROS Conference and Machine Learning Workshop Discussion
By
–
Yes, would love to discuss and will be at IROS! Somewhat relatedly I'll be participating in this workshop next month, maybe some intersections? https://
lbit2023.lst.uni-saarland.de/index.html See you in Detroit!