30 Jan '15, 12am
Robots Learn to Perform Tasks by “Watching” YouTube Videos January 29, 2015 DARPA program advances robots’ ability to sense visual information and turn it into action Robots can learn to recognize objects and patterns fairly well, but to interpret and be able to act on visual input is much more difficult. Researchers at the University of Maryland, funded by DARPA’s Mathematics of Sensing, Exploitation and Execution (MSEE) program, recently developed a system that enabled robots to process visual data from a series of “how to” cooking videos on YouTube. Based on what was shown on a video, robots were able to recognize, grab and manipulate the correct kitchen utensil or object and perform the demonstrated task with high accuracy—without additional human input or programming. “The MSEE program initially focused on sensing, which involves perception and understanding of what’s...