"That's essentially the aspirational goal... We want robots to look at human videos and be able to do the task themselves," said Sanjiban Choudhury.
Choudhury aims to provide proof of concept that robots can integrate information from repair manuals, videos of people doing the task and real-time human feedback.
A major challenge will be to translate written and spoken language and human actions into a series of robot movements - an effort called 'common grounding.'
Collection
[
|
...
]