Robotic Action-Language Learning through Interaction (RALLI)

Future social robots will need the ability to acquire new tasks and behaviors on the job both through observation and through natural language instruction. In this project, we tackle the critical subproblem of learning new actions and their corresponding words by the artificial system observing how those actions are performed and expressed by a human tutor. As a result, robots are enabled to acquire action concepts, learn and execute actions, and talk about them.

Click here for a demo of a robot learning the once unknown referent of a word through a series of word learning situations (i.e., utterance and scene pairs).


Stephanie Gross
Austrian Research Institute for Artificial Intelligence (OFAI)
Freyung 6/6
1010, Vienna