...A robot companion that works and interacts with humans and operated among them should have a clear understanding of humans.... The robot must have capabilities to recognize and perceive the human and reason on his activity...'

Partners involved

RA leader : UniKarl

partners involved : UniKarl, UvA, IPA, UniBi, LAAS, EPFL

RA objectives

A robot companion that works and interacts with humans and operates among them should have a clear understanding of humans, acting in its visual range. The robot must have capabilities to perceive the human and reason on its activity. Indeed, understanding the human’s activity forms a basis for intuitive and efficient interaction with the robot and learning from human behaviour. The owner of the robot should be identified and recognized.

Thus, the aim of this research activity is to study, model and implement cognitive components that help to enable dialogue, social behaviour and other interaction with humans.

To achieve this goals three fundamental work areas will be adressed :

detection and perception of body parts
modelling and prediction of human motion
context based understanding and prediction of human activities

Work conducted in RA2 is related to the three project scenarii : Key Experiment 1 (The Robot Home Tour), Key Experiment 2 (The Curious Robot) and Key Experiment 3 (Learning Skills and Tasks), and also to the other Research Activities.

Related project publications

Below are only listed some of the RA2-related publications, please see the Publications page for more.

Ludovic Brethes, Frédéric Lerasle, Patrick Danès, Data fusion for visual tracking dedicated to human-robot interaction , Accepted to ICRA 2005

Stefan Vacek, Steffen Knoop, Raoul Zöllner, Rüdiger Dillmann, A framework for goal-directed, capability-based visual perception, Submitted to RO-MAN 04.