Community Research and Development Information Service - CORDIS

FP7 IntellAct project logo

IntellAct

Project reference: 269959
Funded under

Intelligent observation and execution of Actions and manipulations

From 2011-03-01 to 2014-02-28

Project details

Total cost:

EUR 3 899 781

EU contribution:

EUR 2 959 592

Coordinated in:

Denmark

Call for proposal:

FP7-ICT-2009-6See other projects for this call

Funding scheme:

CP - Collaborative project (generic)

understanding and exploiting the meaning (semantics) of manipulations in terms of objects, actions and their consequences for reproducing human actions with machines

IntellAct addresses the problem of understanding and exploiting the meaning (semantics) of manipulations in terms of objects, actions and their consequences for reproducing human actions with machines. This is in particular required for the interaction between humans and robots in which the robot has to understand the human action and then to transfer it to its own embodiment. IntellAct will provide means to allow for this transfer not by copying movements of the human but by transferring the human action on a semantic level. Two major application areas are addressed by IntellAct: the monitoring of human manipulations for correctness and the efficient teaching of cognitive robots to perform manipulations in a wide variety of applications.

Objective

IntellAct addresses the problem of understanding and exploiting the meaning (semantics) of manipulations in terms of objects, actions and their consequences for reproducing human actions with machines. This is in particular required for the interaction between humans and robots in which the robot has to understand the human action and then to transfer it to its own embodiment. IntellAct will provide means to allow for this transfer not by copying movements of the human but by transferring the human action on a semantic level. IntellAct will demonstrate the ability to understand scene and action semantics and to execute actions with a robot in two domains. First, in a laboratory environment (exemplified by a lab in the International Space Station (ISS)) and second, in an assembly process in an industrial context.IntellAct consists of three building blocks: (1) Learning: Abstract, semantic descriptions of manipulations are extracted from video sequences showing a human demonstrating the manipulations; (2) Monitoring: In the second step, observed manipulations are evaluated against the learned, semantic models; (3) Execution: Based on learned, semantic models, equivalent manipulations are executed by a robot.<br/>The analysis of low-level observation data for semantic content (Learning) and the synthesis of concrete behaviour (Execution) constitute the major scientific challenge of IntellAct.Based on the semantic interpretation and description and enhanced with low-level trajectory data for grounding, two major application areas are addressed by IntellAct: First, the monitoring of human manipulations for correctness (e.g., for training or in high-risk scenarios) and second, the efficient teaching of cognitive robots to perform manipulations in a wide variety of applications.<br/>To achieve these goals, IntellAct brings together recent methods for (1) parsing scenes into spatio-temporal graphs and so-called „semantic Event Chains‟, (2) probabilistic models of objects and their manipulation, (3) probabilistic rule learning, and (4) dynamic motion primitives for trainable and flexible descriptions of robotic motor behaviour. Its implementation employs a concurrent-engineering approach that includes virtual-reality-enhanced simulation as well as physical robots. Its goal culminates in the demonstration of a robot understanding, monitoring and reproducing human action.

Related information

Open Access

Coordinator

SYDDANSK UNIVERSITET
Denmark

EU contribution: EUR 674 700


Niels Bohrs Allé 1
DK-5230 Odense M
Denmark
Administrative contact: Norbert Krüger
Tel.: +45 65507483
Fax: +45 65503681
E-mail

Participants

UNIVERSITAET INNSBRUCK
Austria

EU contribution: EUR 538 140


INNRAIN
6020 INNSBRUCK
Austria
Administrative contact: Boris Puschitz
Tel.: +43 512 507 6102
Fax: +43 512 507 6105
E-mail
RHEINISCH-WESTFAELISCHE TECHNISCHE HOCHSCHULE AACHEN
Germany

EU contribution: EUR 462 450


Templergraben
52062 AACHEN
Germany
Administrative contact: Ernst Schmachtenberg
Tel.: +49 241 80 90490
Fax: +49 241 80 92490
E-mail
GEORG-AUGUST-UNIVERSITAET GOETTINGEN STIFTUNG OEFFENTLICHEN RECHTS
Germany

EU contribution: EUR 542 700


WILHELMSPLATZ
37073 GOETTINGEN
Germany
Administrative contact: Nadja Daghbouche
Tel.: +49551393058
Fax: +4955139183058
E-mail
AGENCIA ESTATAL CONSEJO SUPERIOR DE INVESTIGACIONES CIENTIFICAS
Spain

EU contribution: EUR 366 693


CALLE SERRANO
28006 MADRID
Spain
Administrative contact: Eusebio Jiménez Arroyo
Tel.: +34 91 5668852
Fax: +34 91 5668913
E-mail
JOZEF STEFAN INSTITUTE
Slovenia

EU contribution: EUR 374 909


Jamova
1000 LJUBLJANA
Slovenia
Administrative contact: Jadran Lenarčič
Tel.: +386 1 4773513
Fax: +386 1 4773906
E-mail
Record Number: 97727 / Last updated on: 2016-04-01