Community Research and Development Information Service - CORDIS

FP7 POETICON++ project logo

POETICON++

Project reference: 288382
Funded under

Robots need Language: A computational mechanism for generalisation and generation of new behaviours in robots

From 2012-01-01 to 2015-12-31, closed project

Project details

Total cost:

EUR 5 123 166

EU contribution:

EUR 3 880 000

Coordinated in:

Italy

Call for proposal:

FP7-ICT-2011-7See other projects for this call

Funding scheme:

CP - Collaborative project (generic)
Handling novel situations beyond learned schemas or set behaviours is still a quest in engineering cognitive and embodied systems. Powerful generalisation mechanisms are necessary for any agent to operate effectively in real-world environments. POETICON++ suggests that natural language can be used as a learning tool for generalisation of learned behaviours & perceptual experiences and generation of new behaviours & experiences (creativity). The main objective of POETICON++ is the development of a computational mechanism for such generalisation of motor programs and visual experiences for robots. To this end, it will integrate natural language and visual action/object recognition tools with motor skills and learning abilities.

Objective

Handling novel situations beyond learned schemas or set behaviours is still a quest in engineering cognitive and embodied systems. Simply put, sensorimotor experiences in real world are non-finite and therefore powerful generalisation mechanisms are necessary for any agent to operate effectively in real-world environments.POETICON++ suggests that natural language can be used as a learning tool for:(a) generalisation of learned behaviours and perceptual experiences, and(b) generation of new behaviours and experiences (creativity).This is a new approach to behaviour and perception generalisation for artificial agents that capitalises on the use of a hierarchical and generative symbolic system for 'indexing' (labelling) sensorimotor experiences at different levels of abstraction. Motivated by experimental findings on a common neurological basis between language, perception and action (a common syntax), POETICON++ suggests the use of natural language for generalisation and generation of sensorimotor 'syntactic structures'.The main objective of POETICON++ is the development of a computational mechanism for such generalisation of motor programs and visual experiences for robots. To this end, it will integrate natural language and visual action/object recognition tools with motor skills and learning abilities, in the iCub humanoid. Tools and skills will engage in a cognitive dialogue for novel action generalisation and creativity experiments in two scenarios of 'everyday activities', comprising of (a) behaviour generation through verbal instruction, and (b) visual scene understanding.POETICON++ views natural language as a necessary tool for endowing artificial agents with generalisation and creativity in real world environments. Building on results from the POETICON project, it brings together an extended interdisciplinary group of experts for developing the first ever computational mechanism that will use language as a behaviour/experience generalisation tool.

Related information

Coordinator

FONDAZIONE ISTITUTO ITALIANO DI TECNOLOGIA
Italy

EU contribution: EUR 900 937


VIA MOREGO 30
16163 GENOVA
Italy
Administrative contact: LUCIANO FADIGA
Tel.: +393472265336
Fax: +390107170817
E-mail

Participants

ATHENA RESEARCH AND INNOVATION CENTER IN INFORMATION COMMUNICATION & KNOWLEDGE TECHNOLOGIES
Greece

EU contribution: EUR 514 420


ARTEMIDOS 6 KAI EPIDAVROU
151 25 MAROUSSI
Greece
Administrative contact: Yanna Volti
Tel.: +30 210 6998677
Fax: +30 210 6998663
E-mail
COGNITIVE SYSTEMS RESEARCH INSTITUTE
Greece

EU contribution: EUR 529 998


MAK PRANTOUNA 7
11525 ATHINA
Greece
Administrative contact: KATERINA PASTRA
Tel.: +306944710967
Fax: +302110124544
E-mail
INSTITUTO SUPERIOR TECNICO
Portugal

EU contribution: EUR 470 334


Avenida Rovisco Pais 1
1049-001 LISBOA
Portugal
Administrative contact: Jose Santos-Victor
Tel.: +351 21 8418294
Fax: +351 21 8418291
E-mail
UNIVERSITY OF PLYMOUTH
United Kingdom

EU contribution: EUR 630 136


DRAKE CIRCUS
PL4 8AA PLYMOUTH
United Kingdom
Administrative contact: Cangelosi Angelo
Tel.: +44 1752 586217
Fax: +44 1752 586300
E-mail
THE UNIVERSITY SYSTEM OF MARYLAND FOUNDATION, INC.
United States

EU contribution: EUR 834 175


METZEROTT ROAD 3300
20783 ADELPHI
United States
Administrative contact: YIANNIS ALOIMONOS
Tel.: +3014051743
E-mail
Record Number: 102147 / Last updated on: 2016-04-11