Project description Cognitive Systems and RoboticsHandling novel situations beyond learned schemas or set behaviours is still a quest in engineering cognitive and embodied systems. Powerful generalisation mechanisms are necessary for any agent to operate effectively in real-world environments. POETICON++ suggests that natural language can be used as a learning tool for generalisation of learned behaviours & perceptual experiences and generation of new behaviours & experiences (creativity). The main objective of POETICON++ is the development of a computational mechanism for such generalisation of motor programs and visual experiences for robots. To this end, it will integrate natural language and visual action/object recognition tools with motor skills and learning abilities. Show the project objective Hide the project objective Handling novel situations beyond learned schemas or set behaviours is still a quest in engineering cognitive and embodied systems. Simply put, sensorimotor experiences in real world are non-finite and therefore powerful generalisation mechanisms are necessary for any agent to operate effectively in real-world environments.POETICON++ suggests that natural language can be used as a learning tool for:(a) generalisation of learned behaviours and perceptual experiences, and(b) generation of new behaviours and experiences (creativity).This is a new approach to behaviour and perception generalisation for artificial agents that capitalises on the use of a hierarchical and generative symbolic system for 'indexing' (labelling) sensorimotor experiences at different levels of abstraction. Motivated by experimental findings on a common neurological basis between language, perception and action (a common syntax), POETICON++ suggests the use of natural language for generalisation and generation of sensorimotor 'syntactic structures'.The main objective of POETICON++ is the development of a computational mechanism for such generalisation of motor programs and visual experiences for robots. To this end, it will integrate natural language and visual action/object recognition tools with motor skills and learning abilities, in the iCub humanoid. Tools and skills will engage in a cognitive dialogue for novel action generalisation and creativity experiments in two scenarios of 'everyday activities', comprising of (a) behaviour generation through verbal instruction, and (b) visual scene understanding.POETICON++ views natural language as a necessary tool for endowing artificial agents with generalisation and creativity in real world environments. Building on results from the POETICON project, it brings together an extended interdisciplinary group of experts for developing the first ever computational mechanism that will use language as a behaviour/experience generalisation tool. Programme(s) FP7-ICT - Specific Programme "Cooperation": Information and communication technologies Topic(s) ICT-2011.2.1 - Cognitive Systems and Robotics Call for proposal FP7-ICT-2011-7 See other projects for this call Funding Scheme CP - Collaborative project (generic) Coordinator FONDAZIONE ISTITUTO ITALIANO DI TECNOLOGIA Address Via morego 30 16163 Genova Italy See on map Region Nord-Ovest Liguria Genova Activity type Research Organisations Administrative Contact LUCIANO FADIGA (Prof.) Links Contact the organisation Opens in new window Website Opens in new window EU contribution No data Participants (5) Sort alphabetically Sort by EU Contribution Expand all Collapse all COGNITIVE SYSTEMS RESEARCH INSTITUTE Greece EU contribution € 529 998,00 Address Makedonomachou prantouna 7 11525 Athina See on map Region Αττική Aττική Κεντρικός Τομέας Αθηνών Activity type Research Organisations Administrative Contact KATERINA PASTRA (Dr.) Links Contact the organisation Opens in new window Other funding No data ATHINA-EREVNITIKO KENTRO KAINOTOMIAS STIS TECHNOLOGIES TIS PLIROFORIAS, TON EPIKOINONION KAI TIS GNOSIS Greece EU contribution € 514 420,00 Address Artemidos 6 kai epidavrou 151 25 Maroussi See on map Region Αττική Aττική Βόρειος Τομέας Αθηνών Activity type Research Organisations Administrative Contact Yanna Volti (Ms.) Links Contact the organisation Opens in new window Website Opens in new window Other funding No data INSTITUTO SUPERIOR TECNICO Portugal EU contribution € 470 334,00 Address Avenida rovisco pais 1 1049 001 Lisboa See on map Region Continente Área Metropolitana de Lisboa Área Metropolitana de Lisboa Activity type Higher or Secondary Education Establishments Administrative Contact Jose Santos-Victor (Prof.) Links Contact the organisation Opens in new window Website Opens in new window Other funding No data UNIVERSITY OF PLYMOUTH United Kingdom EU contribution € 630 136,00 Address Drake circus PL4 8AA Plymouth See on map Region South West (England) Devon Plymouth Activity type Higher or Secondary Education Establishments Administrative Contact Cangelosi Angelo (Prof.) Links Contact the organisation Opens in new window Website Opens in new window Other funding No data THE UNIVERSITY OF MARYLAND FOUNDATIION INC United States EU contribution € 834 175,00 Address Metzerott road 3300 20783 Adelphi See on map Activity type Higher or Secondary Education Establishments Administrative Contact YIANNIS ALOIMONOS (Prof.) Links Contact the organisation Opens in new window Other funding No data