Skip to main content
Ir a la página de inicio de la Comisión Europea (se abrirá en una nueva ventana)
español español
CORDIS - Resultados de investigaciones de la UE
CORDIS
Contenido archivado el 2024-06-18

Robots need Language: A computational mechanism for generalisation and generation of new behaviours in robots

Descripción del proyecto


Cognitive Systems and Robotics

Handling novel situations beyond learned schemas or set behaviours is still a quest in engineering cognitive and embodied systems. Powerful generalisation mechanisms are necessary for any agent to operate effectively in real-world environments. POETICON++ suggests that natural language can be used as a learning tool for generalisation of learned behaviours & perceptual experiences and generation of new behaviours & experiences (creativity). The main objective of POETICON++ is the development of a computational mechanism for such generalisation of motor programs and visual experiences for robots. To this end, it will integrate natural language and visual action/object recognition tools with motor skills and learning abilities.

Handling novel situations beyond learned schemas or set behaviours is still a quest in engineering cognitive and embodied systems. Simply put, sensorimotor experiences in real world are non-finite and therefore powerful generalisation mechanisms are necessary for any agent to operate effectively in real-world environments.POETICON++ suggests that natural language can be used as a learning tool for:(a) generalisation of learned behaviours and perceptual experiences, and(b) generation of new behaviours and experiences (creativity).This is a new approach to behaviour and perception generalisation for artificial agents that capitalises on the use of a hierarchical and generative symbolic system for 'indexing' (labelling) sensorimotor experiences at different levels of abstraction. Motivated by experimental findings on a common neurological basis between language, perception and action (a common syntax), POETICON++ suggests the use of natural language for generalisation and generation of sensorimotor 'syntactic structures'.The main objective of POETICON++ is the development of a computational mechanism for such generalisation of motor programs and visual experiences for robots. To this end, it will integrate natural language and visual action/object recognition tools with motor skills and learning abilities, in the iCub humanoid. Tools and skills will engage in a cognitive dialogue for novel action generalisation and creativity experiments in two scenarios of 'everyday activities', comprising of (a) behaviour generation through verbal instruction, and (b) visual scene understanding.POETICON++ views natural language as a necessary tool for endowing artificial agents with generalisation and creativity in real world environments. Building on results from the POETICON project, it brings together an extended interdisciplinary group of experts for developing the first ever computational mechanism that will use language as a behaviour/experience generalisation tool.

Programa(s)

Programas de financiación plurianuales que definen las prioridades de la UE en materia de investigación e innovación.

Tema(s)

Las convocatorias de propuestas se dividen en temas. Un tema define una materia o área específica para la que los solicitantes pueden presentar propuestas. La descripción de un tema comprende su alcance específico y la repercusión prevista del proyecto financiado.

Convocatoria de propuestas

Procedimiento para invitar a los solicitantes a presentar propuestas de proyectos con el objetivo de obtener financiación de la UE.

FP7-ICT-2011-7
Consulte otros proyectos de esta convocatoria

Régimen de financiación

Régimen de financiación (o «Tipo de acción») dentro de un programa con características comunes. Especifica: el alcance de lo que se financia; el porcentaje de reembolso; los criterios específicos de evaluación para optar a la financiación; y el uso de formas simplificadas de costes como los importes a tanto alzado.

CP - Collaborative project (generic)

Coordinador

FONDAZIONE ISTITUTO ITALIANO DI TECNOLOGIA
Aportación de la UE
€ 900 937,00
Coste total

Los costes totales en que ha incurrido esta organización para participar en el proyecto, incluidos los costes directos e indirectos. Este importe es un subconjunto del presupuesto total del proyecto.

Sin datos

Participantes (5)

Mi folleto 0 0