Skip to main content

Perception, action and cognition through learning of object-action complexes

Objective

The successful design of a cognitive system must rely on a theoretical and measurable basis which on the one hand applies to humans and on the other hand to an artificial system, ultimately allowing for its construction. PACO-PLUS aims at the design of a cognitive robot that is able to develop perceptual, behavioural and cognitive categories in a measurable way and communicate and share these with humans and other artificial agents. PACO-PLUS brings together a consortium of robotics researchers, engineers, computer vision scientists, linguists, theoretical neuroscientists and cognitive psychologists, which is reflected in the management organization.

Central to the approach are three almost axiomatic assumptions which are linked to each other and which are the building blocks of a new approach required to create cognitive artificial agents:
- Objects and Actions are inseparably intertwined; the so-called Object-Action Complexes are the building blocks of cognition.
- Cognition is based on recurrent processes involving nested feedback loops operating on, contextualizing and reinterpreting object-action complexes. This is done while actively closing the perception-action cycle.
- Unified measure of success and progress exist through minimization of contingencies which an artificial cognitive system experiences while interacting with the environment or other agents.

To demonstrate the feasibility of our approach we will build robot systems with advanced cognitive capabilities that operate in real-world scenarios and that are able to learn to interact and perform basic communication with humans: A robot system to augment human action, and a robot system that is able to explore and manipulate a limited set of objects in an unconstrained environment.

Funding Scheme

IP - Integrated Project

Coordinator

UNIVERSITAET KARLSRUHE (TH)
Address
Kaiserstrasse 12
76131 Karlsruhe
Germany

Participants (9)

AALBORG UNIVERSITET
Denmark
Address
Fredrik Bajers Vej 5
9220 Aalborg
CONSEJO SUPERIOR DE INVESTIGACIONES CIENTIFICAS
Spain
Address
Calle Serrano 117
28006 Madrid
GEORG-AUGUST-UNIVERSITAET GOETTINGEN STIFTUNG OEFFENTLICHEN RECHTS
Germany
Address
Gosslerstrasse 5-7
37073 Goettingen
INSTITUT JOZEF STEFAN
Slovenia
Address
Jamova 39
1000 Ljubljana
KUNGLIGA TEKNISKA HOEGSKOLAN
Sweden
Address
Valhallavaegen 79
100 44 Stockholm
SYDDANSK UNIVERSITET
Denmark
Address
Campusvej 55
5230 Odense M
THE UNIVERSITY OF EDINBURGH
UNIVERSITE DE LIEGE
Belgium
Address
Place Du 20 Aout 7
4000 Liege
UNIVERSITEIT LEIDEN
Netherlands
Address
Rapenburg 70
2300 RA Leiden