Skip to main content

SENSOrimotor structuring of perception and action for emerging cognition

Objective

The SENSOPAC project will combine machine learning techniques and modeling of biological systems to develop a machine capable of abstracting cognitive notions from sensorimotor relationships during interactions with its environment, and of generalising this knowledge to novel situations. The machine through active sensing and exploratory actions will discover the sensorimotor relationships and consequently learn the intrinsic structure of its interactions with the world and unravel predictive and causal relationships.

Together with action policy formulation and decision making, this will underlie the machine's abilities to create abstractions, to suggest and test hypotheses, and develop self-awareness. Detailed neural models of key brain areas will be embedded into functional models of perception, motivation, decision making, planning and control, effectively bridging and contributing to Neuroscience and Engineering. The project will demonstrate how a naive system can bootstrap its cognitive development by constructing generalization and discovering abstractions with which it can conceptualize its environment and its ownself.

The continuous developmental approach will combine self-supervised and reinforcement learning with motivational drives to form a truly autonomous artificial system. A systematic and integrated approach to studying active sensing and motor control in animals in a hierarchy of defined tasks will offer insights into skilled behaviour that will lead to fruitful applications of bio-inspired mechanisms for perception, cognition and intelligent control. The project relies on the synergy between multiple scientific institutions including a SME, an industrial and RTD partners who are leaders in their fields. Throughout the project, continuous interactions between experimentalists, theoreticians, engineers and roboticists will take place in order to coordinate the most rigorous development and testing of a complete artificial cognitive system.

Funding Scheme

IP - Integrated Project

Coordinator

ERASMUS UNIVERSITAIR MEDISCH CENTRUM ROTTERDAM
Address
Dr. Molewaterplein 40/50
3015 GE Rotterdam
Netherlands

Participants (11)

ALMA CONSULTING GROUP SAS
France
Address
Domaine Des Bois D'houlbec
27120 Houlbec-cocherel
ALTJIRA SA
Switzerland
Address
Via Cattedrale 9
6900 Lugano
BAR ILAN UNIVERSITY
Israel
Address
Bar Ilan University Campus
52900 Ramat Gan
DEUTSCHES ZENTRUM FUER LUFT UND RAUMFAHRT E.V.
Germany
Address
Linder Hohe
51147 Koeln
LUNDS UNIVERSITET
Sweden
Address
Paradisgatan 5C
221 00 Lund
THE CHANCELLOR, MASTERS AND SCHOLARS OF THE UNIVERSITY OF CAMBRIDGE
United Kingdom
Address
The Old Schools, Trinity Lane
Cambridge
THE UNIVERSITY OF EDINBURGH
United Kingdom
Address
Old College, South Bridge
EH8 9YL Edinburgh
UMEA UNIVERSITET
Sweden
Address
Universitetomradet
901 87 Umea
UNIVERSIDAD DE GRANADA
Spain
Address
Cuesta Del Hospicio, S/n
18071 Granada
UNIVERSITA DEGLI STUDI DI PAVIA
Italy
Address
Strada Nuova 65
27100 Pavia
UNIVERSITE PIERRE ET MARIE CURIE - PARIS 6
France
Address
4 Place Jussieu
75252 Paris Cedex 05