Skip to main content

Multisensory Control of Movement

Objective

MUCOM aims to answer the following questions: (i) What are the reference frames in the control of manipulators and hand arm coordination? (ii) What are the mechanisms of the reduction of degrees of freedom and motor coordination in arm movement control? (iii) What are the spatio-temporal transformations involved in gaze control during orienting movements? (iv) What is the contribution of optic flow in self-motion and object-motion perception? (v) What is the contribution of inertial signals to self-motion perception, and what are the mechanisms for fusion of sensors and object motion detection during navigation?
Research has been carried out with respect to the problems of how the brain builds an internal representation of space and movement in order to allow action, orientation, and navigation, and the relation of these mechanisms with robotics of manipulators and mobile robots.

Acting:
Mechanisms of arm movement control have been studied. It was shown that the brain uses a flexible egocentric frame of reference. A formal model of 3-dimensional computation of arm reaching movements was developed using populations of neurons coding movement in body centred reference frames combined with others using gaze centred reference frames. Results have been obtained concerning multisensory coordination of arm movement in 3-dimensional space: sensory motor transformations necessary to establish a congruence between target visual information and kinesthetic information on hand position use an intermediate hybrid frame.

Orienting:
The mechanisms of oriented eye head movements have been studied at neuronal and behavioural levels. A mechanism for slow correction of saccades has been described. Its neuronal mechanisms have been discovered by revealing the involvement of tectoreticulospinal neurons. The relation between visual and acoustic specification of target contribution has been evaluated and a gaze position feedback discovered in the acoustic system. Superior colliculus neurons have also been shown to control both eye and hand movements during reaching. Models of the colliculus have been compared. These models stimulate dynamic feedback, dynamic memory, and multisensory information.

Navigating and fusion of sensors:
The postural sway induced by moving visual patterns was studied and the importance of coupling mechanisms between vision and the active postural system was revealed. The threshold of motion detection are lowered during active movement of the observer which has implication in robot vision. Also, it has been shown that extraretinal signals contribute to depth measurement and the 3-dimensional aspects of vestibular control of eye movements have been studied.
APPROACH AND METHODS

- Acting. The reference frames involved in eye-head-hand coordination will be studied by recording of movements during pointing 3-D tasks. These behavioural data will be compared with neuronal mechanisms of 3-D arm reaching in the cortex and the modelling with neural networks. The relations between visual perception of target movement and movement control will be studied by psychophysical methods and modelling of possible algorithms for the kinematics control of arm trajectory.

- Orienting. This activity will combine neurophysiological studies and neural networks modelling for the study of multisensory integration in orienting movements. Eye, head, and arm movements will be measured in relation to the underlying activities in the superior colliculus and in other structures involved in orienting.

- Navigating. The visuomotor processes involved in 3-D motion perception will be studied by psychophysical methods, mathematical modelling and neurophysiological recordings. The role of inertial signals (provided by the vestibular system) in navigation will be studied by recording neurons in brain structures involved in spatial memory and by psychophysical experiments in humans. New methods for rapid detection of near objects in mobile robots will be investigated.

POTENTIAL

The work is expected to lead to new basic concepts and results concerning the algorithms and computational mechanisms of the brain; new and improved methods for the study of sensorimotor coordination and fusion of sensors; possible new methods for diagnostic tools usable in biomedical exploration; new concepts for the control of mobile robots and new methods and theories of brain studies derived from robotics: and principles of sensor fusion, which could be useful in telemanipulation or telepresence applications.

Topic(s)

Data not available

Call for proposal

Data not available

Funding Scheme

Data not available

Coordinator

Centre National de la Recherche Scientifique (CNRS)
Address
16 Rue Pierre Et Marie Curie
75005 Paris
France
 

Participants (9)

Consiglio Nazionale delle Ricerche (CNR)
Italy
Address
Via Orazio Raimondo 7
00173 Roma
 
KATHOLIEKE UNIVERSITEIT NIJMEGEN
Netherlands
Address
, 9104
6500 HE Nijmegen
 
RUHR-UNIVERSITY BOCHUM
Germany
Address
Universitätsstraße 150
44780 Bochum
 
UNIVERSITAET ZURICH
Switzerland
Address
Frauenklinikstrasse, 26
8091 Zurich
 
UNIVERSITE CATHOLIQUE DE LOUVAIN
Belgium
Address
Pl.de L'universite, 1
1348 Louvain-la-neuve
 
UNIVERSITE DE GENEVE
Switzerland
Università degli Studi di Roma La Sapienza
Italy
Address
Via Nomentana 118
00161 Roma
 
Université de Montpellier II (Université des Sciences et Techniques du Languedoc)
France
Address
Place Eugène Bataillon
34060 Montpellier
 
Université de Paris VI (Université Pierre et Marie Curie)
France
Address
4 Place Jussieu
75252 Paris