Skip to main content

Human Motion Analysis from Image Sequences

Objective

Recent research has uncovered real potential for humans to interact with computers in natural ways by using their body motion, gestures and facial expressions. This has resulted in a huge surge of research within the Computer Vision community to develop algorithms able to understand, model and interpret human motion using visual information. Commercial motion capture solutions exist that can reconstruct the full motion of a human body or the deformations of a face. However these systems are severely restricted by the need to use markers on the subject and multiple calibrated cameras besides being costly and technically complex. Imagine instead the possibility of pointing a camera at a person for a few seconds and obtaining a fully parameterised detailed 3D model in a completely automated way. This 3D model could subsequently be used for animation tasks, to assist physiotherapists in the rehabilitation of patients with injuries or ultimately to guide a robot in a surgical operation. The aim of this project is to bring this scenario closer to reality by conducting the ground-breaking research needed to crack some of the challenging open problems in visual human motion analysis. So far visual human motion tracking systems have typically modelled the human body as a 3D skeleton ignoring the fact that each of its articulated parts is not strictly rigid but can also deform, since they are surrounded by soft tissue, muscles and clothes. Think of a torso performing small twists, a bicep flexing or a face performing different facial expressions. In this grant I are interested in recovering the full detailed 3D shape of the human body, including a model for the supporting 3D skeleton that captures its underlying articulated structure and a collection of deformable models to describe the non-rigid nature of each of its parts. Crucially, I plan to obtain these models without the use of markers, prior models or exemplars --- purely from image measurements.

Field of science

  • /medical and health sciences/clinical medicine/physiotherapy
  • /natural sciences/computer and information sciences/artificial intelligence/computer vision

Call for proposal

ERC-2007-StG
See other projects for this call

Funding Scheme

ERC-SG - ERC Starting Grant

Host institution

University College London
Address
Gower Street
WC1E 6BT London
United Kingdom
Activity type
Higher or Secondary Education Establishments
EU contribution
€ 267 030,40
Principal investigator
Lourdes De Agapito (Dr.)
Administrative Contact
Giles Machell (Mr.)

Beneficiaries (2)

University College London
United Kingdom
EU contribution
€ 267 030,40
Address
Gower Street
WC1E 6BT London
Activity type
Higher or Secondary Education Establishments
Principal investigator
Lourdes De Agapito (Dr.)
Administrative Contact
Giles Machell (Mr.)
QUEEN MARY UNIVERSITY OF LONDON

Participation ended

United Kingdom
EU contribution
€ 1 211 177,60
Address
327 Mile End Road
E1 4NS London
Activity type
Higher or Secondary Education Establishments
Administrative Contact
Jan Clarke (Ms.)