Skip to main content

Audiovisual to Articulatory Speech Inversion

Project description


FET - Open

ASPI is concerned with the recovery of vocal tract shape dynamics from an acoustical speech signal supplemented by image analysis of a speaker’s face.  It is (i) developing inversion methods with emphasis to audiovisual to articulatory inversion methods and the investigation of additional constraints and optimization methods to deduce the under-determined nature of inversion, and (ii) constructing a multimodal articulatory database based on ultrasound, MRI, and facial motion capture.

ASPI may lead to a much needed breakthrough in our understanding of speech and our approach to speech research, given the focus on multimodal data collection, the activities related to publicizing data collection protocols and technical specifications of data collection equipment as well the activities planned to exploit the data.

Call for proposal

FP6-2002-IST-C
See other projects for this call

Coordinator

CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE
Address
615 Rue Du Jardin Botanique
54600 Villers-l�nancy
France

See on map

EU contribution
€ 612 112,40

Participants (4)

UNIVERSITE LIBRE DE BRUXELLES
Belgium
EU contribution
€ 265 272
Address
Avenue Franklin Roosevelt 50
1050 Bruxelles

See on map

Activity type
Higher or Secondary Education Establishments
INSTITUTE OF COMMUNICATION AND COMPUTER SYSTEMS
Greece
EU contribution
€ 300 639,60
Address
Patission Street 42
10682 Athens

See on map

Activity type
Research Organisations
KUNGLIGA TEKNISKA HOEGSKOLAN
Sweden
EU contribution
€ 421 976
Address
Valhallavaegen 79
100 44 Stockholm

See on map

Activity type
Higher or Secondary Education Establishments
INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET EN AUTOMATIQUE
France
EU contribution
€ 0
Address
Domaine De Voluceau
78153 Le Chesnay

See on map