Skip to main content

Multi-channel biometrics combining acoustic and machine vision analysis of speech, lip movement and face

Objective

The SpeechXRays project will develop and test in real-life environments a user recognition platform based on voice acoustics analysis and audio-visual identity verification. SpeechXRays will outperform state-of-the-art solutions in the following areas:
· Security: high accuracy solution (cross over accuracy of 1/100 i.e. twice the commercial voice/face solutions)
· Privacy: biometric data stored in the device (or in a private cloud under the responsibility of the data subject)
· Usability: text-independent speaker identification (no pass phrase), low sensitivity to surrounding noise
· Cost-efficiency: use of standard embedded microphone and cameras (smartphones, laptops).
The project will combine and pilot two proven techniques: acoustic driven voice recognition (using acoustic rather than statistical only models) and multi-channel biometrics incorporating dynamic face recognition (machine vision analysis of speech, lip movement and face). The vision of the SpeechXRays project is to provide a solution combining the convenience and cost-effectiveness of voice biometrics, achieving better accuracies by combining it with video, and bringing superior anti-spoofing capabilities. The technology will be deployed on 2000 users in 3 pilots: a workforce use case, an eHealth use case and a consumer use case. The project lasts 36 months and is coordinated by world leader in digital security solutions for the mobility space.

Field of science

  • /medical and health sciences/health sciences/health care services/ehealth
  • /natural sciences/physical sciences/acoustics
  • /engineering and technology/electrical engineering, electronic engineering, information engineering/information engineering/telecommunications/mobile phone
  • /humanities/languages and literature/linguistics/phonetics

Call for proposal

H2020-DS-2014-1
See other projects for this call

Funding Scheme

IA - Innovation action

Coordinator

IDEMIA FRANCE
Address
420 Rue D'estienne D'orves
92700 Colombes
France
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
EU contribution
€ 993 666,73

Participants (10)

HOROWITZ BIOMETRICS LIMITED

Participation ended

United Kingdom
EU contribution
€ 309 687,21
Address
364A High Road
NW10 2EA London
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
SIVECO ROMANIA SA
Romania
EU contribution
€ 472 688,01
Address
Soseaua Bucuresti-ploiesti 73-81 Complex Victoria Park Corp Cladire C4 Sector 1
013685 Bucuresti
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
TECH INSPIRE LTD
United Kingdom
EU contribution
€ 376 905,01
Address
Hamilton House, Mabledon Place
WC1H 9BB London
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
REALEYES OU
Estonia
EU contribution
€ 232 968,76
Address
Vahe 15
11615 Tallinn
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
ELLINIKI ETAIRIA TILEPIKOINONION KAI TILEMATIKON EFARMOGON AE
Greece
EU contribution
€ 199 937,50
Address
Vassilika Vouton Technologiko Parko
71500 Irakleio Kriti
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
INSTITUTUL NATIONAL DE CERCETARE-DEZVOLTARE PENTRU FIZICA SI INGINERIE NUCLEARA-HORIA HULUBEI
Romania
EU contribution
€ 206 650
Address
Strada Reactorului 30
077125 Magurele Ilfov
Activity type
Research Organisations
IDRYMA TECHNOLOGIAS KAI EREVNAS
Greece
EU contribution
€ 381 050
Address
N Plastira Str 100
70013 Irakleio
Activity type
Research Organisations
UNIVERSITY COLLEGE LONDON
United Kingdom
EU contribution
€ 310 601,28
Address
Gower Street
WC1E 6BT London
Activity type
Higher or Secondary Education Establishments
INSTITUT MINES-TELECOM
France
EU contribution
€ 460 812,50
Address
19 Place Marguerite Perey
91120 Palaiseau
Activity type
Higher or Secondary Education Establishments
VOICETRUST GMBH
Germany
EU contribution
€ 157 500
Address
Hofmannstrasse 25-27
81379 Munchen
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)