Skip to main content
European Commission logo print header

Multi-channel biometrics combining acoustic and machine vision analysis of speech, lip movement and face

Objective

The SpeechXRays project will develop and test in real-life environments a user recognition platform based on voice acoustics analysis and audio-visual identity verification. SpeechXRays will outperform state-of-the-art solutions in the following areas:
· Security: high accuracy solution (cross over accuracy of 1/100 i.e. twice the commercial voice/face solutions)
· Privacy: biometric data stored in the device (or in a private cloud under the responsibility of the data subject)
· Usability: text-independent speaker identification (no pass phrase), low sensitivity to surrounding noise
· Cost-efficiency: use of standard embedded microphone and cameras (smartphones, laptops).
The project will combine and pilot two proven techniques: acoustic driven voice recognition (using acoustic rather than statistical only models) and multi-channel biometrics incorporating dynamic face recognition (machine vision analysis of speech, lip movement and face). The vision of the SpeechXRays project is to provide a solution combining the convenience and cost-effectiveness of voice biometrics, achieving better accuracies by combining it with video, and bringing superior anti-spoofing capabilities. The technology will be deployed on 2000 users in 3 pilots: a workforce use case, an eHealth use case and a consumer use case. The project lasts 36 months and is coordinated by world leader in digital security solutions for the mobility space.

Call for proposal

H2020-DS-2014-2015

See other projects for this call

Sub call

H2020-DS-2014-1

Coordinator

IDEMIA FRANCE
Net EU contribution
€ 831 791,73
Address
2 PLACE SAMUEL DE CHAMPLAIN
92400 Courbevoie
France

See on map

Region
Ile-de-France Ile-de-France Hauts-de-Seine
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Links
Total cost
€ 1 419 523,93

Participants (12)