Skip to main content

Multi-channel biometrics combining acoustic and machine vision analysis of speech, lip movement and face

Objective

The SpeechXRays project will develop and test in real-life environments a user recognition platform based on voice acoustics analysis and audio-visual identity verification. SpeechXRays will outperform state-of-the-art solutions in the following areas:
· Security: high accuracy solution (cross over accuracy of 1/100 i.e. twice the commercial voice/face solutions)
· Privacy: biometric data stored in the device (or in a private cloud under the responsibility of the data subject)
· Usability: text-independent speaker identification (no pass phrase), low sensitivity to surrounding noise
· Cost-efficiency: use of standard embedded microphone and cameras (smartphones, laptops).
The project will combine and pilot two proven techniques: acoustic driven voice recognition (using acoustic rather than statistical only models) and multi-channel biometrics incorporating dynamic face recognition (machine vision analysis of speech, lip movement and face). The vision of the SpeechXRays project is to provide a solution combining the convenience and cost-effectiveness of voice biometrics, achieving better accuracies by combining it with video, and bringing superior anti-spoofing capabilities. The technology will be deployed on 2000 users in 3 pilots: a workforce use case, an eHealth use case and a consumer use case. The project lasts 36 months and is coordinated by world leader in digital security solutions for the mobility space.

Call for proposal

H2020-DS-2014-2015

See other projects for this call

Sub call

H2020-DS-2014-1

Coordinator

IDEMIA FRANCE
Net EU contribution
€ 831 791,73
Address
420 Rue D'estienne D'orves
92700 Colombes
France

See on map

Region
Ile-de-France Ile-de-France Hauts-de-Seine
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Non-EU contribution
€ 356 482,20

Participants (12)

Third-party

Legal entity other than a subcontractor which is affiliated or legally linked to a participant. The entity carries out work under the conditions laid down in the Grant Agreement, supplies goods or provides services for the action, but did not sign the Grant Agreement. A third party abides by the rules applicable to its related participant under the Grant Agreement with regard to eligibility of costs and control of expenditure.

IDEMIA IDENTITY & SECURITY FRANCE
France
Net EU contribution
€ 161 875,00
Address
2, Place Samuel De Champlain
92400 Courbevoie

See on map

Region
Ile-de-France Ile-de-France Hauts-de-Seine
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Non-EU contribution
€ 69 375,00
HOROWITZ BIOMETRICS LIMITED

Participation ended

United Kingdom
Net EU contribution
€ 309 687,21
Address
364a High Road
NW10 2EA London

See on map

SME

The organization defined itself as SME (small and medium-sized enterprise) at the time the Grant Agreement was signed.

Yes
Region
London Outer London — West and North West Brent
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Non-EU contribution
€ 132 723,09
SIVECO ROMANIA SA
Romania
Net EU contribution
€ 472 688,01
Address
Soseaua Bucuresti-ploiesti 73-81 Complex Victoria Park Corp Cladire C4 Sector 1
013685 Bucuresti

See on map

Region
Macroregiunea Trei Bucureşti-Ilfov Bucureşti
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Non-EU contribution
€ 202 580,57
TECH INSPIRE LTD
United Kingdom
Net EU contribution
€ 376 905,01
Address
Hamilton House, Mabledon Place
WC1H 9BB London

See on map

SME

The organization defined itself as SME (small and medium-sized enterprise) at the time the Grant Agreement was signed.

Yes
Region
London Inner London — West Camden and City of London
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Non-EU contribution
€ 161 530,72
REALEYES OU
Estonia
Net EU contribution
€ 116 484,38
Address
Vahe 15
11615 Tallinn

See on map

SME

The organization defined itself as SME (small and medium-sized enterprise) at the time the Grant Agreement was signed.

Yes
Region
Eesti Eesti Põhja-Eesti
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Non-EU contribution
€ 49 921,87
Third-party

Legal entity other than a subcontractor which is affiliated or legally linked to a participant. The entity carries out work under the conditions laid down in the Grant Agreement, supplies goods or provides services for the action, but did not sign the Grant Agreement. A third party abides by the rules applicable to its related participant under the Grant Agreement with regard to eligibility of costs and control of expenditure.

REALEYES KFT
Hungary
Net EU contribution
€ 116 484,38
Address
Tolgyfa Utca 24
1027 Budapest

See on map

SME

The organization defined itself as SME (small and medium-sized enterprise) at the time the Grant Agreement was signed.

Yes
Region
Közép-Magyarország Budapest Budapest
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Non-EU contribution
€ 49 921,87
NOVA TELECOMMUNICATIONS SINGLE MEMBER SA
Greece
Net EU contribution
€ 199 937,50
Address
Extension Of Manis Street
153 51 Athens/ Kantza Pallinis

See on map

Region
Ανατολική Αττική Aττική Αττική
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Non-EU contribution
€ 85 687,50
INSTITUTUL NATIONAL DE CERCETARE-DEZVOLTARE PENTRU FIZICA SI INGINERIE NUCLEARA-HORIA HULUBEI
Romania
Net EU contribution
€ 206 650,00
Address
Strada Reactorului 30
077125 Magurele Ilfov

See on map

Region
Macroregiunea Trei Bucureşti-Ilfov Ilfov
Activity type
Research Organisations
Non-EU contribution
€ 0,00
IDRYMA TECHNOLOGIAS KAI EREVNAS
Greece
Net EU contribution
€ 381 050,00
Address
N Plastira Str 100
70013 Irakleio

See on map

Region
Ηράκλειο Κρήτη Νησιά Αιγαίου
Activity type
Research Organisations
Non-EU contribution
€ 0,00
UNIVERSITY COLLEGE LONDON
United Kingdom
Net EU contribution
€ 310 601,28
Address
Gower Street
WC1E 6BT London

See on map

Region
London Inner London — West Camden and City of London
Activity type
Higher or Secondary Education Establishments
Non-EU contribution
€ 0,00
INSTITUT MINES-TELECOM
France
Net EU contribution
€ 460 812,50
Address
19 Place Marguerite Perey
91120 Palaiseau

See on map

Region
Ile-de-France Ile-de-France Essonne
Activity type
Higher or Secondary Education Establishments
Non-EU contribution
€ 0,00
VOICETRUST GMBH
Germany
Net EU contribution
€ 157 500,00
Address
Hofmannstrasse 25-27
81379 Munchen

See on map

SME

The organization defined itself as SME (small and medium-sized enterprise) at the time the Grant Agreement was signed.

Yes
Region
Bayern Oberbayern München, Kreisfreie Stadt
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Non-EU contribution
€ 67 500,00