Skip to main content

Personalised Content Creation for the Deaf Community in a Connected Digital Single Market

Objective

Improving the accessibility of content for the Deaf community is an important goal for both EU governments and broadcast industry regulators. Although legislation is being used to coerce content producers and broadcasters to do so, the cost of producing sign-language content and the negative impact of having a sign-interpreter appearing on the content for hearing individuals has relegated sign-language programming to late nights or a small number of sign-presented programs. A low-cost solution for personalized sign-interpreted content creation can address both of these problems, leading to greater accessibility to media content for Deaf users.

CONTENT4ALL proposes such a solution to the problem in the short-term, which is also commericalizable, and proposes innovations to technologies that can lead to automated sign-translation capabilities in long-term. To this end, it builds upon the technologies demonstrated by the consortium partners in previous EU projects.

As a first development a remote signing apparatus (located off-premises of the broadcaster) will be produced to capture a human sign-interpreter’s signs, pose and facial expressions and to parameterize this information. Then, it will be rendered photo-realistically as a 3D representation of the human sign-interpreter at the broadcaster for production of the personalized stream for Deaf users.
While this solution can be used commercially, resulting datasets will provide a vast source of information for learning how to parameterize sign information for translation purposes.

The second development of CONTENT4ALL will focus on advancing the algorithms/models used to do so, with the intent to create an open dataset for further research into automated signing.

Finally, CONTENT4ALL will demonstrate automated sign-translation applied to a real-world TV broadcasting scenario, which is envisaged to lead to new approaches and innovations in the area in the long-run.

Call for proposal

H2020-ICT-2016-2017

See other projects for this call

Sub call

H2020-ICT-2016-2

Coordinator

FINCONS GROUP AG
Net EU contribution
€ 671 212,50
Address
Bahnhofstrasse 57
6403 Kussnacht
Switzerland

See on map

Region
Schweiz/Suisse/Svizzera Zentralschweiz Schwyz
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Other funding
€ 287 662,50

Participants (5)

UNIVERSITY OF SURREY
United Kingdom
Net EU contribution
€ 983 750,00
Address
Stag Hill
GU2 7XH Guildford

See on map

Region
South East (England) Surrey, East and West Sussex West Surrey
Activity type
Higher or Secondary Education Establishments
Other funding
€ 0,00
FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV
Germany
Net EU contribution
€ 651 377,50
Address
Hansastrasse 27c
80686 Munchen

See on map

Region
Bayern Oberbayern München, Kreisfreie Stadt
Activity type
Research Organisations
Other funding
€ 0,00
HFC HUMAN-FACTORS-CONSULT GMBH
Germany
Net EU contribution
€ 278 600,00
Address
Köpenicker Straße 325
12555 Berlin

See on map

SME

The organization defined itself as SME (small and medium-sized enterprise) at the time the Grant Agreement was signed.

Yes
Region
Berlin Berlin Berlin
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Other funding
€ 119 400,00
SWISS TXT AG
Switzerland
Net EU contribution
€ 578 287,50
Address
Alexander Schoni Strasse 40
2501 Biel Bienne

See on map

Region
Schweiz/Suisse/Svizzera Espace Mittelland Bern / Berne
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Other funding
€ 247 837,50
DE VLAAMSE RADIO EN TELEVISIEOMROEPORGANISATIE NV
Belgium
Net EU contribution
€ 336 629,13
Address
Auguste Reyerslaan 52
1043 Brussel

See on map

Region
Région de Bruxelles-Capitale/Brussels Hoofdstedelijk Gewest Région de Bruxelles-Capitale/ Brussels Hoofdstedelijk Gewest Arr. de Bruxelles-Capitale/Arr. Brussel-Hoofdstad
Activity type
Other
Other funding
€ 18 370,87