CORDIS
EU research results

CORDIS

English EN
Personalised Content Creation for the Deaf Community in a Connected Digital Single Market

Personalised Content Creation for the Deaf Community in a Connected Digital Single Market

Objective

Improving the accessibility of content for the Deaf community is an important goal for both EU governments and broadcast industry regulators. Although legislation is being used to coerce content producers and broadcasters to do so, the cost of producing sign-language content and the negative impact of having a sign-interpreter appearing on the content for hearing individuals has relegated sign-language programming to late nights or a small number of sign-presented programs. A low-cost solution for personalized sign-interpreted content creation can address both of these problems, leading to greater accessibility to media content for Deaf users.

CONTENT4ALL proposes such a solution to the problem in the short-term, which is also commericalizable, and proposes innovations to technologies that can lead to automated sign-translation capabilities in long-term. To this end, it builds upon the technologies demonstrated by the consortium partners in previous EU projects.

As a first development a remote signing apparatus (located off-premises of the broadcaster) will be produced to capture a human sign-interpreter’s signs, pose and facial expressions and to parameterize this information. Then, it will be rendered photo-realistically as a 3D representation of the human sign-interpreter at the broadcaster for production of the personalized stream for Deaf users.
While this solution can be used commercially, resulting datasets will provide a vast source of information for learning how to parameterize sign information for translation purposes.

The second development of CONTENT4ALL will focus on advancing the algorithms/models used to do so, with the intent to create an open dataset for further research into automated signing.

Finally, CONTENT4ALL will demonstrate automated sign-translation applied to a real-world TV broadcasting scenario, which is envisaged to lead to new approaches and innovations in the area in the long-run.
Leaflet | Map data © OpenStreetMap contributors, Credit: EC-GISCO, © EuroGeographics for the administrative boundaries

Coordinator

FINCONS GROUP AG

Address

Bahnhofstrasse 57
6403 Kussnacht

Switzerland

Activity type

Other

EU Contribution

€ 659 312,50

Participants (5)

Sort alphabetically

Sort by EU Contribution

Expand all

UNIVERSITY OF SURREY

United Kingdom

EU Contribution

€ 983 750

FRAUNHOFER GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.

Germany

EU Contribution

€ 651 377,50

HFC HUMAN-FACTORS-CONSULT GMBH

Germany

EU Contribution

€ 294 000

SWISS TXT AG

Switzerland

EU Contribution

€ 574 787,50

DE VLAAMSE RADIO EN TELEVISIEOMROEPORGANISATIE NV

Belgium

EU Contribution

€ 336 629,13

Project information

Grant agreement ID: 762021

Status

Ongoing project

  • Start date

    1 September 2017

  • End date

    31 August 2020

Funded under:

H2020-EU.2.1.1.

  • Overall budget:

    € 4 173 127,50

  • EU contribution

    € 3 499 856,63

Coordinated by:

FINCONS GROUP AG

Switzerland