Project description
Breaking barriers to empower the Deaf community
In a world where content remains largely inaccessible to the Deaf community, the EU-funded Content4All project emerges as a game-changer, revolutionising the landscape of media content. Governments and broadcast regulators have long struggled to provide sign-language programming without alienating hearing viewers. Late-night slots and a limited number of sign-presented programmes have been the unfortunate norm. But now, Content4All steps up to the plate with a ground breaking solution. By leveraging innovative technologies and a cost-effective approach, it aims to create personalised, lifelike sign-interpreted content. This game changing project not only promises greater accessibility for Deaf users but will also open doors to automated sign-translation capabilities and foster long-term advancements in the industry. Get ready for a transformative revolution in media accessibility.
Objective
Improving the accessibility of content for the Deaf community is an important goal for both EU governments and broadcast industry regulators. Although legislation is being used to coerce content producers and broadcasters to do so, the cost of producing sign-language content and the negative impact of having a sign-interpreter appearing on the content for hearing individuals has relegated sign-language programming to late nights or a small number of sign-presented programs. A low-cost solution for personalized sign-interpreted content creation can address both of these problems, leading to greater accessibility to media content for Deaf users.
CONTENT4ALL proposes such a solution to the problem in the short-term, which is also commericalizable, and proposes innovations to technologies that can lead to automated sign-translation capabilities in long-term. To this end, it builds upon the technologies demonstrated by the consortium partners in previous EU projects.
As a first development a remote signing apparatus (located off-premises of the broadcaster) will be produced to capture a human sign-interpreter’s signs, pose and facial expressions and to parameterize this information. Then, it will be rendered photo-realistically as a 3D representation of the human sign-interpreter at the broadcaster for production of the personalized stream for Deaf users.
While this solution can be used commercially, resulting datasets will provide a vast source of information for learning how to parameterize sign information for translation purposes.
The second development of CONTENT4ALL will focus on advancing the algorithms/models used to do so, with the intent to create an open dataset for further research into automated signing.
Finally, CONTENT4ALL will demonstrate automated sign-translation applied to a real-world TV broadcasting scenario, which is envisaged to lead to new approaches and innovations in the area in the long-run.
Fields of science
Keywords
Programme(s)
Funding Scheme
IA - Innovation actionCoordinator
6403 Kussnacht
Switzerland