SiMAX - The Sign Language Avatar

Información del proyecto

SiMAX

Identificador del acuerdo de subvención: 778421

DOI

10.3030/778421

Proyecto cerrado

Fecha de la firma de la CE 17 Agosto 2017

Fecha de inicio 1 Septiembre 2017

Fecha de finalización 29 Febrero 2020

Financiado con arreglo a

• INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Coste total

€ 1 563 372,50

Aportación de la UE

€ 1 094 360,75

Coordinado por

Sign time GmbH
Austria

Periodic Reporting for period 2 - SiMAX (SiMAX - The Sign Language Avatar)

Período documentado: 2018-09-01 hasta 2020-02-29

Resumen del contexto y de los objetivos generales del proyecto

Deaf people need sign language because they have difficulty understanding texts. 80% of deaf people are functionally illiterate.
In order to make information accessible to the deaf, companies, the media, public authorities, etc. must have it translated into sign language. Conventional methods of translation with interpreters in film studios are time-consuming and expensive.
Sign Time's goal is to develop a semi-automated sign language translation system and make it available as a cloud service. The translations are represented by an animated figure, an avatar in sign language.

Accessibility is an increasingly important value in society. With traditional methods, only a very small part of our digital information can be made accessible to the deaf.
With our technology it will be possible to translate mass content into sign language, as the costs are very low. In the long run it should be possible to translate almost any text into sign language. Since our system is adaptive, it becomes better with each application and thus faster and more economical. This will make it possible in the long term to make all digital content on the web accessible to the deaf. Worldwide.

Trabajo realizado desde el comienzo del proyecto hasta el final del período abarcado por el informe y los principales resultados hasta la fecha

Based on feedback from deaf people, a new avatar with special features was developed. This meets the requirements of the target group much better and receives very high approval values.

There were additionally 3 deaf persons trained to 3D animators. These produce the vocabulary of sign language. Since they use sign language themselves, they have better insight into this activity.
We have developed a quality management system for the creation of sign language vocabulary, which is managed by a deaf sign language translator. This ensures that our product meets the highest quality requirements at the module level.

Our existing translation software SiMAX was programmed into a first cloud-capable version.
Over 3,000 signs were animated as sign language vocabulary and are available for translation.

We implemented two pilot projects:
https://vimeo.com/263871219/e8c5efefde
https://vimeo.com/265404730

Dissemination:

We have presented our development at various international conferences and trade fairs, including the Mobile Word Congress in Barcelona, the Web Summit in Lisbon, the Innovator Summit in Berlin, trade fairs in Karlsruhe and Berlin, the RISE Conference in Hong Kong and many more. TV reports about us were shown in Austria and Hong Kong.
We have created and published GIFs animated by individual gestures. These can be used with different messengers like WhatsApp and Facebook Messenger like emoties. We got more than 270,000 hits so far. See https://giphy.com/simax

Avances que van más allá del estado de la técnica e impacto potencial esperado (incluida la repercusión socioeconómica y las implicaciones sociales más amplias del proyecto hasta la fecha)

We have the world's first functioning system for the semi-automatic translation of text into animated sign language. The system will be further developed and adapted for different sign languages.
On the one hand, the aim is to make all available digital texts in sign languages accessible to deaf people all over the world. This will give them equal access to all information.
On the other hand, all companies, organisations, media and individuals should be able to communicate barrier-free in the interest of the deaf at very low cost. This is not only prescribed by law, it is also required by a modern society without discrimination.

Sign language happy

Sign language how are you

Sign language i love you