Project description DEENESFRITPL Bridging the communication gap between the deaf and the hearing People who are deaf or hard of hearing face the challenge of interacting with others in real-life situations and are often excluded from accessing information in society. The EU-funded SignON project aims to develop a mobile application that will translate between different European sign and verbal languages. The application, a lightweight software running on a standard mobile device, will interact with a cloud-based distributed framework dedicated to the computationally heavy tasks. The application and the framework will be designed through a co-creation approach where users will work together with the SignON researchers and engineers. The application will be easily adaptable to other languages (sign and spoken) and modalities and will ultimately promote equitable exchange of information among all European citizens. Show the project objective Hide the project objective Objective Nowadays any communication barrier is detrimental to society. This project will research and develop the SignON communication service that uses machine translation to translate between Sign and spoken languages. This service will facilitate the exchange of information among deaf and hard of hearing, and hearing individuals. In this user-centric and community-driven project we will tightly collaborate with European deaf and hard of hearing communities to (re)define use-cases, co-design and co-develop the SignON service and application, assess the quality and validate their acceptance. Our ultimate objective is the fair, unbiased and inclusive spread of information and digital content in European society.Our project will develop a free, open application and framework for conversion between video (capturing and understanding Sign language), audio and text and translation between Sign and spoken languages. To facilitate these tasks we propose a common representation for mapping of video, audio and text into a unified space, that will be used for translating into the target modality and language. To ensure wide uptake, improved sign language detection and synthesis, as well as multilingual speech processing on mobile devices for everyone, we will deploy the SignON service as a smart phone application running on standard modern devices. We envisage the application as a light-weight interface. The SignON framework, however, will be distributed on the cloud where the computationally intensive tasks will be executed.The project will be driven by a focused set of use-cases tailored towards the deaf communities. We target the Irish, British, Dutch, Flemish and Spanish Sign and English, Irish, Dutch, Spanish spoken languages. However, SignON will incorporate sophisticated machine learning capabilities that will allow (i) learning new Sign, written and spoken languages; (ii) style-, domain- and user-adaptation and (iii) automatic error correction, based on user feedback Fields of science natural sciencescomputer and information sciencesartificial intelligencemachine learning Programme(s) H2020-EU.2.1.1. - INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT) Main Programme Topic(s) ICT-57-2020 - An empowering, inclusive Next Generation Internet Call for proposal H2020-ICT-2018-20 See other projects for this call Sub call H2020-ICT-2020-2 Funding Scheme RIA - Research and Innovation action Coordinator DUBLIN CITY UNIVERSITY Net EU contribution € 430 755,00 Address Glasnevin 9 Dublin Ireland See on map Region Ireland Eastern and Midland Dublin Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 0,00 Participants (16) Sort alphabetically Sort by Net EU contribution Expand all Collapse all FINCONS GROUP AG Switzerland Net EU contribution € 442 500,00 Address Bahnhofstrasse 57 6403 Kussnacht See on map Region Schweiz/Suisse/Svizzera Zentralschweiz Schwyz Activity type Private for-profit entities (excluding Higher or Secondary Education Establishments) Links Contact the organisation Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 0,00 STICHTING INSTITUUT VOOR DE NEDERLANDSE TAAL Netherlands Net EU contribution € 263 375,00 Address Rapenburg 61 2311 GJ Leiden See on map Region West-Nederland Zuid-Holland Agglomeratie Leiden en Bollenstreek Activity type Research Organisations Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 0,00 UNIVERSIDAD DEL PAIS VASCO/ EUSKAL HERRIKO UNIBERTSITATEA Spain Net EU contribution € 231 250,00 Address Barrio sarriena s n 48940 Leioa See on map Region Noreste País Vasco Bizkaia Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 0,00 THE NATIONAL MICROELECTRONICS APPLICATIONS CENTRE LTD Ireland Net EU contribution € 342 500,00 Address Suparule house, lonsdale road national technologicy park . Limerick See on map SME The organization defined itself as SME (small and medium-sized enterprise) at the time the Grant Agreement was signed. Yes Region Ireland Eastern and Midland Dublin Activity type Private for-profit entities (excluding Higher or Secondary Education Establishments) Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 0,00 UNIVERSIDAD POMPEU FABRA Spain Net EU contribution € 539 375,00 Address Placa de la merce, 10-12 08002 Barcelona See on map Region Este Cataluña Barcelona Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 0,00 TECHNOLOGICAL UNIVERSITY DUBLIN Ireland Net EU contribution € 269 758,75 Address North circular road 191 park house grangegorman D07 EWV4 Dublin See on map Region Ireland Eastern and Midland Dublin Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 0,00 THE PROVOST, FELLOWS, FOUNDATION SCHOLARS & THE OTHER MEMBERS OF BOARD, OF THE COLLEGE OF THE HOLY & UNDIVIDED TRINITY OF QUEEN ELIZABETH NEAR DUBLIN Ireland Net EU contribution € 242 236,25 Address College green trinity college D02 CX56 Dublin 2 See on map Region Ireland Eastern and Midland Dublin Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 0,00 DE VLAAMSE RADIO EN TELEVISIEOMROEPORGANISATIE NV Belgium Net EU contribution € 288 000,00 Address Auguste reyerslaan 52 1043 Brussels / bruxelles See on map Region Région de Bruxelles-Capitale/Brussels Hoofdstedelijk Gewest Région de Bruxelles-Capitale/ Brussels Hoofdstedelijk Gewest Arr. de Bruxelles-Capitale/Arr. Brussel-Hoofdstad Activity type Other Links Contact the organisation Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 0,00 UNIVERSITEIT GENT Belgium Net EU contribution € 331 295,00 Address Sint pietersnieuwstraat 25 9000 Gent See on map Region Vlaams Gewest Prov. Oost-Vlaanderen Arr. Gent Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 0,00 VLAAMS GEBARENTAALCENTRUM VZW Belgium Net EU contribution € 364 250,00 Address Sint-andriesstraat 2 2000 Antwerpen See on map Region Vlaams Gewest Prov. Antwerpen Arr. Antwerpen Activity type Research Organisations Links Contact the organisation Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 0,00 UNIVERSITY COLLEGE DUBLIN, NATIONAL UNIVERSITY OF IRELAND, DUBLIN Ireland Net EU contribution € 207 271,25 Address Belfield 4 Dublin See on map Region Ireland Eastern and Midland Dublin Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 0,00 STICHTING RADBOUD UNIVERSITEIT Netherlands Net EU contribution € 424 500,00 Address Houtlaan 4 6525 XZ Nijmegen See on map Region Oost-Nederland Gelderland Arnhem/Nijmegen Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 0,00 NEDERLANDSE TAALUNIE Netherlands Net EU contribution € 94 500,00 Address Paleisstraat 9 2514JA Den haag See on map SME The organization defined itself as SME (small and medium-sized enterprise) at the time the Grant Agreement was signed. Yes Region West-Nederland Zuid-Holland Agglomeratie ’s-Gravenhage Activity type Public bodies (excluding Research Organisations and Secondary or Higher Education Establishments) Links Contact the organisation Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 0,00 KATHOLIEKE UNIVERSITEIT LEUVEN Belgium Net EU contribution € 492 800,00 Address Oude markt 13 3000 Leuven See on map Region Vlaams Gewest Prov. Vlaams-Brabant Arr. Leuven Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 0,00 EUROPEAN UNION OF THE DEAF AISBL Belgium Net EU contribution € 373 500,00 Address Wetstraat 26 15 1040 Brussels / bruxelles See on map Region Région de Bruxelles-Capitale/Brussels Hoofdstedelijk Gewest Région de Bruxelles-Capitale/ Brussels Hoofdstedelijk Gewest Arr. de Bruxelles-Capitale/Arr. Brussel-Hoofdstad Activity type Research Organisations Links Contact the organisation Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 0,00 TILBURG UNIVERSITY- UNIVERSITEIT VAN TILBURG Netherlands Net EU contribution € 278 852,50 Address Warandelaan 2 5037 AB Tilburg See on map Region Zuid-Nederland Noord-Brabant Midden-Noord-Brabant Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Other funding € 0,00