Skip to main content
Go to the home page of the European Commission (opens in new window)
English English
CORDIS - EU research results
CORDIS

SignON - Sign Language Translation Mobile Application and Open Communications Framework

Project description

Bridging the communication gap between the deaf and the hearing

People who are deaf or hard of hearing face the challenge of interacting with others in real-life situations and are often excluded from accessing information in society. The EU-funded SignON project aims to develop a mobile application that will translate between different European sign and verbal languages. The application, a lightweight software running on a standard mobile device, will interact with a cloud-based distributed framework dedicated to the computationally heavy tasks. The application and the framework will be designed through a co-creation approach where users will work together with the SignON researchers and engineers. The application will be easily adaptable to other languages (sign and spoken) and modalities and will ultimately promote equitable exchange of information among all European citizens.

Objective

Nowadays any communication barrier is detrimental to society. This project will research and develop the SignON communication service that uses machine translation to translate between Sign and spoken languages. This service will facilitate the exchange of information among deaf and hard of hearing, and hearing individuals. In this user-centric and community-driven project we will tightly collaborate with European deaf and hard of hearing communities to (re)define use-cases, co-design and co-develop the SignON service and application, assess the quality and validate their acceptance. Our ultimate objective is the fair, unbiased and inclusive spread of information and digital content in European society.
Our project will develop a free, open application and framework for conversion between video (capturing and understanding Sign language), audio and text and translation between Sign and spoken languages. To facilitate these tasks we propose a common representation for mapping of video, audio and text into a unified space, that will be used for translating into the target modality and language. To ensure wide uptake, improved sign language detection and synthesis, as well as multilingual speech processing on mobile devices for everyone, we will deploy the SignON service as a smart phone application running on standard modern devices. We envisage the application as a light-weight interface. The SignON framework, however, will be distributed on the cloud where the computationally intensive tasks will be executed.The project will be driven by a focused set of use-cases tailored towards the deaf communities. We target the Irish, British, Dutch, Flemish and Spanish Sign and English, Irish, Dutch, Spanish spoken languages. However, SignON will incorporate sophisticated machine learning capabilities that will allow (i) learning new Sign, written and spoken languages; (ii) style-, domain- and user-adaptation and (iii) automatic error correction, based on user feedback

Fields of science (EuroSciVoc)

CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: https://op.europa.eu/en/web/eu-vocabularies/euroscivoc.

You need to log in or register to use this function

Keywords

Project’s keywords as indicated by the project coordinator. Not to be confused with the EuroSciVoc taxonomy (Fields of science)

Programme(s)

Multi-annual funding programmes that define the EU’s priorities for research and innovation.

Topic(s)

Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.

Funding Scheme

Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.

RIA - Research and Innovation action

See all projects funded under this funding scheme

Call for proposal

Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.

(opens in new window) H2020-ICT-2018-20

See all projects funded under this call

Coordinator

DUBLIN CITY UNIVERSITY
Net EU contribution

Net EU financial contribution. The sum of money that the participant receives, deducted by the EU contribution to its linked third party. It considers the distribution of the EU financial contribution between direct beneficiaries of the project and other types of participants, like third-party participants.

€ 430 755,00
Address
Glasnevin
9 Dublin
Ireland

See on map

Region
Ireland Eastern and Midland Dublin
Activity type
Higher or Secondary Education Establishments
Links
Total cost

The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.

€ 430 755,00

Participants (15)

My booklet 0 0