Project description
Cognitive Systems, Interaction, Robotics
The overall goal of SignSpeak is to develop a new vision-based technology for recognizing and translating continuous sign language to text.
Deaf communities revolve around sign languages as they are their natural means of communication. Although deaf, hard of hearing and hearing signers can communicate without boundaries amongst themselves, there is a serious challenge for the deaf community in trying to integrate into educational, social and work environments, as the vast majority of Europeans do not have signing skills. The overall goal of SignSpeaker is to develop a new vision-based technology for translating continuous sign language to text, in order to improve the communication between deaf and hearing communities. To this end, at the beginning of the project a new scientific study will be carried out to increase the linguistic understanding of sign languages; this new knowledge about the nature of sign language structure from the perspective of machine recognition of continuous sign language is crucial for a further development of sign-language-to-text technologies. The breakthrough in the understanding of sign language will allow a subsequent breakthrough in the development a new vision-based technology for continuous sign language recognition and translation to text. The SignSpeaker system will track the dominant and non-dominant hand, as well as facial expressions and body posture, taking into account the signs performed before and after or, in other words, taking into account the context in which a sign has been realised; the new technology will be also signer and ambient-independent. SignSpeaker will be the first step to approach sign language recognition and translation to the levels already obtained in similar technologies like translating from text-to-speech and speech-to-text. But the impact of SignSpeaker's results is much broader than the unique application in sign languages, because the results have also important applications in the industry for improving human-machine communication by gesture and for an automatic object and body part recognition and tracking in video streams.
Fields of science (EuroSciVoc)
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: https://op.europa.eu/en/web/eu-vocabularies/euroscivoc.
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: https://op.europa.eu/en/web/eu-vocabularies/euroscivoc.
You need to log in or register to use this function
We are sorry... an unexpected error occurred during execution.
You need to be authenticated. Your session might have expired.
Thank you for your feedback. You will soon receive an email to confirm the submission. If you have selected to be notified about the reporting status, you will also be contacted when the reporting status will change.
Programme(s)
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
Topic(s)
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Call for proposal
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
FP7-ICT-2007-3
See other projects for this call
Funding Scheme
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
Coordinator
52062 Aachen
Germany
The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.