Project description Cognitive Systems, Interaction, RoboticsThe overall goal of SignSpeak is to develop a new vision-based technology for recognizing and translating continuous sign language to text. Show the project objective Hide the project objective Deaf communities revolve around sign languages as they are their natural means of communication. Although deaf, hard of hearing and hearing signers can communicate without boundaries amongst themselves, there is a serious challenge for the deaf community in trying to integrate into educational, social and work environments, as the vast majority of Europeans do not have signing skills. The overall goal of SignSpeaker is to develop a new vision-based technology for translating continuous sign language to text, in order to improve the communication between deaf and hearing communities. To this end, at the beginning of the project a new scientific study will be carried out to increase the linguistic understanding of sign languages; this new knowledge about the nature of sign language structure from the perspective of machine recognition of continuous sign language is crucial for a further development of sign-language-to-text technologies. The breakthrough in the understanding of sign language will allow a subsequent breakthrough in the development a new vision-based technology for continuous sign language recognition and translation to text. The SignSpeaker system will track the dominant and non-dominant hand, as well as facial expressions and body posture, taking into account the signs performed before and after or, in other words, taking into account the context in which a sign has been realised; the new technology will be also signer and ambient-independent. SignSpeaker will be the first step to approach sign language recognition and translation to the levels already obtained in similar technologies like translating from text-to-speech and speech-to-text. But the impact of SignSpeaker's results is much broader than the unique application in sign languages, because the results have also important applications in the industry for improving human-machine communication by gesture and for an automatic object and body part recognition and tracking in video streams. Fields of science humanitieslanguages and literaturelinguisticssign language Programme(s) FP7-ICT - Specific Programme "Cooperation": Information and communication technologies Topic(s) ICT-2007.2.2 - Cognitive systems, interaction, robotics Call for proposal FP7-ICT-2007-3 See other projects for this call Funding Scheme CP - Collaborative project (generic) Coordinator Contact Philippe DREUW Mr. Coordinator RHEINISCH-WESTFAELISCHE TECHNISCHE HOCHSCHULE AACHEN Address Templergraben 55 52062 Aachen Germany See on map Region Nordrhein-Westfalen Köln Städteregion Aachen Activity type Higher or Secondary Education Establishments Administrative Contact Philippe Dreuw (Mr.) Links Contact the organisation Opens in new window Website Opens in new window EU contribution No data Participants (6) Sort alphabetically Sort by EU Contribution Expand all Collapse all UNIVERSITAET INNSBRUCK Austria EU contribution € 284 806,00 Address Innrain 52 6020 Innsbruck See on map Region Westösterreich Tirol Innsbruck Activity type Higher or Secondary Education Establishments Administrative Contact Boris Puschitz (Mr.) Links Contact the organisation Opens in new window Website Opens in new window Other funding No data UNIVERSITE DE LIEGE Participation ended Belgium EU contribution € 190 622,00 Address Place du 20 aout 7 4000 Liege See on map Region Région wallonne Prov. Liège Arr. Liège Activity type Higher or Secondary Education Establishments Administrative Contact ISABELLE HALLEUX (Dr.) Links Contact the organisation Opens in new window Website Opens in new window Other funding No data EUROPEAN UNION OF THE DEAF AISBL Belgium EU contribution € 120 892,00 Address Wetstraat 26 15 1040 Brussels / bruxelles See on map Region Région de Bruxelles-Capitale/Brussels Hoofdstedelijk Gewest Région de Bruxelles-Capitale/ Brussels Hoofdstedelijk Gewest Arr. de Bruxelles-Capitale/Arr. Brussel-Hoofdstad Activity type Research Organisations Administrative Contact MARK WHEATLEY (Mr.) Links Contact the organisation Opens in new window Other funding No data TELEFONICA INVESTIGACION Y DESARROLLO SA Spain EU contribution € 137 277,00 Address Ronda de la comunicacion s/n distrito c edificio oeste i 28050 Madrid See on map Region Comunidad de Madrid Comunidad de Madrid Madrid Activity type Private for-profit entities (excluding Higher or Secondary Education Establishments) Administrative Contact Luis LOPEZ DE AYALA HIDALGO (Mr.) Links Contact the organisation Opens in new window Website Opens in new window Other funding No data NTRAM GENERAL S.A. Spain EU contribution € 682 706,00 Address Calle victor pradera 45 08940 Cornella de llobregat barcelona See on map Region Este Cataluña Barcelona Activity type Private for-profit entities (excluding Higher or Secondary Education Establishments) Administrative Contact Ivan Rica (Mr.) Links Contact the organisation Opens in new window Website Opens in new window Other funding No data STICHTING RADBOUD UNIVERSITEIT Netherlands EU contribution € 452 988,00 Address Houtlaan 4 6525 XZ Nijmegen See on map Region Oost-Nederland Gelderland Arnhem/Nijmegen Activity type Higher or Secondary Education Establishments Administrative Contact N. Schroder (Mr.) Links Contact the organisation Opens in new window Website Opens in new window Other funding No data
