Skip to main content
Go to the home page of the European Commission (opens in new window)
English English
CORDIS - EU research results
CORDIS
Content archived on 2024-06-18

Sign Language Recognition, Generation and Modelling \n with application in Deaf Communication

Project description


Cognitive Systems, Interaction, Robotics
Dicta-Sign's goal is to develop the necessary technologies that make Web 2.0 interactions in sign language possible.

Dicta-Sign addresses the need for communication between deaf individuals and communication via natural language by deaf users with various HCI environments. It will research and develop recognition and synthesis engines for sign languages (SLs) at a level of detail necessary for recognising and generating authentic signing. Research outcomes will be integrated in three laboratory prototypes (a Search-by-Example tool, a SL-to-SL translator and a sign-Wiki) leading to a practical project demonstrator.Dicta-Sign will be based on research novelties in sign recognition and generation exploiting significant linguistic knowledge and coded SL resources. Interoperation of several scientific domains is required in order to combine linguistic knowledge with computer vision for image/video analysis for continuous sign recognition, and with computer graphics for realistic avatar animation. Coding of SL linguistic knowledge requires exploitation of annotated parallel video corpora for four SLs (BSL, DGS, GSL and LSF), linked to common grammar and lexicon modules created to feed both recognition and synthesis engines.These resources will also be applied, by exploiting multilingual syntactic and lexical interrelations, to domain-specific SL-to-SL machine translation. Sign input will be extended by integrating continuous sign recognition with multi-modal fusion and signer adaptation. Sign recognition technology will also help with annotation procedures and tools developed within the project as a necessary support for adequate corpus construction and data access. Procedural sign synthesis will be extended by further development of current state-of-the-art representations of manual signing elements in order to achieve close-to-natural signing, including non-manual features of eye gaze, mouthing patterns and body postures. Prototypes and the demonstrator will validate the interaction between sign recognition, linguistic modelling, and sign synthesis.

Fields of science (EuroSciVoc)

CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: https://op.europa.eu/en/web/eu-vocabularies/euroscivoc.

You need to log in or register to use this function

Programme(s)

Multi-annual funding programmes that define the EU’s priorities for research and innovation.

Topic(s)

Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.

Call for proposal

Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.

FP7-ICT-2007-3
See other projects for this call

Funding Scheme

Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.

CP - Collaborative project (generic)

Coordinator

ATHINA-EREVNITIKO KENTRO KAINOTOMIAS STIS TECHNOLOGIES TIS PLIROFORIAS, TON EPIKOINONION KAI TIS GNOSIS
EU contribution
€ 423 200,00
Address
ARTEMIDOS 6 KAI EPIDAVROU
151 25 MAROUSSI
Greece

See on map

Region
Αττική Aττική Βόρειος Τομέας Αθηνών
Activity type
Research Organisations
Links
Total cost

The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.

No data

Participants (7)

My booklet 0 0