Skip to main content
European Commission logo print header

Sign language recognition from real-time video

Final Activity Report Summary - TALKING HANDS (Sign Language Recognition from Real-time video)

The aim of this project was to produce a computer-based sign language translation system, which can translate sign language to text. The human user performs gestures from sign language in front of a single video camera attached to a personal computer and the computer displays an English translation.

Our most important achievement was to produce a live demo system, which can run on a laptop and has been shown to work in real-time in a number of different locations. We introduced methods to detect human skin colour and to describe hand motion and shape. We hope that our system will eventually allow deaf and hearing people to communicate more easily.