Skip to main content
European Commission logo print header

Action Recognition and Tracking based on Time-of-flight Sensors

Project description

Multimodal Interfaces

Based on a new type of award-winning sensor technology, the time-of-flight (TOF) camera, ARTTS will develop algorithms and prototype systems to solve open computer-vision problems and enable new applications that involve multimodal interfaces and the sensing of people and their actions. Unlike a conventional video camera, the TOF camera delivers not only an intensity image but also a range map that contains a distance measurement at each pixel, obtained by measuring the time required by light to reach the object and return to the camera (time-of-flight principle).Intelligent recognition and tracking solutions developed for TOF cameras will provide a crucial enabling technology for multimodal interfaces. The current state-of-the-art 3D TOF systems will be considerably improved so as to increase the resolution and quality of the signal and to reduce size, power consumption, and cost. A prototype of the improved system will be developed and released within the ARTTS project. Advanced signal processing methods will increase the quality of the signal and derive the features needed for the subsequent development of algorithms that can track people and recognize their activity. Finally, two further prototypes will be developed and released. One will track head and eye movements, the other will be able to monitor the actions of people in a room and thus provide an interactive interface.The consortium has evolved from a Network of Excellence, all partners have known each other for some time, and some have collaborated extensively in related projects. They bring in exactly the expertise required here.ARTTS will contribute to a large number of IST Strategic Objectives and Proactive Initiatives by developing technology that will enable the natural interaction between humans and their environment on the basis of easy-to-use interfaces and ambient intelligence.

Call for proposal

See other projects for this call



Ratzeburger allee 140
23569 L�beck

See on map

Activity type
Higher or Secondary Education Establishments
EU contribution
No data

Participants (4)