Community Research and Development Information Service - CORDIS

FP7 Improving robot sensing systems with real 3D foveation properties

TACO

Project reference: 248623
Funded under: FP7-ICT

Threedimensional Adaptive Camera with Object Detection and Foveation [Print to PDF] [Print to RTF]

From 2010-02-01 to 2013-07-31

Project details

Total cost:

EUR 4 791 835

EU contribution:

EUR 3 572 000

Coordinated in:

Austria

Call for proposal:

FP7-ICT-2009-4

Funding scheme:

CP - Collaborative project (generic)

Giving robots faster, more human-like vision through foveation

TACO develops a 3D sensing system with 3D foveation properties endowing service robots with a higher level of motion and affordance perception and interaction capabilities with respect to everyday objects and environments in a more natural and human-like manner. The system will be able to acquire 3D images with coarse level of details, applying fast object recognition techniques to identify areas of interest and then concentrate the image acquisition on details of interest allowing for higher resolution 3D sampling of these details.

The project will verify and test the 3D sensing system in a robotic environment, exploring the capabilities of the system to allow the robot to navigate autonomously and interact with a diverse number of everyday objects.

Objective

TACO develops a 3D sensing system with real 3D foveation properties endowing service robots with a higher level of motion and affordance perception and interaction capabilities with respect to everyday objects and environments. By 3D foveation properties we mean properties based on the process of acquiring 3D images with coarse level of details, applying fast object recognition techniques to identify areas of interest in the coarse 3D image and then concentrate the image acquisition on details of interest allowing for higher resolution 3D sampling of these details. This new 3D foveation concept will allow robots to interact with everyday environments in a more natural and human-like manner, increasing the level of detail whenever needed for interaction between the robot and everyday objects and humans. These 3D foveation properties are achieved by utilising the power of micro-mirror MEMS technology combined with state-of-the-art time-of-flight methods to ensure a system that is small, light-weight and easily mounted on an ordinary-sized service robot or even a robot arm. The project will explore control strategies for 3D foveation allowing 3D robot vision that is adaptable with space- and time-variant sampling, processing and understanding. The project will verify and test the 3D sensing system in a robotic environment, exploring the capabilities of the system to allow the robot to navigate autonomously and interact with a diverse number of everyday objects. The TACO consortium has RTD partners and industrial end users: Fraunhofer IPMS (micro-mirror scanning device), Fraunhofer IPM (3D range sensors), CTR (Electronics), SINTEF (3D foveation software), TU Wien (benchmarking with state-of-the-art 3D sensing methods), Shadow Robotics (application towards robot grippers) and Oxford Technologies (application towards robots for harsh environments)

Related information

Documents and Publications

Open Access

Coordinator

TECHNIKON FORSCHUNGS- UND PLANUNGSGESELLSCHAFT MBH
Austria
BURGPLATZ 3A
VILLACH, Austria
Administrative contact: Klaus-Michael Koch
Tel.: +43 4242 233 55
Fax: +43 4242 233 55 77
E-mail

Participants

TECHNISCHE UNIVERSITAET WIEN
Austria
Karlsplatz
WIEN, Austria
Administrative contact: Markus Vincze
Tel.: +43 1 58801 37661
Fax: +43 1 58801 37697
E-mail
CTR CARINTHIAN TECH RESEARCH AG
Austria
EUROPASTRASSE
VILLACH SANKT MAGDALEN, Austria
Administrative contact: SIMON GRASSER
Tel.: +43 4242 56300
E-mail
FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V
Germany
Hansastrasse
MUENCHEN, Germany
Administrative contact: Christoph Schulte
Tel.: +49 89 1205 2728
Fax: +49 89 1205 7534
E-mail
STIFTELSEN SINTEF
Norway
Strindveien
TRONDHEIM, Norway
Administrative contact: Jens T. Thielemann
Tel.: +47 2206 7477
Fax: +47 2206 7350
E-mail
OXFORD TECHNOLOGIES LTD
United Kingdom
Picklers Hill
ABINGDON, United Kingdom
Administrative contact: ALAN ROLFE
Tel.: +44 1235 544872
Fax: +44 1235 522124
E-mail
THE SHADOW ROBOT COMPANY LIMITED
United Kingdom
IDA Road
London, United Kingdom
Administrative contact: Rich Walker
Tel.: +44 207 700 2487
E-mail
Record Number: 93711 / Last updated on: 2014-10-07