Skip to main content
Go to the home page of the European Commission (opens in new window)
English English
CORDIS - EU research results
CORDIS
Content archived on 2024-06-18

Threedimensional Adaptive Camera with Object Detection and Foveation

Project description


Cognitive Systems and Robotics
Giving robots faster, more human-like vision through foveation

TACO develops a 3D sensing system with 3D foveation properties endowing service robots with a higher level of motion and affordance perception and interaction capabilities with respect to everyday objects and environments in a more natural and human-like manner. The system will be able to acquire 3D images with coarse level of details, applying fast object recognition techniques to identify areas of interest and then concentrate the image acquisition on details of interest allowing for higher resolution 3D sampling of these details.

The project will verify and test the 3D sensing system in a robotic environment, exploring the capabilities of the system to allow the robot to navigate autonomously and interact with a diverse number of everyday objects.

TACO develops a 3D sensing system with real 3D foveation properties endowing service robots with a higher level of motion and affordance perception and interaction capabilities with respect to everyday objects and environments. By 3D foveation properties we mean properties based on the process of acquiring 3D images with coarse level of details, applying fast object recognition techniques to identify areas of interest in the coarse 3D image and then concentrate the image acquisition on details of interest allowing for higher resolution 3D sampling of these details. This new 3D foveation concept will allow robots to interact with everyday environments in a more natural and human-like manner, increasing the level of detail whenever needed for interaction between the robot and everyday objects and humans. These 3D foveation properties are achieved by utilising the power of micro-mirror MEMS technology combined with state-of-the-art time-of-flight methods to ensure a system that is small, light-weight and easily mounted on an ordinary-sized service robot or even a robot arm. The project will explore control strategies for 3D foveation allowing 3D robot vision that is adaptable with space- and time-variant sampling, processing and understanding. The project will verify and test the 3D sensing system in a robotic environment, exploring the capabilities of the system to allow the robot to navigate autonomously and interact with a diverse number of everyday objects. The TACO consortium has RTD partners and industrial end users: Fraunhofer IPMS (micro-mirror scanning device), Fraunhofer IPM (3D range sensors), CTR (Electronics), SINTEF (3D foveation software), TU Wien (benchmarking with state-of-the-art 3D sensing methods), Shadow Robotics (application towards robot grippers) and Oxford Technologies (application towards robots for harsh environments)

Fields of science (EuroSciVoc)

CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: https://op.europa.eu/en/web/eu-vocabularies/euroscivoc.

You need to log in or register to use this function

Programme(s)

Multi-annual funding programmes that define the EU’s priorities for research and innovation.

Topic(s)

Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.

Call for proposal

Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.

FP7-ICT-2009-4
See other projects for this call

Funding Scheme

Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.

CP - Collaborative project (generic)

Coordinator

TECHNIKON FORSCHUNGS- UND PLANUNGSGESELLSCHAFT MBH
EU contribution
€ 384 687,00
Address
BURGPLATZ 3A
9500 VILLACH
Austria

See on map

Region
Südösterreich Kärnten Klagenfurt-Villach
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Links
Total cost

The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.

No data

Participants (6)

My booklet 0 0