Skip to main content
Go to the home page of the European Commission (opens in new window)
English English
CORDIS - EU research results
CORDIS
Content archived on 2024-06-18

Probabilistic and Compositional Representations of Objects for Robotic Manipulation

Project description


Cognitive Systems and Robotics

PaCMan will advance methods for object perception, representation and manipulation so that a robot is able to robustly manipulate objects even when those objects are unfamiliar, and even though the robot has unreliable perception and action. The project will develop two main strands of work: a multi-modal compositional, probabilistic representation of object properties to support perception and manipulation, and algorithms for reasoning with this representation, that will estimate object properties from visual and haptic data, and also plan how to actively gather information about shape and other object properties while achieving a task.

The challenge laid out in this call for proposals is to advance technologies for, and understand the principles of cognition and control in complex systems. We will meet this challenge by advancing methods for object perception, representation and manipulation so that a robot is able to robustly manipulate objects even when those objects are unfamiliar, and even though the robot has unreliable perception and action. The proposal is founded on two assumptions. The first of these is that the representation of the object's shape in particular and of other properties in general will benefit from being compositional (or very loosely hierarchical and part based). The second is that manipulation planning and execution benefits from explicitly reasoning about uncertainty in object pose, shape etcetera; how it changes under the robot's actions, and the robot should plan actions that not only achieve the task, but gather information to make task achievement more reliable.
These two assumptions are mirrored in the structure of the proposed work, as we will develop two main strands of work:
i) a multi-modal compositional, probabilistic representation of object properties to support perception and manipulation, and ii) algorithms for reasoning with this representation, that will estimate object properties from visual and haptic data, and also plan how to actively gather information about shape and other object properties (frictional coefficients, mass) while achieving a task. These two strands will be combined and tested on robots performing aspects of a dishwasher loading task. The outcome will be robust manipulation (i.e. under unreliable perception and action) of unfamiliar objects from familiar categories or with familiar parts.

Programme(s)

Multi-annual funding programmes that define the EU’s priorities for research and innovation.

Topic(s)

Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.

Call for proposal

Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.

FP7-ICT-2011-9
See other projects for this call

Funding Scheme

Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.

CP - Collaborative project (generic)

Coordinator

THE UNIVERSITY OF BIRMINGHAM
EU contribution
€ 1 451 962,00
Address
Edgbaston
B15 2TT Birmingham
United Kingdom

See on map

Region
West Midlands (England) West Midlands Birmingham
Activity type
Higher or Secondary Education Establishments
Links
Total cost

The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.

No data

Participants (2)

My booklet 0 0