Skip to main content
European Commission logo print header

Learning and Execution of Action Categories

Descrizione del progetto


Cognitive Systems and Robotics

ACAT focuses on the problem of how artificial systems (robots) can understand and utilize information made for humans. The ultimate purpose of ACAT is to equip a robot – on an on-going basis – with abstract, functional knowledge about relations between actions and objects, leading to a system which can act meaningfully. The robot will be able to partially take over human tasks without time-consuming programming procedures improving the efficiency of industrial processes. The main outcome of ACAT will be a robot-compiler which translates human understandable information into a robot-executable program.

ACAT focuses on the problem how artificial systems (robots) can understand and utilize information made for humans. For example, a statement like: "Put the nut on the bolt and tighten", which one might find in any assembly instruction sheet, is easily understood by us, but not by any robot. Too much background information is missing: Which tool to use? How to hold the tool? How to operate it? And much more. To make this understandable for a machine, ACAT introduces the concept of an "action category". Action categories are extracted from large bodies of human sources (text, images) and will fill in the missing background information. An action category, thus, includes the general computer code to perform the action (e.g. by a robot hand). But, as actions are always situation dependent, it also includes all situation specific information (e.g. how to shape the hand, how to generate the correct pose relative to a manipulated object). This is called action-specific background information. Action categories are obtained by combining linguistic analysis with action-simulation and robot self-exploration. They are assembled in an action-specific knowledge base. The ACAT project will develop a system that uses this knowledge base to compile and execute plans as sequences of individual actions. The execution of these plans by a robot serves as a test-bed for the success of the stored action categories. Repeated execution, error analysis, and correction lead to a life-long update process of the action-category knowledge base. The ultimate purpose of ACAT is to equip the robot – on an ongoing basis – with abstract, functional knowledge, normally made for humans, about relations between actions and objects leading to a system which can act meaningfully. For testing, ACAT uses "instruction sheets" (manuals), made for human workers, and translates these into a robot-executable format. This way the robot will be able to partially take over human tasks without time-consuming programming procedures improving the efficiency of industrial processes. Thus, similar to computer science, where the development of the first compilers had led to a major step forward, the main impact of this project is that ACAT develops a robot-compiler, which translates human understandable information into a robot-executable program.

Invito a presentare proposte

FP7-ICT-2011-9
Vedi altri progetti per questo bando

Meccanismo di finanziamento

CP - Collaborative project (generic)

Coordinatore

GEORG-AUGUST-UNIVERSITAT GOTTINGEN STIFTUNG OFFENTLICHEN RECHTS
Contributo UE
€ 873 659,00
Indirizzo
WILHELMSPLATZ 1
37073 Gottingen
Germania

Mostra sulla mappa

Regione
Niedersachsen Braunschweig Göttingen
Tipo di attività
Higher or Secondary Education Establishments
Contatto amministrativo
Nadja Daghbouche (Ms.)
Collegamenti
Costo totale
Nessun dato

Partecipanti (5)