Skip to main content
EnglishEN
European Commission logo print header

Cognitive Workflow Capturing and Rendering with On-Body Sensor Networks

Project description


Cognitive Systems and Robotics
System design to assist and interact with individual human activity, particularly that concerns with task solving and hand manipulation of objects and tools
The automatic capture, recognition and rendering of human sensory-motor activities represent essential technologies in many diverse applications. Current capture systems focus primarily on capturing raw motion data that is organised as a single cinematic sequence, with little or no reference to the underlying task activity or workflow patterns exhibited by the human subject.
The aim of the COGNITO project is to develop novel techniques that will allow cognitive workflow patterns to be analysed, learnt, recorded and subsequently rendered in a user-adaptive manner. COGNITO will map and closely couple both the afferent and efferent channels of the human subject, enabling activity data to be linked directly to workflow patterns and task completion. The focus will be on tasks involving the hand manipulation of objects and tools due to their importance in many industrial applications.

The automatic capture, recognition and rendering of human sensory-motor activities represent essential technologies in many diverse applications, ranging from 3D virtual manuals through to training simulators and novel computer games. Although capture systems already exist on the market, they focus primarily on capturing raw motion data, matched to a coarse model of the human body. Moreover, the recorded data is organised as a single cinematic sequence, with little or no reference to the underlying task activity or workflow patterns exhibited by the human subject. The result is data that is difficult to use in all but the most straightforward of applications, requiring extensive editing and user manipulation, especially when cognitive understanding of human action is a key concern, such as in virtual manuals or training simulators.The aim of the COGNITO project is to address these issues by advancing both the scope and the capability of human activity capture, recognition and rendering. Specifically, we propose to develop novel techniques that will allow cognitive workflow patterns to be analysed, learnt, recorded and subsequently rendered in a user-adaptive manner. Our concern will be to map and closely couple both the afferent and efferent channels of the human subject, enabling activity data to be linked directly to workflow patterns and task completion. We will focus particularly on tasks involving the hand manipulation of objects and tools due to their importance in many industrial applications.

Fields of science

Programme(s)

Topic(s)

Call for proposal

FP7-ICT-2009-4
See other projects for this call

Funding Scheme

CP - Collaborative project (generic)

Coordinator Contact

Didier STRICKER Prof.Dr.

Coordinator

DEUTSCHES FORSCHUNGSZENTRUM FUR KUNSTLICHE INTELLIGENZ GMBH
Address
Trippstadter strasse 122
67663 Kaiserslautern
Germany

See on map
Region
Rheinland-Pfalz Rheinhessen-Pfalz Kaiserslautern, Kreisfreie Stadt
Activity type
Research Organisations
Administrative Contact
Walter Olthoff (Dr.)
Links
EU contribution
€ 903 988,00

Participants (8)

Share this page

Download

Last update: 19 April 2017

My Booklet

Permalink: https://cordis.europa.eu/project/id/248290

European Union, 2023