Objetivo
Rapid technical development generates the need to train many people in expert operations. To teach many users a system to interpret the expert's activities is required. The user can replay activities at any time and from any viewpoint. Due to the cognitive framework of the vision system envisioned it is possible to index activities and objects involved. The index is based on natural language terms and allows user-driven retrieval. The system provides feedback to motivate the trainee and to enhance the training effect. The cognitive vision framework builds on purposive and reactive vision techniques which focus processing to obtain real-time performance. Integration and active selection of techniques realises robust interpretation. The final presentation will interpret activities involved in an assembly scenario, e.g. changing a car wheel. Seven industrial companies have expressed interest to exploit the results for training and long-term documentation.
Objectives:
The objective of ActIPret is to develop a vision methodology that interprets and records the activities of people handling tools. The tasks considered are observable by video streams. Focus is on active observation and interpretation of activities, on parsing the sequences into constituent behaviour elements, and on extracting the essential activities and their functional dependence. By providing this functionality ActIPret will enable observation of experts executing intricate tasks such as repairing machines and maintaining plants. The expert activities are interpreted and stored using natural language expressions in an activity plan. The activity plan is an indexed manual in the form of 3D reconstructed scenes, which can be replayed at any time and location to many users using Augmented Reality equipment. Due to the interpretive level of the system, ActIPret can provide the trainee with feedback when repeating the operation (in simulation or reality), which results in a superior training effect compared to repetition without feedback.
Work description:
The project is organised into eight interlaced technical work packages to build the cognitive vision framework and its purposive and reactive processing components. In the first year the framework and its constituent parts are designed and a first prototype is implemented. Every six months all components will be tested, evaluated and the functionality extended. Iterative progress of work is required to thoroughly study the interactivity of the components. The approach involves associating attentional pragmatic interpretation with specific phases of tasks and context to zoom in on the relevant objects and activities. The components of visual processing are all task and context-driven and report visual evidence with confidence measures. These components are the extraction of cues and features, the detection of context-dependent relationships between cues/features, the recognition of the objects handled taking into account potential occlusion, and the recognition of activities and the synthesis of behaviours and tasks that bias the context at the other components. These levels of visual interpretation are interlaced with the attentive and investigative behaviours that provide the feedback to purposively focus processing to obtain real-time performance. Robust interpretation results are obtained with methods of learning and methods to actively seek good viewpoints and to obtain disambiguating information for detection, recognition and synthesis. Robustness is further enhanced using context-dependent information integration between the components and with integration of cues, features and complementary recognition methods.
The framework is tested with two scenarios where various people handle objects: placing a CD in a player and an industrial assembly task. From interpreting observed activities the activity plan will be extracted. Using the stored reconstruction of the scene and activities, users will be able to index the expert operations for replay using AR equipment.
Milestones:
Year 1: Prototype framework implemented; Recognition of single activities and learning of object representations; Conceptual language defining activities.
Year 2: Interpretation of one-handed activities with objects; Qualitative description of spatial relations between objects and activities; Conceptual activity description for activity plans.
Year 3: Interpretation of two-handed activity sequences with objects; Temporal relations between objects and activities; Activity plan synthesis and replay.
Ámbito científico (EuroSciVoc)
CORDIS clasifica los proyectos con EuroSciVoc, una taxonomía plurilingüe de ámbitos científicos, mediante un proceso semiautomático basado en técnicas de procesamiento del lenguaje natural. Véas: El vocabulario científico europeo..
CORDIS clasifica los proyectos con EuroSciVoc, una taxonomía plurilingüe de ámbitos científicos, mediante un proceso semiautomático basado en técnicas de procesamiento del lenguaje natural. Véas: El vocabulario científico europeo..
- ciencias naturales informática y ciencias de la información software software de aplicación software de simulación
Para utilizar esta función, debe iniciar sesión o registrarse
Programa(s)
Programas de financiación plurianuales que definen las prioridades de la UE en materia de investigación e innovación.
Programas de financiación plurianuales que definen las prioridades de la UE en materia de investigación e innovación.
Tema(s)
Las convocatorias de propuestas se dividen en temas. Un tema define una materia o área específica para la que los solicitantes pueden presentar propuestas. La descripción de un tema comprende su alcance específico y la repercusión prevista del proyecto financiado.
Las convocatorias de propuestas se dividen en temas. Un tema define una materia o área específica para la que los solicitantes pueden presentar propuestas. La descripción de un tema comprende su alcance específico y la repercusión prevista del proyecto financiado.
Convocatoria de propuestas
Procedimiento para invitar a los solicitantes a presentar propuestas de proyectos con el objetivo de obtener financiación de la UE.
Datos no disponibles
Procedimiento para invitar a los solicitantes a presentar propuestas de proyectos con el objetivo de obtener financiación de la UE.
Régimen de financiación
Régimen de financiación (o «Tipo de acción») dentro de un programa con características comunes. Especifica: el alcance de lo que se financia; el porcentaje de reembolso; los criterios específicos de evaluación para optar a la financiación; y el uso de formas simplificadas de costes como los importes a tanto alzado.
Régimen de financiación (o «Tipo de acción») dentro de un programa con características comunes. Especifica: el alcance de lo que se financia; el porcentaje de reembolso; los criterios específicos de evaluación para optar a la financiación; y el uso de formas simplificadas de costes como los importes a tanto alzado.
Coordinador
1040 WIEN
Austria
Los costes totales en que ha incurrido esta organización para participar en el proyecto, incluidos los costes directos e indirectos. Este importe es un subconjunto del presupuesto total del proyecto.