Skip to main content
Ir a la página de inicio de la Comisión Europea (se abrirá en una nueva ventana)
español español
CORDIS - Resultados de investigaciones de la UE
CORDIS
Contenido archivado el 2024-05-24

Visual Active Memory Processes and Interactive REtrieval

Objetivo

In traditional vision systems the model acquisition and recognition processes are decoupled in time and control. The coupling of both processes leads to significant challenges in computer vision. The model acquisition task has to be performed by active memory processes that have to implement visual learning and categorization capabilities. The recognition process must be substituted by an interactive retrieval that performs a reasoning process about the memorized and perceived input data. The project aims at the development of an active memory and retrieval system in the context of an Augmented Reality scenario. The user wears a head-mounted camera and display such that the system is able to build up a hierarchical structured memory of what the user sees. Query results are re-visualized in a virtual world or projected into the real world using the head-mounted display.

Objectives:
Despite of great progress in the field of image understanding the simulation of the human visual system is still far unreachable. It is characterized by the ability to categorize unknown objects and events with regard to the situational context and background knowledge. The main thesis put forth by the project VAMPIRE is that learning and cognitive capabilities in vision systems cannot be realized without Visual Active Memory (VAM) Processes. VAM maintains the visual history of the dynamic world over an extended period of time. It provides the context and background knowledge for learning and categorization of objects and motion behaviors in a dynamically changing environment. The categorization process is enforced by interactive retrieval where acquired concepts must be related to queries provided by a user opening up the full cognitive performance of the system.

Work description:
The realization of a visual active memory and interactive retrieval system can be broken down into the following aspects that each is a research aim for its own. The combination of these aspects will result in a system that out rules the performance and functionality of today's vision systems. Robust real-time detection and tracking of objects in complex scenes is one of the most important requirement for a visual active memory and interactive retrieval system. The aim is to provide fast and robust modules at the low level of vision for object/background segmentation and sparse 3-d reconstruction. Another important step is the development of the concept of visual Active Memory and the implementation of the associated tools for learning visual concepts and events by observing dynamic environments. The conceptual models will be used to aid the scene interpretation process. A further research goal is the implementation of a fully mobile multi-user Augmented Reality (AR) demonstrator having active visual memory capabilities. This demonstrator is a realization of all-important features of a wearable, distributed real-time cognitive vision system. The system is distributed over several users, each of them wearing a fully mobile AR-gear. The final aim to have demo systems in (at least) 4 labs serving as project demonstrator and evaluation platforms. The demonstrator will evolve over gradually more complex tasks. We will start by evaluating the system in two different environments, e.g office and lab. Additional domains will be successively introduced modelling context switches and learning facilities.

Milestones:
The project will progress according to a set of annual milestones that range from the design of an integrated vision architecture over the realization of content- based retrieval to the implementation of visual learning and categorization capabilities on the basis of the Visual Active Memory. All these skills will be demonstrated in an augmented reality scenario where query results of a user request are constructed to visual data and projected into the real world using a head-mounted display.

Ámbito científico (EuroSciVoc)

CORDIS clasifica los proyectos con EuroSciVoc, una taxonomía plurilingüe de ámbitos científicos, mediante un proceso semiautomático basado en técnicas de procesamiento del lenguaje natural. Véas: El vocabulario científico europeo..

Para utilizar esta función, debe iniciar sesión o registrarse

Programa(s)

Programas de financiación plurianuales que definen las prioridades de la UE en materia de investigación e innovación.

Tema(s)

Las convocatorias de propuestas se dividen en temas. Un tema define una materia o área específica para la que los solicitantes pueden presentar propuestas. La descripción de un tema comprende su alcance específico y la repercusión prevista del proyecto financiado.

Convocatoria de propuestas

Procedimiento para invitar a los solicitantes a presentar propuestas de proyectos con el objetivo de obtener financiación de la UE.

Datos no disponibles

Régimen de financiación

Régimen de financiación (o «Tipo de acción») dentro de un programa con características comunes. Especifica: el alcance de lo que se financia; el porcentaje de reembolso; los criterios específicos de evaluación para optar a la financiación; y el uso de formas simplificadas de costes como los importes a tanto alzado.

CSC - Cost-sharing contracts

Coordinador

UNIVERSITAET BIELEFELD
Aportación de la UE
Sin datos
Dirección
UNIVERSITAETSSTRASSE 25
33501 BIELEFELD
Alemania

Ver en el mapa

Coste total

Los costes totales en que ha incurrido esta organización para participar en el proyecto, incluidos los costes directos e indirectos. Este importe es un subconjunto del presupuesto total del proyecto.

Sin datos

Participantes (3)

Mi folleto 0 0