Skip to main content
European Commission logo print header

Smart Eyes: Attending and Recognizing Instances of Salient Events

Project description


Cognitive Systems, Interaction, Robotics
Technology capable to learn what is a salient event and to detect only the security relevant activities

The SEARISE project will develop a trinocular active cognitive vision system, the Smart-Eyes, for detection, tracking and categorization of salient events and behaviours. Unlike other approaches in video surveillance, the system will have human-like capability to learn continuously from the visual input, self-adjust to ever changing visual environment, fixate salient events and follow their motion, categorize salient events dependent on the context. Inspired by the human visual system, a cyclopean camera will perform wide range monitoring of the visual field while active binocular stereo cameras will fixate and track salient objects, mimicking a focus of attention that switches between different interesting locations. The core of this artificial cognitive visual system will be a dynamic hierarchical neural architecture – a computational model of visual processing in the brain. Information processing in Smart-Eyes will be highly efficient due to a multi-scale design: Controlled by the cortically plausible neural model, the active cameras will provide a multi-scale video record of salient events. The processing will self-organize to adapt to scale variations and to assign the majority of computational resources to the informative parts of the scene. Smart-Eyes will be tested in real-life scenarios for observation of large crowded public spaces and of individual activities within restricted areas.

Call for proposal

FP7-ICT-2007-1
See other projects for this call

Coordinator Contact

Marina KOLESNIK Dr.

Coordinator

FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV
EU contribution
€ 807 194,00
Address
HANSASTRASSE 27C
80686 Munchen
Germany

See on map

Region
Bayern Oberbayern München, Kreisfreie Stadt
Activity type
Research Organisations
Administrative Contact
Stephan Kollmer (Mr.)
Links
Total cost
No data

Participants (7)