Objective Current Computer Vision systems do not meet important criteria such as cognitive performance, adaptability, robustness, run-time efficiency, and cost-effective development. Thus the spectrum of possible applications is restricted considerably. The project will tackle this weakness by the development of generic cognitive vision architecture, which can be adapted automatically to underlying tasks and environments. It includes novel algebraic means for image and shape representation as well as approaches of multi cue integration for describing hierarchical inter- and intra-image linkages, and these will be based on novel mechanisms of dynamic neural network learning. Cognitive visual competences can be learned including detection of 3D objects in images and attentive object/situation analysis. They are needed in the sample application Skillful RobotArm which has been chosen for measuring the success under real-world conditions.Objectives:The overall objective of the proposed project is to design a learning-based cognitive vision architecture and to implement essential generic components for the automatic adaptation to underlying tasks and environments. The objectives include adequate representation schemes for multi-dimensional images and object shapes, reliable feature extraction and multi cue integration, dynamic adaptation and learning mechanisms, and their specific use for the detection of 3D objects in images and attentive object/situation analysis. These novel techniques will be exploited in the sample real-world application Skillful Robot Arm, which should be equipped with high-level cognitive competences such as object removal from bins, and must rely on robust behaviours of the cognitive vision system as a whole and consider real-time constraints.Work description:The project will last 36 months and will be organised in seven work-packages (WPs).Workpackage WP1 is devoted to project management, which includes permanent administrative and technical duties and permanent inter-project communication.The aim of workpackage WP2 is to keep a common project infra-structure by installing hardware and common software platforms in the very beginning, then specifying and implementing common software interfaces throughout all project phases, and finally consolidating the user interfaces in the last phase.The goal of workpackage WP3 is to design novel representation schemes for images and shapes which enable the integration of multiple local cues and the bridging of different abstraction levels and thus will have enough descriptive power to solve cognitive vision tasks.Workpackage WP4 is devoted to the detection of task-related objects in colour or range images which is based on designing and developing algorithmic learning components for automatically learning or adapting appropriate operators involved in the detection method.Workpackage WP5 is devoted to task-adaptive attentive object and situation analysis in colour or range images which results in a purposive geometric description of relevant objects and object-relations including actoric information just as required to treat a certain Cognitive Vision application.The aim of workpackage WP6 is to make use of all generic components in the sample application Skillful Robot Arm, which will involve automatic learning and/or adaptation of essential methods to yield task-solving behaviours in the actual environment.Workpackage WP7 is responsible for disseminating the final results to the research community at large and to industries, i.e. demonstrating the results in tutorials, and organizing an international workshop for leading-edge researchers and practitioners from industries.Milestones:PM 20: Computational modules which produce representations (pictorial, spatial) of several object types using multivector-/tensor-based methods; algorithmic learning modules for localization/recognition of objects in different real-world environments.PM 29: Computational modules for task-adaptive object/situation analysis of several object/situations types in different environments.PM 36: A cognitive vision architecture adaptable to sub-tasks involved in the Skillful Robot Arm. Fields of science natural sciencescomputer and information sciencessoftwareengineering and technologymaterials engineeringcolorsnatural sciencescomputer and information sciencesartificial intelligencecomputer visionnatural sciencescomputer and information sciencesartificial intelligencecomputational intelligence Programme(s) FP5-IST - Programme for research, technological development and demonstration on a "User-friendly information society, 1998-2002" Topic(s) 2001-4.2.1 - Real time distributed systems Call for proposal Data not available Funding Scheme CSC - Cost-sharing contracts Coordinator CHRISTIAN-ALBRECHTS-UNIVERSITAET ZU KIEL EU contribution No data Address OLSHAUSENSTRASSE 40 24098 KIEL Germany See on map Total cost No data Participants (2) Sort alphabetically Sort by EU Contribution Expand all Collapse all ISRA VISION SYSTEMS AG Germany EU contribution No data Address INDUSTRIESTRASSE 14 64297 DARMSTADT See on map Total cost No data LINKOEPINGS UNIVERSITET Sweden EU contribution No data Address CAMPUS VALLA 581 83 LINKOEPING See on map Total cost No data
