Objectif Computer Vision has gradually become an enabling technology for a range of applications involving in particular inspection and recovery of 3D models. The problem of recognition and categorisation of general sets of objects has posed to be a significant challenge. This proposal addresses the problem of recognition, categorisation, scene interpretation and learning in the context of an embodied system to demonstrate that through careful consideration of spatio-temporal context, task constraints, embodiment, and representation it is indeed possible to provide the methods needed for the demonstrating the basic functionalities of cognitive vision in the context of realistic problems.Objectives:The objective of this project is to provide the methods and techniques that enable construction of vision systems that can perform task oriented categorisation and recognition of objects and events in the context of an embodied agent. The functionality will enable construction of mobile agents that can interpret the action of humans and interact with the environment for tasks such as fetch and delivery of objects in a realistic domestic setting.Work description:Cognitive vision systems include facilities for "understanding", "knowing" and "learning". Understanding here involves both recognition/categorisation of objects and events, through association of semantic labels with data from the scene. Interpretation does, however, also involve interpretation and reasoning to enable construction of rich semantic models of the environment. Knowing implicitly specifies a need to consider memory as a common basis for representation and maintenance of information, including methods for associate access. Systems with a realistic complexity cannot be engineered. There is consequently a need for methods for automatic acquisition of models and representations to allow the system to operate in an open-ended fashion, i.e. beyond initial specifications. Finally the above issues can only be addressed in a meaningful manner in the context of a fully operational system, which implies that it must be embodied and continuously operating.To address the issues outlined above the work has been organised into four workpackages:i) Recognition and Categorisation of Objects, Structures and Events,ii) Reasoning and Interpretation about Scenes and Events,iii) Learning and Adaptation, andiv) Control and Integration. Through the work in each of these packages and integration of these efforts into a number of operational systems the key issues in cognitive vision will be studied. Particular emphasis is placed on studies of these systems in realistic settings and through combination of static and dynamic information to allow interpretation, control and knowledge acquisition to operate in concert.Milestones:The project will in particular deliver basic methods for recognition / categorisation of objects and events/actions in large scale scenarios, new methods for robust interpretation of dynamic scenes, methods for acquisition of basic skills and environmental models, and techniques for fully distributed control of continuously operating systems. The methods studied will be integrated in prototype systems. Many of the results within the project will be of immediate industrial utility. Champ scientifique natural sciencescomputer and information sciencessoftwaresoftware applicationssystem softwareoperating systemsnatural sciencescomputer and information sciencesartificial intelligencecomputer vision Programme(s) FP5-IST - Programme for research, technological development and demonstration on a "User-friendly information society, 1998-2002" Thème(s) 2000-4.2.2 - Real-time systems Appel à propositions Data not available Régime de financement CSC - Cost-sharing contracts Coordinateur KUNGLIGA TEKNISKA HOEGSKOLAN Contribution de l’UE Aucune donnée Adresse VALHALLAVAEGEN 79 100 44 STOCKHOLM Suède Voir sur la carte Coût total Aucune donnée Participants (6) Trier par ordre alphabétique Trier par contribution de l’UE Tout développer Tout réduire EIDGENOESSISCHE TECHNISCHE HOCHSCHULE ZUERICH Suisse Contribution de l’UE Aucune donnée Adresse RAEMISTRASSE 101 8092 ZUERICH Voir sur la carte Coût total Aucune donnée MAX-PLANCK GESELLSCHAFT ZUR FOERDERUNG DER WISSENSCHAFTEN E.V. Allemagne Contribution de l’UE Aucune donnée Adresse HOFGARTENSTRASSE 8 80539 MUENCHEN Voir sur la carte Coût total Aucune donnée UNIVERSITA DEGLI STUDI DI GENOVA Italie Contribution de l’UE Aucune donnée Adresse VIA BALBI 5 16126 GENOVA Voir sur la carte Coût total Aucune donnée UNIVERSITAET HAMBURG Allemagne Contribution de l’UE Aucune donnée Adresse EDMUND-SIEMERS-ALLEE 1 20146 HAMBURG Voir sur la carte Coût total Aucune donnée UNIVERSITY OF LEEDS Royaume-Uni Contribution de l’UE Aucune donnée Adresse Woodhouse Lane LS2 9JT LEEDS Voir sur la carte Coût total Aucune donnée UNIVERZA V LJUBLJANI Slovénie Contribution de l’UE Aucune donnée Adresse KONGRESNI TRG 12 LJUBLJANA Voir sur la carte Liens Site web Opens in new window Coût total Aucune donnée