Objective Computer vision has gained considerable momentum in recent years – both in industry and academia. There seems to be a spirit that the time is ripe to realize grand goals and to bring computer vision from the lab into real life. But is a vision system already as good as a human is? The answer is: “Unfortunately, not yet.” Given a single image, a child can describe the objects and their relationships in a much more detailed manner than any computer can. Also, humans can quite effortlessly “visually extract” an object from its background, even in the presence of fine details such as hair. Computers cannot yet achieve this automatically. But, for many real-world applications it is absolutely necessary to reach such levels of rich output, accuracy, quality, robustness, and system autonomy. In this proposal we try to get closer to this overarching goal. We believe that the key to success is a richer representation. Here “rich” stands for rich, detailed output, modelling rich, physical and semantic constraints, and learning rich, statistical relations between different aspects of a scene. Towards this end we propose the Rich Scene Model (RSM), which is one joint statistical, structured model of many physical and semantic scene aspects that can take full advantage of the synergy effect between all its components. This effort goes beyond previous attempts, in many respects. However, it is simple to say “We will build the best ever joint, rich scene model”. Accordingly, the crux of this proposal is to design novel models, learning and inference techniques to make the RSM a reality. This proposal addresses not only theoretical questions such as, “What can we infer from a few images of a dynamically changing 3D scene?”, and “Is our RSM rich enough to make statistical learning “work better” than deterministic learning?” we also propose a model that can give new forms of output, better deal with challenging real world scenarios, and can adapt nicely to human and application needs Fields of science natural sciencescomputer and information sciencesartificial intelligencecomputer visionnatural sciencesphysical sciencesastronomyastrophysicssocial sciencessociologygovernancecrisis managementnatural sciencescomputer and information sciencesartificial intelligencemachine learningdeep learningnatural sciencescomputer and information sciencesartificial intelligencecomputational intelligence Programme(s) H2020-EU.1.1. - EXCELLENT SCIENCE - European Research Council (ERC) Main Programme Topic(s) ERC-CoG-2014 - ERC Consolidator Grant Call for proposal ERC-2014-CoG See other projects for this call Funding Scheme ERC-COG - Consolidator Grant Host institution RUPRECHT-KARLS-UNIVERSITAET HEIDELBERG Net EU contribution € 1 549 535,88 Address SEMINARSTRASSE 2 69117 Heidelberg Germany See on map Region Baden-Württemberg Karlsruhe Heidelberg, Stadtkreis Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 1 549 535,88 Beneficiaries (2) Sort alphabetically Sort by Net EU contribution Expand all Collapse all RUPRECHT-KARLS-UNIVERSITAET HEIDELBERG Germany Net EU contribution € 1 549 535,88 Address SEMINARSTRASSE 2 69117 Heidelberg See on map Region Baden-Württemberg Karlsruhe Heidelberg, Stadtkreis Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 1 549 535,88 TECHNISCHE UNIVERSITAET DRESDEN Participation ended Germany Net EU contribution € 448 745,12 Address HELMHOLTZSTRASSE 10 01069 Dresden See on map Region Sachsen Dresden Dresden, Kreisfreie Stadt Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 448 745,12