Skip to main content
Vai all'homepage della Commissione europea (si apre in una nuova finestra)
italiano it
CORDIS - Risultati della ricerca dell’UE
CORDIS

Deep Learning for Dynamic 3D Visual Scene Understanding

Obiettivo

Over the past 5 years, deep learning has exercised a tremendous and transformational effect on the field of computer vision. However, deep neural networks (DNNs) can only realize their full potential when applied in an end-to-end manner, i.e. when every stage of the processing pipeline is differentiable with respect to the network’s parameters, such that all of those parameters can be optimized together. Such end-to-end learning solutions are still rare for computer vision problems, in particular for dynamic visual scene understanding tasks. Moreover, feed-forward processing, as done in most DNN-based vision approaches, is only a tiny fraction of what the human brain can do. Feedback processes, temporal information processing, and memory mechanisms form an important part of our human scene understanding capabilities. Those mechanisms are currently underexplored in computer vision.

The goal of this proposal is to remove this bottleneck and to design end-to-end deep learning approaches that can realize the full potential of DNNs for dynamic visual scene understanding. We will make use of the positive interactions and feedback processes between multiple vision modalities and combine them to work towards a common goal. In addition, we will impart deep learning approaches with a notion of what it means to move through a 3D world by incorporating temporal continuity constraints, as well as by developing novel deep associative and spatial memory mechanisms.

The results of this research will enable deep neural networks to reach significantly improved dynamic scene understanding capabilities compared to today’s methods. This will have an immediate positive effect for applications in need for such capabilities, most notably for mobile robotics and intelligent vehicles.

Programma(i)

Argomento(i)

Meccanismo di finanziamento

ERC-COG - Consolidator Grant

Vedi tutti i progetti finanziati nell’ambito di questo schema di finanziamento

Invito a presentare proposte

(si apre in una nuova finestra) ERC-2017-COG

Vedi tutti i progetti finanziati nell’ambito del bando

Istituzione ospitante

RHEINISCH-WESTFAELISCHE TECHNISCHE HOCHSCHULE AACHEN
Contributo netto dell'UE
€ 2 000 000,00
Indirizzo
TEMPLERGRABEN 55
52062 Aachen
Germania
Regione
Nordrhein-Westfalen Köln Städteregion Aachen
Tipo di attività
Higher or Secondary Education Establishments
Collegamenti
Costo totale
€ 2 000 000,00

Beneficiari (1)