Skip to main content

Deep Learning Theory: Geometric Analysis of Capacity, Optimization, and Generalization for Improving Learning in Deep Neural Networks

Objective

Deep Learning is one of the most vibrant areas of contemporary machine learning and one of the most promising approaches to Artificial Intelligence. Deep Learning drives the latest systems for image, text, and audio processing, as well as an increasing number of new technologies. The goal of this project is to advance on key open problems in Deep Learning, specifically regarding the capacity, optimization, and regularization of these algorithms. The idea is to consolidate a theoretical basis that allows us to pin down the inner workings of the present success of Deep Learning and make it more widely applicable, in particular in situations with limited data and challenging problems in reinforcement learning. The approach is based on the geometry of neural networks and exploits innovative mathematics, drawing on information geometry and algebraic statistics. This is a quite timely and unique proposal which holds promise to vastly streamline the progress of Deep Learning into new frontiers.

Field of science

  • /natural sciences/mathematics/pure mathematics/geometry
  • /natural sciences/computer and information sciences/artificial intelligence
  • /natural sciences/computer and information sciences/artificial intelligence/computational intelligence
  • /natural sciences/computer and information sciences/artificial intelligence/machine learning/deep learning
  • /natural sciences/computer and information sciences/artificial intelligence/machine learning/reinforcement learning
  • /natural sciences/computer and information sciences/artificial intelligence/machine learning

Call for proposal

ERC-2017-STG
See other projects for this call

Funding Scheme

ERC-STG - Starting Grant

Host institution

MAX-PLANCK-GESELLSCHAFT ZUR FORDERUNG DER WISSENSCHAFTEN EV
Address
Hofgartenstrasse 8
80539 Munich
Germany
Activity type
Other
EU contribution
€ 1 500 000

Beneficiaries (1)

MAX-PLANCK-GESELLSCHAFT ZUR FORDERUNG DER WISSENSCHAFTEN EV
Germany
EU contribution
€ 1 500 000
Address
Hofgartenstrasse 8
80539 Munich
Activity type
Other