Cracking the neural code of human object vision

Objective

At each blink of our eyes, our brain rapidly transforms the stream of photons hitting the retina into a conscious percept of the world as consisting of meaningful objects that guide our actions to ensure survival. Yet, in spite of intense research three interrelated, fundamental, long-standing and open questions about how neural dynamics mediate object recognition remain unanswered: How exactly do the core cortical regions active during vision represent objects? How and what do those regions communicate? How does the observed activity mediate adaptive behavior? The overall goal of the program CRACK is to crack the neural code of object vision by addressing those three fundamental questions. For this, CRACK will integrate in an unprecedented manner cutting-edge, non-invasive brain imaging methods, advanced multivariate analysis techniques and state-of-the-art computational modelling in an ambitious three-step interdisciplinary work program. Each step is marked by innovation that breaks new ground and opens new horizons at the next step. First, CRACK will unravel the unique representational format of each core cortical region using an unprecedented brain mapping approach that combines brain imaging with artificial deep neural networks (DNNs). Second, it will clarify the flow of information between visual regions that creates these representations with unseen spatiotemporal precision by resolving neural activity in both cortical layers and frequency channels using a combination of functional MRI (fMRI) and electroencephalography (EEG). Third, it will use advanced multivariate methods linking brain activity and behavior to reveal which aspects of the newly described neural dynamics drive human choice behavior. By breaking down current knowledge boundaries, CRACK will provide the empirical evidence for a new theory of the neural dynamics underlying human visual object recognition, and transform the way we think about and investigate sensory processing.

Field of science

• /natural sciences/computer and information sciences/artificial intelligence/computational intelligence
• /medical and health sciences/clinical medicine/ophthalmology
• /natural sciences/physical sciences/theoretical physics/particles/photons

Programme(s)

• H2020-EU.1.1. - EXCELLENT SCIENCE - European Research Council (ERC)

Topic(s)

• ERC-2018-STG - ERC Starting Grant

Call for proposal

ERC-2018-STG
See other projects for this call

Funding Scheme

Host institution

Beneficiaries (1)