CORDIS
EU research results

CORDIS

English EN
Explaining object permanence with a deep recurrent neural network model of human cortical visual cognition

Explaining object permanence with a deep recurrent neural network model of human cortical visual cognition

Objective

Visual cognition is our ability to recognize the things we see around us and make inferences about their meaning and
relationships. Deep convolutional neuronal network (CNN) models now achieve human-level performance on certain visual
recognition tasks and currently provide the most powerful models of human visual cognition. A hallmark step in the
development of human visual cognition is the acquisition of object permanence (OP). Object permanence is the ability to
continue to mentally represent an object that has disappeared from view – for example because it is hidden behind another
object. Current deep neural network models of vision lack this fundamental ability, limiting their power as models of human
visual cognition and as artificially intelligent systems. In this action, I will study the computational mechanisms necessary for
OP using a highly innovative approach that combines four elements: (1) a novel behavioral task that requires OP, (2)
development of a deep recurrent neural network models, (3) testing of both human participants and models at the task, and
(4) measurement of brain activity with functional magnetic resonance imaging (fMRI) during task performance. The OP task
involves viewing a scene of moving objects that occasionally become occluded behind other objects. Models will be trained
to represent objects continually, even as they vanish behind an occluder, and selected to match behavioral and cortical-layer-
resolved high-field fMRI data of human observers. The hosts, Prof Kriegeskorte at Columbia University and Prof Muckli
at University of Glasgow are world-leading experts on deep neural network models of vision and cortical-layer-resolved highfield
fMRI, respectively. The outcome of this action, a biologically plausible deep recurrent convolutional model that can
explain behavior and brain activity, will significantly enhance our understanding of the computational principles of visual
cognition, with implications also for AI technology.
Leaflet | Map data © OpenStreetMap contributors, Credit: EC-GISCO, © EuroGeographics for the administrative boundaries

Coordinator

UNIVERSITY OF GLASGOW

Address

University Avenue
G12 8qq Glasgow

United Kingdom

Activity type

Higher or Secondary Education Establishments

EU Contribution

€ 271 732,80

Partners (1)

Sort alphabetically

Expand all

TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK

Project information

Grant agreement ID: 841578

Status

Grant agreement signed

  • Start date

    1 September 2019

  • End date

    31 August 2022

Funded under:

H2020-EU.1.3.2.

  • Overall budget:

    € 271 732,80

  • EU contribution

    € 271 732,80

Coordinated by:

UNIVERSITY OF GLASGOW

United Kingdom