Skip to main content

Explaining object permanence with a deep recurrent neural network model of human cortical visual cognition

Objective

Visual cognition is our ability to recognize the things we see around us and make inferences about their meaning and
relationships. Deep convolutional neuronal network (CNN) models now achieve human-level performance on certain visual
recognition tasks and currently provide the most powerful models of human visual cognition. A hallmark step in the
development of human visual cognition is the acquisition of object permanence (OP). Object permanence is the ability to
continue to mentally represent an object that has disappeared from view – for example because it is hidden behind another
object. Current deep neural network models of vision lack this fundamental ability, limiting their power as models of human
visual cognition and as artificially intelligent systems. In this action, I will study the computational mechanisms necessary for
OP using a highly innovative approach that combines four elements: (1) a novel behavioral task that requires OP, (2)
development of a deep recurrent neural network models, (3) testing of both human participants and models at the task, and
(4) measurement of brain activity with functional magnetic resonance imaging (fMRI) during task performance. The OP task
involves viewing a scene of moving objects that occasionally become occluded behind other objects. Models will be trained
to represent objects continually, even as they vanish behind an occluder, and selected to match behavioral and cortical-layer-
resolved high-field fMRI data of human observers. The hosts, Prof Kriegeskorte at Columbia University and Prof Muckli
at University of Glasgow are world-leading experts on deep neural network models of vision and cortical-layer-resolved highfield
fMRI, respectively. The outcome of this action, a biologically plausible deep recurrent convolutional model that can
explain behavior and brain activity, will significantly enhance our understanding of the computational principles of visual
cognition, with implications also for AI technology.

Coordinator

UNIVERSITY OF GLASGOW
Net EU contribution
€ 271 732,80
Address
University Avenue
G12 8QQ Glasgow
United Kingdom

See on map

Region
West Central Scotland Glasgow City
Activity type
Higher or Secondary Education Establishments
Non-EU contribution
€ 0,00

Partners (1)

Partner

Partner organisations contribute to the implementation of the action, but do not sign the Grant Agreement.

TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK
United States
Net EU contribution
€ 0,00
Address
Amsterdam Avenue 1210 Room
10027 7003 New York

See on map

Activity type
Higher or Secondary Education Establishments
Non-EU contribution
€ 165 265,92