Skip to main content
European Commission logo print header

Spatio-Temporal Attention and Representation Tracking: the precise neural architecture of conscious object perception

Periodic Reporting for period 2 - START (Spatio-Temporal Attention and Representation Tracking: the precise neural architecture of conscious object perception)

Reporting period: 2019-07-01 to 2020-12-31

START aims to improve our understanding of consciousness by revealing and explaining the neural underpinnings of conscious access, capitalising on the combined strengths of multiple neuroimaging and behavioural measurement modalities. Using Representational Similarity Analyses (RSA) to combine brain data collected from Electroencephalography (EEG; precise in time), functional Magnetic Resonance Imaging (fMRI; precise in space), and behavioural tasks modulating conscious access and memory, START will fill an important gap in our understanding of the neural mechanisms involved in object recognition, from perception to conscious access and storage in long-term memory. Overall, the research on conscious access has three important challenges that START will aim to address:
(1) make use of novel neuroimaging tools to deepen and broaden insights into the spatiotemporal dynamics of conscious access.
(2) Develop innovative experimental designs to grasp knowledge on the mechanisms of amplification and encoding in working memory which are not yet fully understood.
(3) Consider the nature of internal brain representations in understanding the variability in task performance across trials and individuals.
Understanding the spatiotemporal mechanisms of object recognition and conscious access has important implications for our understanding of brain function, and potential translational applications towards better understanding disorders of consciousness.
WP1: The functional architecture of conscious access in time and space:
In this work package, we investigated how object representations in time and space affect conscious perception. Two main projects have been completed within this work package. These two projects have given us great insight into the role of visual features and neural representations (in time and space) of objects in conscious access. The manuscript prepared describing the first project has been published in Nature Communications, and the second project has been presented at the Visual Science Society conference 2019 and at Computational Cognitive Neuroscience 2019 and a manuscript is under preparation for peer-reviewed publlication.
WP2: Decoding target-related population code amplification.
This work package aims at delineating how different attributes of visual stimuli are encoded and temporarily stored in the brain. Additionally, we are interested in investigating how task-relevance affects these representations. To this purpose, we combine the signals obtained through distinct EEG and fMRI recording sessions. This methodology allows us to overcome the limitations of both techniques and achieves great spatial and temporal resolution. In the first 18 months, we have designed and implemented the paradigm, obtained the ethics approval, and started both EEG and fMRI data collection. We have also performed preliminary data analysis of the EEG data. In the next 18 months, we will complete data collection and analysis.
WP3: inter-trial and inter-individual variability in conscious access:
This work package aims at better understanding the inter-trial and inter-individual variability consistently observed in studies of conscious access. We will collect behavioural, electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) data with several experimental tasks spanning object recognition, conscious access, working memory and long-term memory using personally meaningful and unfamiliar visual objects as stimuli. WP3 will investigate the mechanisms underlying object recognition and the variability in brain and behaviour across trials and across individuals. Object recognition, conscious access, working memory encoding and long-term memory representations are tightly intertwined in our brain’s ability to make sense of the world and generate appropriate actions. In summary, we will provide new insights on the precise spatio-temporal dynamics of conscious access, the idiosyncratic components behind it, and the variability in forming and recalling new memories.
We developed and customised an array of cutting-edge software tools to manage, analyse, and disseminate the behavioural, EEG and fMRI data acquired throughout the START project. These include: automated structuring and metadata annotation of the data, scripted access to university high-performance computing (HPC) resources for faster data analysis, deployment of community-standardised analysis software, development of an advanced technique for increasing signal-to-noise ratio (SNR), and extended python-based representational similarity code. Using modern software development and data scientific practices, these tools have greatly increased efficiency and reliability of parts of the data processing pipeline that previously were labour intensive and prone to human error.