Periodic Reporting for period 1 - NeSt (Neural mechanisms of perceptual Stability in magnitude perception)
Reporting period: 2019-06-01 to 2021-05-31
How do we perceive the world around us? An essential piece of information needed to understand the external environment is the magnitude dimension of the sensory experience: how many objects are around us? And how big are they? How long and how frequent are the important events occurring in a visual scene? To answer these questions, the brain must process magnitude information in a fast and reliable way. An important characteristic of sensory information allowing to make decisions in a reliable way is its stability: objects do not suddenly change in their appearance or position, and we usually perceive the world as a continuous, seamless, stream of information. This is however not trivial, as the machinery of our brain and sensory organs is noisy, and sensory information is made discontinuous by the instability of biological sensors like the eye, constantly moving and shifting to scan the environment. The overarching goal of NeSt was thus to understand how the brain ensures a stable and continuous processing of magnitude information. Understanding the mechanisms of stability is indeed fundamental to further understand how the brain works on a broader level, and to understand how our conscious experience is constructed based on the available sensory information. With NeSt, we have extensively explored the mechanisms and functional properties of stability in magnitude perception, characterizing the rules governing stability across different perceptual dimensions and sensory modalities, the consequences of stability on perception and decision-making, and the dynamics of brain processes involved in stability.
Across two main work packages, we used psychophysical, electroencephalography (EEG), and brain stimulation techniques (TMS) to address the processes of perceptual stability in magnitude perception.
The first research work package (WP2) was based on psychophysics and EEG. First, we investigated how the brain exploits information over time across multiple magnitude dimensions (size, duration, and numerosity) in the service of perceptual stability (Exp. 1). To this aim, we measured the psychophysical “serial dependence” effect, a perceptual bias whereby a stimulus that we are currently seeing appears more similar to what we saw in the recent past, while concurrently recording the EEG responses to the visual stimuli. Moreover, we also measured the neural signature of stability using a passive-viewing approach during EEG recording (Exp. 2), which allows to capture the perceptual aspects of stability in the absence of decision-making. In three subsequent studies (Exp. 3, Exp. 4, Exp. 5), we further addressed the specificity of the serial dependence effect for the task-relevance of different magnitude dimensions (i.e. whether they are actively judged or not), the interaction between perceptual stability and magnitude integration, and the nature of the magnitude integration effect itself. Magnitude integration is indeed an important feature of perception, and defines how we perceive a given dimension when multiple magnitudes are concurrently modulated. However, its brain mechanisms and relation with perceptual stability are unclear. Finally, in Exp. 6 and Exp. 7, we addressed whether stability in magnitude perception involves a generalized mechanism encompassing different perceptual dimensions and sensory modalities, or a series of distinct mechanisms. Overall, our results show that the neural and behavioural signatures of stability can be dissociated: the first seems to more genuinely capture perceptual processing, the second also involves decision-making processes. Our results also showed that magnitude integration is mediated by an active mechanism “binding” the different dimensions of an object, and not by a trivial interference, although it does not directly interact with stability. Finally, our results also suggest that the brain possesses different and potentially independent mechanisms mediating stability in different domains and sensory modalities, following different rules and showing different patterns of brain activity. The work in this WP has been presented at the ESCoP 2019 meeting, at the CyPi 2019 workshop, at the EWCN 2020, and will be presented at the ECVP meeting in 2021.
In the second research WP (WP3), we used TMS to further address the mechanisms of stability in magnitude perception. TMS involves delivering a magnetic pulse disrupting brain activity in a specific cortical area at a specific time, with a high degree of spatial and temporal precision. In this study, we focused on the serial dependence effect in numerosity and time perception, considering it as a correlate of perceptual stability (i.e. the consequence of stability on perception), and delivered TMS to the primary visual cortex (V1) at different times while participants judged the numerosity or duration of visual stimuli. Our results show that TMS to area V1 can successfully disrupt serial dependence, abolishing the effect, and crucially it does so in a time-sensitive fashion, depending on which brain processing stage gets disrupted. With this study, we have provided for the first time causal evidence for the involvement of V1 in perceptual stability, and demonstrated the timing of its involvement.
The first research work package (WP2) was based on psychophysics and EEG. First, we investigated how the brain exploits information over time across multiple magnitude dimensions (size, duration, and numerosity) in the service of perceptual stability (Exp. 1). To this aim, we measured the psychophysical “serial dependence” effect, a perceptual bias whereby a stimulus that we are currently seeing appears more similar to what we saw in the recent past, while concurrently recording the EEG responses to the visual stimuli. Moreover, we also measured the neural signature of stability using a passive-viewing approach during EEG recording (Exp. 2), which allows to capture the perceptual aspects of stability in the absence of decision-making. In three subsequent studies (Exp. 3, Exp. 4, Exp. 5), we further addressed the specificity of the serial dependence effect for the task-relevance of different magnitude dimensions (i.e. whether they are actively judged or not), the interaction between perceptual stability and magnitude integration, and the nature of the magnitude integration effect itself. Magnitude integration is indeed an important feature of perception, and defines how we perceive a given dimension when multiple magnitudes are concurrently modulated. However, its brain mechanisms and relation with perceptual stability are unclear. Finally, in Exp. 6 and Exp. 7, we addressed whether stability in magnitude perception involves a generalized mechanism encompassing different perceptual dimensions and sensory modalities, or a series of distinct mechanisms. Overall, our results show that the neural and behavioural signatures of stability can be dissociated: the first seems to more genuinely capture perceptual processing, the second also involves decision-making processes. Our results also showed that magnitude integration is mediated by an active mechanism “binding” the different dimensions of an object, and not by a trivial interference, although it does not directly interact with stability. Finally, our results also suggest that the brain possesses different and potentially independent mechanisms mediating stability in different domains and sensory modalities, following different rules and showing different patterns of brain activity. The work in this WP has been presented at the ESCoP 2019 meeting, at the CyPi 2019 workshop, at the EWCN 2020, and will be presented at the ECVP meeting in 2021.
In the second research WP (WP3), we used TMS to further address the mechanisms of stability in magnitude perception. TMS involves delivering a magnetic pulse disrupting brain activity in a specific cortical area at a specific time, with a high degree of spatial and temporal precision. In this study, we focused on the serial dependence effect in numerosity and time perception, considering it as a correlate of perceptual stability (i.e. the consequence of stability on perception), and delivered TMS to the primary visual cortex (V1) at different times while participants judged the numerosity or duration of visual stimuli. Our results show that TMS to area V1 can successfully disrupt serial dependence, abolishing the effect, and crucially it does so in a time-sensitive fashion, depending on which brain processing stage gets disrupted. With this study, we have provided for the first time causal evidence for the involvement of V1 in perceptual stability, and demonstrated the timing of its involvement.
Overall, the work carried out during NeSt has pushed the boundaries of our understanding of magnitude processing and perceptual stability, going significantly beyond the state of the art. Work in WP2 provided new evidence suggesting a possible dissociation between the mechanisms purely dedicated to stability, and the processes mediating serial dependence. This is particularly important, and suggests that a shift of paradigm is necessary in the serial dependence and perceptual stability research fields, which could benefit from a more extensive use of techniques such as the EEG. This observation is thus very promising and has the potential to spur research in new directions to advance our understanding of stability and serial dependence. Additionally, the finding of different stability mechanisms in different domains and sensory modalities is important as well, as it might explain the inconsistency of results obtained by different studies testing serial dependence with different paradigms. Second, evidence gathered in WP3 provided for the first time robust cause-effect evidence for the involvement of the primary visual cortex in establishing serial dependence, showing that although modulated by decision-making, this effect is deeply rooted into the sensory processing stream. This in turn might inform the development of new models of stability and serial dependence, taking into account the physiological properties of primary sensory areas. Taken together, these results are expected to have an important impact in the perceptual science and neuroscience fields, opening new frontiers and deepening our understanding not only of perceptual stability and magnitude perception, but also of how our brain works on a broader level. Overall, the findings achieved during NeSt represent an important step forward towards the ultimate goal of explaining how our conscious experience of the external world is generated by the brain.
No website has been developed for the project, but a summary of the work and results has been published on the group’s website (http://www.buetilab.com/michele-fornaciai/).
No website has been developed for the project, but a summary of the work and results has been published on the group’s website (http://www.buetilab.com/michele-fornaciai/).