Periodic Reporting for period 2 - PlasticityOfMind (Plasticity of the Predictive Mind)
Reporting period: 2023-08-01 to 2025-01-31
The workings of the human mind have been a topic of active debate among philosophers for millennia, and more recently, also in modern science. Over the past few decades, advances in non-invasive brain imaging methods, including EEG and fMRI, have permitted real-time examination of the brain mechanisms supporting mental processes and behavior. This approach has yielded tremendous insights into human cognition and its neurobiological basis, giving rise to the interdisciplinary field of cognitive neuroscience. So far, most cognitive neuroscience research has focused on identifying the specific brain systems involved in cognitive functions, such as attention and memory, and even consciousness, assuming a functional architecture of serial information processing stages from sensory to cognitive to motor control stages, each subserved by distinct regions and networks in the brain. However, over the past decade or so, it has become apparent that the boundaries between brain systems and the functions they support are blurry at best. For example, activity in visual brain regions, traditionally associated with visual information processing, has been shown to reflect memories and actions to be made, i.e. not visual input per se. This has led to a conceptual revolution in psychology and neuroscience and the embracement of theoretical notions in which the brain is not treated as an information-processing system, but approached as an information-generating system, which continuously tests competing hypotheses about the world through (mental) action. This perspective, which resonates with action-oriented views of perception and cognition, assigns crucial importance to action: because the brain lacks direct access to the outside world, predictions can only be tested by generating information through action. Thereby, perception is strongly shaped by predictions about the sensory outcomes of actions and may even constitutively rest on action. Goal-directed cognitive processes are similarly understood as internal predictive activity serving information generation, but covertly and over longer time scales (they are mental actions). Moreover, in this perspective, in contrast to long held notions of the adult brain as a rather static organ, emphasis is placed on the plasticity of the brain, as it continuously adapts based on new experiences and changes in the structure of the generated input. Indeed, parallel developments in the field of cognitive neuroscience indicate that even the adult brain may undergo continuous changes in response to sensory input, associations, reward signals, motor acts, and even awareness itself.
In a time where our conception of the brain is moving rapidly towards an information and prediction generating system, in which learning through (mental) action is central, it becomes crucial to investigate it as such. This ERC project aims to do so to enhance our understanding of the plasticity and action-oriented nature of perception and cognition. It specifically examines how, at the neural level, self-generated (mental) action influences how we (learn to) perceive the world around us using an innovative combination of psychophysics, neuroimaging, virtual reality, and modelling in healthy individuals and expert meditators.
The research program comprises four projects, investigating 1) how we learn to predict the sensory outcomes of our actions and how this shapes perception; 2) the hypothesis that perception constitutively rests on action; 3) the plasticity of the higher-order cognitive operations that comprise mental actions; and 4) the control that people may exert over such mental actions. This promises to provide an integrative framework for understanding the neural mechanisms and plasticity of action-oriented perception and cognition, with clear clinical implications.
In a time where our conception of the brain is moving rapidly towards an information and prediction generating system, in which learning through (mental) action is central, it becomes crucial to investigate it as such. This ERC project aims to do so to enhance our understanding of the plasticity and action-oriented nature of perception and cognition. It specifically examines how, at the neural level, self-generated (mental) action influences how we (learn to) perceive the world around us using an innovative combination of psychophysics, neuroimaging, virtual reality, and modelling in healthy individuals and expert meditators.
The research program comprises four projects, investigating 1) how we learn to predict the sensory outcomes of our actions and how this shapes perception; 2) the hypothesis that perception constitutively rests on action; 3) the plasticity of the higher-order cognitive operations that comprise mental actions; and 4) the control that people may exert over such mental actions. This promises to provide an integrative framework for understanding the neural mechanisms and plasticity of action-oriented perception and cognition, with clear clinical implications.
The project is currently in full swing. First findings show that predictions externalized through action differ from predictions induced by passive information processing, which has important implications for the study of the brain’s predictive activity. Building on these first findings, current work tests the hypothesis that predictive learning involves the integration of actions and their sensory outcomes in a context-dependent manner, similar to the formation of ‘event files’ that include goals, actions, and outcomes. To this end, EEG is combined with multivariate decoding and representational similarity analyses to detect conjunction representations in the brain. If found, this would provide novel evidence for the notion that action and perception are intrinsically intertwined.
In another line of work, we have shown that also higher-level mental processes, such as working memory and distractor inhibition, are fundamentally action oriented. For example, actions planned on objects held in mind can strengthen and even warp their (veridical) sensory representations such that they better serve behavior. In another study, we found that distractor inhibition is constrained by sensorimotor processing and grounded in action control.
In a final line of work, we examine the extent to which control over predictive activity and perception is possible as a function of meditation expertise. Meditation experience did not affect structure learning in one study, but in another study, some expert meditators could top-down alter automatic perception, as shown with EEG-based multivariate decoding. These first findings shed novel light on the automaticity and plasticity of the predictive mind, identifying the extent to which control over predictive processing is possible through mental training.
In another line of work, we have shown that also higher-level mental processes, such as working memory and distractor inhibition, are fundamentally action oriented. For example, actions planned on objects held in mind can strengthen and even warp their (veridical) sensory representations such that they better serve behavior. In another study, we found that distractor inhibition is constrained by sensorimotor processing and grounded in action control.
In a final line of work, we examine the extent to which control over predictive activity and perception is possible as a function of meditation expertise. Meditation experience did not affect structure learning in one study, but in another study, some expert meditators could top-down alter automatic perception, as shown with EEG-based multivariate decoding. These first findings shed novel light on the automaticity and plasticity of the predictive mind, identifying the extent to which control over predictive processing is possible through mental training.
Not just our perceptual experience, but also how we think is proposed to be strongly driven by our past (mental) actions, that ultimately allow us to predict and navigate the outside world. This makes it essential to better understand the plasticity and action-oriented nature of the predictive mind. This ERC project promises to do so using a unique set of methods and interventions. Findings will have far reaching implications for current theories of perception and visual awareness, that typically do not consider perception for vision as constitutively resting on action. They will also have important implications for how we understand human thought: as action-oriented, probabilistic and predictive. This is a radically different view from traditional notions of high-level cognitive processes as abstract and general, and as operating independently from the knowledge that they latch onto and the action context in which they occur. Finally, insights gained regarding the ability to exert control over mental actions may inform future studies in clinical disorders characterized by dysfunctional thought patterns.