Periodic Reporting for period 2 - BODYinTRANSIT (Sensory-driven Body Transformation Experiences On-the-move)
Okres sprawozdawczy: 2023-07-01 do 2024-12-31
Our physical body is the interface between ourselves and the world around us. The way we perceive our body, its appearance, configuration and motor abilities shapes our behaviour, emotion and social functioning. Recent advances in sensing technologies coupled with bodily sensory feedback devices are paving the way for body transformation experiences (BTE) or perceptual experiences of one’s body changing. Imagine a perceptual illusion like being in a child’s body. Beyond fun experiences, BTE technologies can bring significant advancements for wellbeing and health applications for different clinical conditions, as well as opening possibilities for applications for sports, virtual reality, robotics, fashion design and the Arts. The aim of this ERC-funded project BODYinTRANSIT is to establish a new fundamental knowledge base for individualised sensorial manipulation of body perceptions that will enable future BTE technologies and applications. To induce, preserve, measure, model, personalize and support Body Transformation Experiences the project relies on neuroscience of multisensory body perception, data modelling, wearable-based embodied multisensory interaction design and field studies in real life and on-the-move contexts with physically inactive users, somatic practitioners and users with body image concerns.
The work has been carried out as planned with significant progress made on the five research objectives (RO):
RO1: Development of a theoretical framework integrating multidisciplinary research on MBR (Mental Body Representations) and guiding the design of future BTE (Body Transformation Experiences) technologies: We are conducting studies investigating the effects of different sensory combinations and top-down influences on body perception, to contribute to the theoretical framework. Our work focuses on 1) the design and optimization of measures of MBR and 2) strategies, methods, and prototypes for BTE interventions, including the utilization of material metaphors to transform body perceptions. Key contributions include embodied design explorations that have led to critical knowledge synthesis and a pragmatic integrative approach combining design research with quantitative sensory neuroscience methods.
RO2: Identification, mapping, and validation of the most effective non-visual cue combinations and underlying top-down and bottom-up mechanisms for transforming MBR in terms of body appearance and capabilities: Using a full-body motion suit, sensors, and questionnaires, we built a data corpus (N>100) to model behavior-MBR relationships and study individual differences in sound effects. Additionally, we identified key sensory cues for anchoring sound to the body, examined their emotional impact, and explored spatial metaphors for altering perceived body capabilities.
RO3: Understanding and quantifying the within- and between-subject interdependence of MBR with behavior, emotion, and self-identity: Using our data corpus (RO2), we are analyzing interdependencies and have developed deep learning models for real-time MBR assessment. Additionally, we are working on sensory input optimization, along with innovative architectures enabling MBR inference on wearable and edge devices.
RO4: Investigation of the short- and long-term effects on MBR malleability and persistence, including longitudinal and field studies with representative populations: Our studies with individuals with anorexia nervosa and subclinical eating disorders revealed disturbances in sensory integration, altering body perceptions. Additionally, our research with physically inactive users and professional dancers which encompasses embodied design exploration sessions, controlled lab studies, and 4-week home studies, demonstrates how sensory effects evolve over time, influenced by exposure timing, metaphor types, and individual traits.
RO5: Laying the knowledge basis for new technologies supporting the “inner fashion” concept which uses smart clothing to shape body perception, as validated in real-life studies: We are designing BODYinTRANSIT interactive gear through user-centered iterative approaches. We ran various thematic workshops in the form of embodied design explorations engaging various user cohorts (physically inactive, professional dancers with body concerns, general population). Art-science residencies contributed creative solutions. We are developing a toolkit for optimizing BTE wearables for real-life use.
The results of these activities have been disseminated through publications, conference presentations, seminars, demos, a dedicated website, social media, public events, and artistic performances. Notably, we organized an international conference on Body Representation.
These activities have been made possible through the establishment of a new laboratory known as i_mBODY Lab - Interactive Multisensory Body-centred Experiences at the Intersection of Neuroscience & Technology. This innovative lab integrates a maker space for prototyping, experimental testing capabilities and resources for sensory stimulation and body tracking.
RO1: Development of a theoretical framework integrating multidisciplinary research on MBR (Mental Body Representations) and guiding the design of future BTE (Body Transformation Experiences) technologies: We are conducting studies investigating the effects of different sensory combinations and top-down influences on body perception, to contribute to the theoretical framework. Our work focuses on 1) the design and optimization of measures of MBR and 2) strategies, methods, and prototypes for BTE interventions, including the utilization of material metaphors to transform body perceptions. Key contributions include embodied design explorations that have led to critical knowledge synthesis and a pragmatic integrative approach combining design research with quantitative sensory neuroscience methods.
RO2: Identification, mapping, and validation of the most effective non-visual cue combinations and underlying top-down and bottom-up mechanisms for transforming MBR in terms of body appearance and capabilities: Using a full-body motion suit, sensors, and questionnaires, we built a data corpus (N>100) to model behavior-MBR relationships and study individual differences in sound effects. Additionally, we identified key sensory cues for anchoring sound to the body, examined their emotional impact, and explored spatial metaphors for altering perceived body capabilities.
RO3: Understanding and quantifying the within- and between-subject interdependence of MBR with behavior, emotion, and self-identity: Using our data corpus (RO2), we are analyzing interdependencies and have developed deep learning models for real-time MBR assessment. Additionally, we are working on sensory input optimization, along with innovative architectures enabling MBR inference on wearable and edge devices.
RO4: Investigation of the short- and long-term effects on MBR malleability and persistence, including longitudinal and field studies with representative populations: Our studies with individuals with anorexia nervosa and subclinical eating disorders revealed disturbances in sensory integration, altering body perceptions. Additionally, our research with physically inactive users and professional dancers which encompasses embodied design exploration sessions, controlled lab studies, and 4-week home studies, demonstrates how sensory effects evolve over time, influenced by exposure timing, metaphor types, and individual traits.
RO5: Laying the knowledge basis for new technologies supporting the “inner fashion” concept which uses smart clothing to shape body perception, as validated in real-life studies: We are designing BODYinTRANSIT interactive gear through user-centered iterative approaches. We ran various thematic workshops in the form of embodied design explorations engaging various user cohorts (physically inactive, professional dancers with body concerns, general population). Art-science residencies contributed creative solutions. We are developing a toolkit for optimizing BTE wearables for real-life use.
The results of these activities have been disseminated through publications, conference presentations, seminars, demos, a dedicated website, social media, public events, and artistic performances. Notably, we organized an international conference on Body Representation.
These activities have been made possible through the establishment of a new laboratory known as i_mBODY Lab - Interactive Multisensory Body-centred Experiences at the Intersection of Neuroscience & Technology. This innovative lab integrates a maker space for prototyping, experimental testing capabilities and resources for sensory stimulation and body tracking.
The project aims to generate fundamental knowledge for the emerging field of Body-Transformation Experiences (BTE) engineering, integrating research from various disciplines. This endeavor may revolutionize everyday body perceptions and enable the design of BTE technologies for real-life scenarios.
Scientifically, it is expected that the results by the end of the project will lead to significant breakthroughs, including:
- The identification of links between mental Body Representations (MBR) and behavioral, emotional, and self-identity variables.
- The reformulation of principles of multisensory body perception to incorporate novel sensory combinations, top-down influences, and MBR-behavior links
- The development of a real-time measure of MBR changes (rtMBR) based on modeling
- The exploration of new non-visual BTE paradigms arising from in-the-wild research.
Technologically, BODYinTRANSIT will lay the foundation for next-generation BTE technologies by establishing theoretical principles and an rtMBR measure that underlie the design of personalized BTE systems. Technological breakthroughs will include:
- Reduced-order modeling methods for optimizing body-tracking interfaces.
- Prototypes of BTE wearable technology developed within the project.
- Data-driven models that map links between MBR and behavior, emotion, and self-identity.
- Datasets with the experimental data corpus.
On a societal level, the in-the-wild studies involving various populations will uncover strategies for improving health and well-being, specifically targeting negative body perceptions. These applications have the potential to impact users' motor and social behavior, emotional state, self-identity, and body satisfaction. The translation of these principles into technological tools for fashion design and production opens up opportunities in sports, wearable technologies, and retail, among other fields. Dissemination and communication activities will engage stakeholders through art residencies, workshops, and real-life demonstrations.
Scientifically, it is expected that the results by the end of the project will lead to significant breakthroughs, including:
- The identification of links between mental Body Representations (MBR) and behavioral, emotional, and self-identity variables.
- The reformulation of principles of multisensory body perception to incorporate novel sensory combinations, top-down influences, and MBR-behavior links
- The development of a real-time measure of MBR changes (rtMBR) based on modeling
- The exploration of new non-visual BTE paradigms arising from in-the-wild research.
Technologically, BODYinTRANSIT will lay the foundation for next-generation BTE technologies by establishing theoretical principles and an rtMBR measure that underlie the design of personalized BTE systems. Technological breakthroughs will include:
- Reduced-order modeling methods for optimizing body-tracking interfaces.
- Prototypes of BTE wearable technology developed within the project.
- Data-driven models that map links between MBR and behavior, emotion, and self-identity.
- Datasets with the experimental data corpus.
On a societal level, the in-the-wild studies involving various populations will uncover strategies for improving health and well-being, specifically targeting negative body perceptions. These applications have the potential to impact users' motor and social behavior, emotional state, self-identity, and body satisfaction. The translation of these principles into technological tools for fashion design and production opens up opportunities in sports, wearable technologies, and retail, among other fields. Dissemination and communication activities will engage stakeholders through art residencies, workshops, and real-life demonstrations.