EnTimeMent - ENtrainment and synchronization at multiple TIME scales in the MENTal foundations of expressive gesture

Livrables

Documents, reports (23)

Data acquisition analytic tools for complex actions

Data acquisition will consist on motion capture video recordings electroencephalography NIRS Near Infrared Spectroscopy fMRI electromyography and autonomic activity Extraction of behavioral and physiological indexes of action prediction will be basedupon computational pipelines inspired to Becchio et al 2017 and to Granger causality indexes of sensorimotor information exchange see the computational pipeline described in DAusilio et al 2012 Badino et al 2014

Ethics requirements and procedures

A document containing the procedures adopted in EnTimeMent for ethically responsible research, and for recruiting participants, for informed consent, and for data protection, to be used in the first round of experiments.

Proof-of-Concept Testing and Validation in chronic pain management in everyday life - Phase 1

Summative evaluation of the EnTimeMent proofofconcepts carried out in a series of short lab and in situ studies comprising interviews with and observations of users of thetechnology and an evaluation of the effectiveness and efficiency of the users and their satisfaction while performing the envisaged activities

Proof-of-Concept Testing and Validation in healing and everyday life support of disabled - Phase 2

Summative evaluation of the EnTimeMent proofofconcepts carried out in a series of short lab and in situ studies comprising interviews with and observations of users of thetechnology and an evaluation of the effectiveness and efficiency of the users and their satisfaction while performing the envisaged activities

Dissemination & Communication plan

Planning of Dissemination & Communication activities during the first year of the project, as well as execution and reporting of the planned Dissemination and Communication Activities, including presentation of scientific papers in top-level international conferences and journals, public events and workshops including the EU FET Conference.

Final evaluation report - Phase 1

Summative evaluation will be carried out in the final part of the project and will produce the final evaluation report It may also consist of participation in contests and hackathons where teams are supported by the developed technology

Updated ethics requirements and procedures

A revision of D71 taking into account the results of quality control to improve operational ethics procedures to be used in the second round of basic research technological developments experiments and scenarios if necessary

Project management handbook and quality assurance manual

A report summarising the activities carried out in the first reporting period.

Research requirements for laboratory and ecological experimental scenarios - Phase 2

Refinement of research requirements after the first experiments, according to the obtained feedback and results.

Research requirements for laboratory and ecological experimental scenarios - Phase 1

Research requirements for the project, definition of hypotheses for experiments, detailed description of experimental scenarios (technical needs, algorithms required for feature extraction and data analysis), procedures for assessment and evaluation.

Models and algorithms - Phase 1

Elaboration of multitemporal predictive models in the context of dyadic and group interaction

Predictions of multi-scale, temporally aggregated, social-motor synchronization models - Phase 3

Experiments exploring the multiscale nature of human action

Data acquisition analytic tools for IMS & GMS

Data acquisition will consist on motion capture video recordings electromyographyelectroencephalography NIRS Extraction of behavioral and physiological indexes at multiple time scales revealing a Individual Motor Signature IMS of how we move in synchrony will be based upon the use of Multidimensional scaling Analysis and Similarity Space techniques during solo duo and group sensorimotor exchanges see the computational pipeline described in Slowinski et al 2016 2017 GMS indexGroup Motor Signature will be developed based on multiscale IMS index in order to analyse data collected in WP2 and evaluate movement qualities cascading from milliseconds to minutes

Data acquisition analytic tools for individual actions

Data acquisition will consist on motion capture, video recordings, electroencephalography, NIRS (Near Infrared Spectroscopy), fMRI, electromyography and autonomic activity. Extraction of behavioral and physiological indexes of action prediction will be based upon computational pipelines inspired to (Becchio et al., 2017) and to Granger causality indexes of sensorimotor information exchange (see the computational pipeline described in D’Ausilio et al., 2012; Badino et al., 2014).

Data management plan

First draft of the plan for making data findable, accessible, interoperable and reusable.

Proof-of-Concept Testing and Validation in dance, living architectures, sports and entertainment - Phase 2

Summative evaluation of the EnTimeMent proofofconcepts carried out in a series of short lab and in situ studies comprising interviews with and observations of users of thetechnology and an evaluation of the effectiveness and efficiency of the users and their satisfaction while performing the envisaged activities

Predictions of multi-scale, temporally aggregated, social-motor synchronization models - Phase 1

Experiments exploring the multi-scale nature of human action.

Models and algorithms - Phase 2

Elaboration of multitemporal predictive models in the context of dyadic and group interaction

Proof-of-Concept Testing and Validation in dance, living architectures, sports and entertainment - Phase 1

Summative evaluation of the EnTimeMent proofofconcepts carried out in a series of short lab and in situ studies comprising interviews with and observations of users of thetechnology and an evaluation of the effectiveness and efficiency of the users and their satisfaction while performing the envisaged activities

Proof-of-Concept Testing and Validation in healing and everyday life support of disabled - Phase 1

Summative evaluation of the EnTimeMent proofofconcepts carried out in a series of short lab and in situ studies comprising interviews with and observations of users of thetechnology and an evaluation of the effectiveness and efficiency of the users and their satisfaction while performing the envisaged activities

Data acquisition analytic tools for joint actions

Data acquisition will consist on motion capture video recordings electroencephalography NIRS Near Infrared Spectroscopy fMRI electromyography and autonomic activity Extraction of behavioral and physiological indexes of action prediction will be basedupon computational pipelines inspired to Becchio et al 2017 and to Granger causality indexes of sensorimotor information exchange see the computational pipeline described in DAusilio et al 2012 Badino et al 2014

Predictions of multi-scale, temporally aggregated, social-motor synchronization models - Phase 2

Experiments exploring the multiscale nature of human action

Proof-of-Concept Testing and Validation in chronic pain management in everyday life - Phase 2

Summative evaluation of the EnTimeMent proofofconcepts carried out in a series of short lab and in situ studies comprising interviews with and observations of users of thetechnology and an evaluation of the effectiveness and efficiency of the users and their satisfaction while performing the envisaged activities

Open Research Data Pilot (10)

EnTimeMent platform and software libraries for multi-time analysis, entrainment, and prediction - Phase 3

The platform will integrate the sensor systems adopted in the project including motion capture multichannel video and audio recordings electroencephalography NIRS electromyography and autonomic activity to support the software libraries for analysis and measures of entrainment and prediction at multiple temporal scales

Results on prediction in action execution and observation - Phase 2

Testing whether neurobehavioral MoCap EMG EEG TMS fNIRS and autonomic indexes GSR HRV describing the pragmatic details and emotional valence of the distal action goal are anticipatorily modulated both in action execution and observation

Results on prediction in complex action execution and observation - Phase 1

Exploring the existence of multiple channels of sensorimotor communication acting at different timescales during group synchronization situations Investigating if these timescales allow different behavioural prediction at the individual and group level and which one of them correlates with the autonomic indexes reflecting the affective dimension of group coordination Evaluating whether the IMS Individual Motor Signature Slowinski et al 2016 and GMS Group Motor Signature and their dynamics at multiple timescales express the movement social and affective qualities of the complex action of interest

Results on prediction in dyadic action execution and observation - Phase 2

Extrapolating the kinematics features MoCap EMG autonomic responses GSR HRV and neural antecedents EEGfNIRS used to predict the expressive content of others actions

EnTimeMent platform and software libraries for multi-time analysis, entrainment, and prediction - Phase 1

The platform will integrate the sensor systems adopted in the project (including motion capture, multichannel video and audio recordings, electroencephalography, NIRS, electromyography and autonomic activity) to support the software libraries for analysis and measures of entrainment and prediction at multiple temporal scales.

Results on prediction in dyadic action execution and observation - Phase 1

Extrapolating the kinematics features MoCap EMG autonomic responses GSR HRV and neural antecedents EEGfNIRS used to predict the expressive content of others actions

Results on prediction in action execution and observation - Phase 1

Testing whether neurobehavioral MoCap EMG EEG TMS fNIRS and autonomic indexes GSR HRV describing the pragmatic details and emotional valence of the distal action goal are anticipatorily modulated both in action execution and observation

Annotated open-source dataset

A data collection protocol will be defined to maximize the use of the collected data across WPs where possible The dataset will be annotated as needed to reflect the different temporalscale movements and related physiological and neural signals that needs to be captured and represented Part of the dataset will be opened to the community where ethics allows

Results on prediction in Complex Action execution and observation - Phase 2

Exploring the existence of multiple channels of sensorimotor communication acting at different timescales during group synchronization situations Investigating if these timescales allow different behavioural prediction at the individual and group level and which one of them correlates with the autonomic indexes reflecting the affective dimension of group coordination Evaluating whether the IMS Individual Motor Signature Slowinski et al 2016 and GMS Group Motor Signature and their dynamics at multiple timescales express the movement social and affective qualities of the complex action of interest

EnTimeMent platform and software libraries for multi-time analysis, entrainment, and prediction - Phase 2

The platform will integrate the sensor systems adopted in the project including motion capture multichannel video and audio recordings electroencephalography NIRS electromyography and autonomic activity to support the software libraries for analysis and measures of entrainment and prediction at multiple temporal scales

Other (3)

Hackathons and Users Community Workshops - Phase 3

Qualisys will involve their users community and will include EnTimeMent events as main events in their consolidated Qualisys Users Workshops contributing to the consolidation of a multidisciplinary EnTimeMent users community

Hackathons and Users Community Workshops - Phase 1

Qualisys will involve their users’ community, and will include EnTimeMent events as main events in their consolidated Qualisys Users Workshops, contributing to the consolidation of a multidisciplinary EnTimeMent users’ community.

Hackathons and Users Community Workshops - Phase 2

Qualisys will involve their users community and will include EnTimeMent events as main events in their consolidated Qualisys Users Workshops contributing to the consolidation of a multidisciplinary EnTimeMent users community

Websites, patent fillings, videos etc. (1)

Project Website

EnTimeMent Website creation, updating, maintenance and support.

Publications

Peer reviewed articles (49)

The role of computational and subjective features in emotional body expressions

Auteurs: Marta Poyo Solanas, Maarten J. Vaessen, Beatrice de Gelder
Publié dans: Scientific Reports, Volume:10, Issue:1, 2020, ISSN 2045-2322
Éditeur: Nature Publishing Group
DOI: 10.1038/s41598-020-63125-1

Role of sensorimotor areas in early detection of motor errors: an EEG and TMS study

Auteurs: Laura Maffongelli, Elisabetta Ferrari, Eleonora Bartoli, Claudio Campus, Etienne Olivier, Luciano Fadiga, Alessandro D’Ausilio
Publié dans: Behavioural Brain Research, Volume:378, Month:January, 2020, ISSN 0166-4328
Éditeur: Elsevier BV
DOI: 10.1016/j.bbr.2019.112248

Interpersonal Entrainment in Music Performance: Theory, Method, and Model

Auteurs: Martin Clayton, Kelly Jakubowski, Tuomas Eerola, Peter E. Keller, Antonio Camurri, Gualtiero Volpe, Paolo Alborno
Publié dans: Music Perception, Volume:38, Number:2, 2020, Page(s) 136-194, ISSN 0730-7829
Éditeur: University of California at Berkeley
DOI: 10.1525/mp.2020.38.2.136

huSync - A Model and System for the Measure of Synchronization in Small Groups: A Case Study on Musical Joint Action

Auteurs: Sanket Rajeev Sabharwal, Manuel Varlet, Matthew Breaden, Gualtiero Volpe, Antonio Camurri, Peter E. Keller
Publié dans: IEEE Access, Volume:10, 2022, Page(s) 92357-92372, ISSN 2169-3536
Éditeur: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2022.3202959

Interacting humans use forces in specific frequencies to exchange information by touch

Auteurs: C. Colomer, M. Dhamala, G. Ganesh, J. Lagarde
Publié dans: Scientific Reports, Volume:12, 2022, Page(s) 1-12, ISSN 2045-2322
Éditeur: Nature Publishing Group
DOI: 10.1038/s41598-022-19500-1

Automated Analysis of the Origin of Movement: An Approach Based on Cooperative Games on Graphs

Auteurs: Ksenia Kolykhalova, Giorgio Gnecco, Marcello Sanguineti, Gualtiero Volpe, Antonio Camurri
Publié dans: IEEE Transactions on Human-Machine Systems, Volume:50, Month:December, 2020, Page(s) 550-560, ISSN 2168-2291
Éditeur: IEEE Systems, Man, and Cybernetics Society
DOI: 10.1109/thms.2020.3016085

Impact of emotion-laden acoustic stimuli on group synchronisation performance

Auteurs: Marta M. N. Bieńkiewicz, Stefan Janaqi, Pierre Jean, Benoît G. Bardy
Publié dans: Scientific Reports, Volume: 13, 2023, ISSN 2045-2322
Éditeur: Nature Publishing Group
DOI: 10.1038/s41598-023-34406-2

Human Movement Datasets: An Interdisciplinary Scoping Review

Auteurs: Temitayo Olugbade, Marta Bieńkiewicz, Giulia Barbareschi, Vincenzo D’amato, Luca Oneto, Antonio Camurri, Catherine Holloway, Mårten Björkman, Peter Keller, Martin Clayton, Amanda C De C Williams, Nicolas Gold, Cristina Becchio, Benoît Bardy, Nadia Bianchi-Berthouze
Publié dans: Association for Computing Machinery, ACM Comput. Surv., Volume:55, 2022, ISSN 0360-0300
Éditeur: Association for Computing Machinary, Inc.
DOI: 10.1145/3534970

Mechanisms of Hebbian-like plasticity in the ventral premotor--primary motor network

Auteurs: Andrea Casarotto, Elisa Dolfini, Pasquale Cardellicchio, Luciano Fadiga, Alessandro D'Ausilio, Giacomo Koch
Publié dans: The Journal of Physiology, Volume:601, Number:1, 2023, Page(s) 211-226, ISSN 1469-7793
Éditeur: Wiley Online Library
DOI: 10.1113/jp283560

Decoding of emotion expression in the face, body and voice reveals sensory modality specific representations

Auteurs: Maarten J. Vaessen; Van der Heijden K; de Gelder B; de Gelder B
Publié dans: bioRxiv, 24, 2019, ISSN 0000-0000
Éditeur: Cold Spring Harbor Laboratory
DOI: 10.1101/869578

Interpersonal synchronization of movement intermittency

Auteurs: A. Tomassini, J. Laroche, M. Emanuele, G. Nazzaro, N. Petrone, L. Fadiga, A. D'Ausilio
Publié dans: iScience, Volume:25, 2022, Page(s) 104096, ISSN 2589-0042
Éditeur: ScienceDirect - Elsevier
DOI: 10.1016/j.isci.2022.104096

Modeling Frequency Reduction in Human Groups Performing a Joint Oscillatory Tasc

Auteurs: Calabrese, C., Bardy, B. G., de Lellis, P., & di Bernardo, M.
Publié dans: Frontiers in Psychology, 2022, ISSN 1664-1078
Éditeur: Frontiers Research Foundation
DOI: 10.3389/fpsyg.2021.753758

Chronic Pain Protective Behavior Detection with Deep Learning

Auteurs: Chongyang Wang, Temitayo A. Olugbade, Akhil Mathur, Amanda C. DE C. Williams, Nicholas D. Lane, Nadia Bianchi-Berthouze
Publié dans: ACM Transactions on Computing for Healthcare, Volume:2, Number:3, Article:23, 2021, Page(s) 1-24, ISSN 2691-1957
Éditeur: ACM
DOI: 10.1145/3449068

Motor Recruitment during Action Observation: Effect of Interindividual Differences in Action Strategy.

Auteurs: Pauline M. Hilt; Pasquale Cardellicchio; Elisa Dolfini; Thierry Pozzo; Thierry Pozzo; Luciano Fadiga; Luciano Fadiga; Alessandro D'Ausilio; Alessandro D'Ausilio
Publié dans: Cerebral Cortex (New York, NY), 30, July 2020, 2020, Page(s) 3910-3920, ISSN 1047-3211
Éditeur: Oxford University Press
DOI: 10.1093/cercor/bhaa006

Decoding social decisions from movement kinematics

Auteurs: Giacomo Turri, Andrea Cavallo, Luca Romeo, Massimiliano Pontil, Alan Sanfey, Stefano Panzeri, Cristina Becchio
Publié dans: iScience, Volume:25, Number:12, 2022, Page(s) 105550, ISSN 2589-0042
Éditeur: ScienceDirect, Elsevier
DOI: 10.1016/j.isci.2022.105550

Anticipatory postural adjustments during joint action coordination

Auteurs: A. A. Nogueira-Campos, P. M. Hilt, L. Fadiga, C. Veronesi, A. D’Ausilio, T. Pozzo
Publié dans: Scientific Reports, 9/1, 2019, ISSN 2045-2322
Éditeur: Nature Publishing Group
DOI: 10.1038/s41598-019-48758-1

Motor cortical inhibition during concurrent action execution and action observation

Auteurs: Pasquale Cardellicchio, Elisa Dolfini, Pauline M. Hilt, Luciano Fadiga, Alessandro D’Ausilio
Publié dans: NeuroImage, Volume:208, 2020, ISSN 1053-8119
Éditeur: Academic Press
DOI: 10.1016/j.neuroimage.2019.116445

Interpersonal sensorimotor communication shapes intrapersonal coordination in a musical ensemble

Auteurs: J. Laroche, A. Tomassini, G. Volpe, A. Camurri, L. Fadiga, A. D'Ausilio
Publié dans: Frontiers in Human Neuroscience, Volume: 16, 2022, ISSN 1662-5161
Éditeur: Frontiers Research Foundation
DOI: 10.3389/fnhum.2022.899676

Visual detection is locked to the internal dynamics of cortico-motor control

Auteurs: Alice Tomassini; Eric Maris; Pauline M. Hilt; Luciano Fadiga; Luciano Fadiga; Alessandro D'Ausilio; Alessandro D'Ausilio
Publié dans: PLoS Biology, Volume:18, Month:October, 2020, ISSN 0000-0000
Éditeur: PLoS Biology
DOI: 10.1371/journal.pbio.3000898

Computation-Based Feature Representation of Body Expressions in the Human Brain

Auteurs: Marta Poyo Solanas, Maarten Vaessen, Beatrice de Gelder
Publié dans: Cerebral Cortex, 2020, ISSN 1047-3211
Éditeur: Oxford University Press
DOI: 10.1093/cercor/bhaa196

Spontaneous emergence of leadership patterns drives synchronization in complex human networks

Auteurs: Calabrese, C., Lombardi, M., Bollt, E., De Lellis, P., Bardy, B. G., & di Bernardo, M.
Publié dans: Scientific Reports, 2021, ISSN 2045-2322
Éditeur: Nature Publishing Group
DOI: 10.1038/s41598-021-97656-y

Parallel fast and slow motor inhibition processes regulate Joint Action coordination

Auteurs: Pasquale Cardellicchio, Elisa Dolfini, Luciano Fadiga, Alessandro D'Ausilio
Publié dans: Cortex, Volume:133, 2020, Page(s) 346-357, ISSN 0010-9452
Éditeur: Masson Publishing
DOI: 10.1016/j.cortex.2020.09.029

The classical mean negative asynchrony in sensorimotor synchronization is not universal in humans. A cross-cultural study.

Auteurs: Julien Lagarde
Publié dans: PsyArXiv, Month:July, 2021, ISSN 0000-0000
Éditeur: Center for Open Science
DOI: 10.31234/osf.io/rf7ku

Intersecting kinematic encoding and readout of intention in autism

Auteurs: Noemi Montobbio, Andrea Cavallo , Dalila Albergo, Caterina Ansuini, Francesca Battaglia, Jessica Podda, Lino Nobili, Stefano Panzeri, Cristina Becchio
Publié dans: Proceedings of the National Academy of Sciences, 2022, Page(s) e2114648119, ISSN 1091-6490
Éditeur: United States National Academy of Sciences
DOI: 10.1073/pnas.2114648119

Understanding joint action: Current theoretical and empirical approaches

Auteurs: Robrecht P.R.D.van der Wel, Cristina Becchio, Arianna Curioni, ThomasWolf
Publié dans: Acta Psychologica, 2021, Page(s) 103285, ISSN 0001-6918
Éditeur: Elsevier BV
DOI: 10.1016/j.actpsy.2021.103285

Why do we move to the beat? A multi-scale approach, from physical principles to brain dynamics

Auteurs: Loïc Damm, Déborah Varoqui, Valérie Cochen De Cock, Simone Dalla Bella, Benoît Bardy,
Publié dans: Neuroscience & Biobehavioral Reviews, Volume: 112, 2020, Page(s) Pages 553-584, ISSN 0149-7634
Éditeur: Pergamon Press Ltd.
DOI: 10.1016/j.neubiorev.2019.12.024

Decoding identity from motion: how motor similarities colour our perception of self and others

Auteurs: Alexandre Coste, Benoît G. Bardy, Stefan Janaqi, Piotr Słowiński, Krasimira Tsaneva-Atanasova, Juliette Lozano Goupil, Ludovic Marin
Publié dans: Psychological Research, 2020, ISSN 0340-0727
Éditeur: Springer Verlag
DOI: 10.1007/s00426-020-01290-8

Modeling Multiple Temporal Scales of Full-body Movements for Emotion Classification

Auteurs: Cigdem Beyan; Sukumar Karumuri; Gualtiero Volpe; Antonio Camurri; Radoslaw Niewiadomski
Publié dans: IEEE Transactions on Affective Computing, 4, 2021, ISSN 1949-3045
Éditeur: Institute of Electrical and Electronics Engineers
DOI: 10.1109/taffc.2021.3095425

Beta rebound as an index temporal integration of somatosensory and motor signals

Auteurs: Pasquale Cardellicchio, Pauline M. Hilt, Elisa Dolfini, Luciano Fadiga, Alessandro D’Ausilio
Publié dans: Frontiers in Systems Neuroscience, Volume:14, Number:63, 2020, ISSN 0000-0000
Éditeur: Frontiers Media
DOI: 10.3389/fnsys.2020.00063

Understanding Violin Players Skills Level based on Motion Capture: a Data Driven Perspective

Auteurs: Vincenzo D'Amato, Erica Volta, Luca Oneto, Gualtiero Volpe, Antonio Camurri, Davide Anguita
Publié dans: Cognitive Computation, 2020, ISSN 1866-9964
Éditeur: Springer

The role of respiration audio in multimodal analysis of movement qualities

Auteurs: Vincenzo Lussu, Radoslaw Niewiadomski, Gualtiero Volpe, Antonio Camurri
Publié dans: Journal on Multimodal User Interfaces, 14/1, 2020, Page(s) 1-15, ISSN 1783-7677
Éditeur: Springer Verlag
DOI: 10.1007/s12193-019-00302-1

Moving in unison after perceptual interruption

Auteurs: Bardy, B.G., Calabrese, C., De Lellis, P. et al.
Publié dans: Scientific Reports, 2020, ISSN 2045-2322
Éditeur: Nature Publishing Group
DOI: 10.1038/s41598-020-74914-z

A computational neuroethology perspective on body and expression perception

Auteurs: Beatrice de Gelder, Marta Poyo Solanas
Publié dans: Trends in Cognitive Sciences, Volume:25, Number:9, 2021, Page(s) 744-756, ISSN 1364-6613
Éditeur: Elsevier BV
DOI: 10.1016/j.tics.2021.05.010

Towards an Embodied Signature of Improvisation Skills

Auteurs: Alexandre Coste, Benoît G. Bardy, Ludovic Marin
Publié dans: Frontiers in Psychology, 10, 2019, ISSN 1664-1078
Éditeur: Frontiers Research Foundation
DOI: 10.3389/fpsyg.2019.02441

Motor overload: GABAergic index of parallel buffer costs

Auteurs: Pasquale Cardellicchio, Giacomo Koch, Luciano Fadiga, Alessandro D'Ausilio
Publié dans: Brain Stimulation, Volume:14, Month:August, 2021, Page(s) 1106-1108, ISSN 1935-861X
Éditeur: Elsevier BV
DOI: 10.1016/j.brs.2021.07.061

Author Correction: Multi-layer adaptation of group coordination in musical ensembles

Auteurs: Pauline M. Hilt, Leonardo Badino, Alessandro D’Ausilio, Gualtiero Volpe, Serâ Tokay, Luciano Fadiga, Antonio Camurri
Publié dans: Scientific Reports, 10/1, 2020, ISSN 2045-2322
Éditeur: Nature Publishing Group
DOI: 10.1038/s41598-019-55965-3

Motor invariants in action execution and perception

Auteurs: Francesco Torricelli, Alice Tomassini, Giovanni Pezzulo, Thierry Pozzo, Luciano Fadiga, Alessandro D'Ausilio
Publié dans: Physics of Life Reviews, Volume:44, 2023, Page(s) 13-47, ISSN 1571-0645
Éditeur: Elsevier BV
DOI: 10.1016/j.plrev.2022.11.003

Multi-layer adaptation of group coordination in musical ensembles

Auteurs: Pauline M. Hilt, Leonardo Badino, Alessandro D’Ausilio, Gualtiero Volpe, Serâ Tokay, Luciano Fadiga, Antonio Camurri
Publié dans: Scientific Reports, 9/1, 2019, ISSN 2045-2322
Éditeur: Nature Publishing Group
DOI: 10.1038/s41598-019-42395-4

Motor Recruitment during Action Observation: Effect of Interindividual Differences in Action Strategy

Auteurs: P M Hilt, P Cardellicchio, E Dolfini, T Pozzo, L Fadiga, A D’Ausilio
Publié dans: Cerebral Cortex, 30/7, 2020, Page(s) 3910-3920, ISSN 1047-3211
Éditeur: Oxford University Press
DOI: 10.1093/cercor/bhaa006

Bridging the gap between emotion and joint action.

Auteurs: Marta Bienkiewicz; Andrii P. Smykovskyi; Temitayo A. Olugbade; Stefan Janaqi; Antonio Camurri; Nadia Bianchi-Berthouze; Mårten Björkman; Benoît G. Bardy
Publié dans: ISSN: 1873-7528, 131, December 2021, 2021, Page(s) 806-833, ISSN 0149-7634
Éditeur: Pergamon Press Ltd.
DOI: 10.1016/j.neubiorev.2021.08.014

Decoding the difference between explicit and implicit body expression representation in high level visual, prefrontal and inferior parietal cortex

Auteurs: Giuseppe Marrazzo, Maarten J. Vaessen, Beatrice de Gelder
Publié dans: Neuroimage, 2021, ISSN 1053-8119
Éditeur: Academic Press
DOI: 10.1016/j.neuroimage.2021.118545

Modulation of corticospinal output during goal-directed actions: Evidence for a contingent coding hypothesis.

Auteurs: Marco Soriano; Marco Soriano; Atesh Koul; Atesh Koul; Cristina Becchio; Cristina Becchio; Andrea Cavallo; Andrea Cavallo
Publié dans: Neuropsychologia, 10, 2019, Page(s) 107205, ISSN 0028-3932
Éditeur: Pergamon Press Ltd.
DOI: 10.1016/j.neuropsychologia.2019.107205

Leveraging Activity Recognition to Enable Protective Behavior Detection in Continuous Data

Auteurs: Chongyang Wang, Yuan Gao, Akhil Mathur, Amanda C. De C. Williams, Nicholas D. Lane, and Nadia Bianchi-Berthouze
Publié dans: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 5, 2, 81, 2021, Page(s) 1-27, ISSN 2474-9567
Éditeur: ACM
DOI: 10.1145/3463508

Correlations of random classifiers on large data sets

Auteurs: Vera Kurkova, Marcello Sanguineti
Publié dans: Soft Computing, Volume:25, Month:October, 2021, Page(s) 12641–12648, ISSN 1433-7479
Éditeur: Springer
DOI: 10.1007/s00500-021-05938-4

Tracking the Leader: Gaze Behavior in Group Interactions

Auteurs: Francesca Capozzi, Cigdem Beyan, Antonio Pierro, Atesh Koul, Vittorio Murino, Stefano Livi, Andrew P. Bayliss, Jelena Ristic, Cristina Becchio
Publié dans: iScience, 16, 2019, Page(s) 242-249, ISSN 2589-0042
Éditeur: Cell Press, Elsevier
DOI: 10.1016/j.isci.2019.05.035

Threat Detection in Nearby Space Mobilizes Human Ventral Premotor Cortex, Intraparietal Sulcus, and Amygdala

Auteurs: Aline W. de Borst, Beatrice de Gelder
Publié dans: Brain Sciences, Volume:12, 2022, ISSN 2076-3425
Éditeur: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/brainsci12030391

Toward an Emotional Individual Motor Signature

Auteurs: Lozano-Goupil, J., Bardy, B., & Marin, L.
Publié dans: Frontiers in Psychology, 2021, ISSN 1664-1078
Éditeur: Frontiers Research Foundation
DOI: 10.3389/fpsyg.2021.647704

Frozen in (e) motion: How reactive motor inhibition is influenced by the emotional content of stimuli in healthy and psychiatric populations

Auteurs: Simone Battaglia, Gianluigi Serio, Cristina Scarpazza, Alessandro D'Ausilio, Sara Borgomaneri
Publié dans: Behaviour Research and Therapy, Volume:146, 2021, Page(s) 103963, ISSN 0005-7967
Éditeur: Pergamon Press Ltd.
DOI: 10.1016/j.brat.2021.103963

Motor synergies: Evidence for a novel motor signature in autism spectrum disorder

Auteurs: M. Emanuele, G. Nazzaro, M. Marini, C. Veronesi, S. Boni, G. Polletta, A. D’Ausilio, L. Fadiga
Publié dans: Cognition, Volume:213, 2021, ISSN 0010-0277
Éditeur: Elsevier BV
DOI: 10.1016/j.cognition.2021.104652

Conference proceedings (20)

Graph-based Normalizing Flow for Human Motion Generation and Reconstruction

Auteurs: Wenjie Yin; Hang Yin; Danica Kragic; Mårten Björkman
Publié dans: RO-MAN, 4, 2021
Éditeur: IEEE
DOI: 10.1109/ro-man50785.2021.9515316

EmoPain(at)Home: Dataset and Automatic Assessment within Functional Activity for Chronic Pain Rehabilitation

Auteurs: Temitayo Olugbade, Raffaele Andrea Buono, Amanda C De C Williams, Santiago De Ossorno Garcia, Nicolas Gold, Catherine Holloway, Nadia Bianchi-Berthouze
Publié dans: 10th International Conference on Affective Computing and Intelligent Interaction (ACII), 2022, Page(s) 1-8, ISSN 0000-0000
Éditeur: IEEE Xplore
DOI: 10.1109/acii55700.2022.9953831

Raga Classification From Vocal Performances Using Multimodal Analysis

Auteurs: Martin Clayton; Preeti Rao; Nithya Shikarpur; Sujoy Roychowdhury; Jin Li
Publié dans: Proceedings of the 23rd International Society for Music Information Retrieval Conference, Month:December, 2022, Page(s) 283-290, ISSN 0000-0000
Éditeur: ISMIR
DOI: 10.5281/zenodo.7316650

Functional Musical Sonification for Chronic Pain Support

Auteurs: Neubauer, L; Gold, N; Olugbade, T; Williams, A; Berthouze, N
Publié dans: Proceedings of X Ubiquitous Music, 2021
Éditeur: https://dei.fe.up.pt/ubimus/

Representations of emotion from the face, body and voice in the brain, an fMRI decoding study

Auteurs: M. Vaessen, K. Van der Heijden, R. Watson and B. de Gelder
Publié dans: Organization for Human Brain Mapping (OHBM) annual meeting, 2019
Éditeur: OHBM

Long-term Human Motion Generation and Reconstruction Using Graph-based Normalizing Flow

Auteurs: Wenjie Yin, Hang Yin, Danica Kragic Jensfelt and Mårten Björkman
Publié dans: 3rd Workshop on Long-term Human Motion Prediction, 2021 IEEE International Conference on Robotics and Automation workshops, 2021
Éditeur: IEEE

Towards Chatbot-Supported Self-Reporting for Increased Reliability and Richness of Ground Truth for Automatic Pain Recognition: Reflections on Long-Distance Runners and People with Chronic Pain

Auteurs: Bi T, Buono RA, Olugbade T, Singh A, Holloway C, Costanza E, Williams A, Gold N, Berthouze N
Publié dans: ICMI '21 Companion: Companion Publication of the 2021 International Conference on Multimodal Interaction, ACM, 2021, Page(s) 43–53, ISBN 9781450384711
Éditeur: ACM
DOI: 10.1145/3461615.3485670

The AffectMove 2021 Challenge-Affect Recognition from Naturalistic Movement Data

Auteurs: T. Olugbade and R. Sagoleo and S. Ghisio and N. Gold and A. C de C Williams and B. de Gelder and A. Camurri and G. Volpe and N. Bianchi-Berthouze
Publié dans: 9th International Conference on Affective Computing & Intelligent Interaction (ACII 2021) Workshops and Demos, 2021, 2021
Éditeur: IEEE

Multivariate analysis of affective body perception using postural and kinematic features of movement

Auteurs: M. Poyo Solanas, M. Vaessen, B. de Gelder
Publié dans: Organization for Human Brain Mapping (OHBM) annual meeting 2019, 2019
Éditeur: OHBM

Exploring Multimodal Fusion for Continuous Protective Behavior Detection

Auteurs: Guanting Cen, Chongyang Wang, Temitayo A. Olugbade, Amanda C. de C. Williams, Nadia Bianchi-Berthouze
Publié dans: 2022 10th International Conference on Affective Computing and Intelligent Interaction (ACII), 2022, Page(s) 1-8, ISSN 2156-8111
Éditeur: IEEE Xplore
DOI: 10.1109/acii55700.2022.9953851

Group Behavior Recognition Using Attention- and Graph-Based Neural Networks

Auteurs: Fangkai Yang, Wenjie Yin, Tetsunari Inamura, Mårten Björkman, Christopher Peters
Publié dans: Frontiers in Artificial Intelligence and Applications, Volume 325: ECAI 2020, 2020, Page(s) 1626 - 1633, ISSN 1879-8314
Éditeur: IOS Press

Impact of Trajectory Generation Methods on Viewer Perception of Robot Approaching Group Behaviors

Auteurs: Yang Fangkai, Yin Wenjie, Björkman Mårten, Peters Christopher
Publié dans: 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2020, Page(s) 509-516, ISBN 978-1-7281-6075-7
Éditeur: IEEE
DOI: 10.1109/ro-man47096.2020.9223584

Improving EEG-based Motor Execution Classification for Robot Control

Auteurs: Sumeyra U. Demir Kanik, Wenjie Yin, Arzu Guneysu Ozgur, Ali Ghadirzadeh, Mårten Björkman & Danica Kragic
Publié dans: Social Computing and Social Media: Design, User Experience and Impact, 2022, Page(s) 65–82, ISBN 978-3-031-05061-9
Éditeur: Springer, Cham
DOI: 10.1007/978-3-031-05061-9_5

P(l)aying Attention: Multi-modal, multi-temporal music control

Auteurs: Nicolas Gold, Chongyang Wang, Temitayo Olugbade, Nadia Bianchi-Berthouze, and Amanda C. de C. Williams
Publié dans: Proceedings - International Conference on New Interfaces for Musical Expression, 2020
Éditeur: Proceedings - International Conference on New Interfaces for Musical Expression

Learning Bodily and Temporal Attention in Protective Movement Behavior Detection

Auteurs: Wang, Chongyang; Peng, Min; Olugbade, Temitayo A.; Lane, Nicholas D.; Williams, Amanda C. De C.; Bianchi-Berthouze, Nadia
Publié dans: Proceedings of 2019 8th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW). (pp. pp. 324-330). IEEE: Cambridge, UK. (2019), 2019
Éditeur: IEEE
DOI: 10.1109/aciiw.2019.8925084

Multimodal Data Fusion based on the Global Workspace Theory

Auteurs: Cong Bao, Zafeirios Fountas, Temitayo Olugbade, Nadia Bianchi-Berthouze
Publié dans: International Conference on Multimodal Interaction, 2020
Éditeur: Association for Computing Machinery (ACM)

The Importance of Multiple Temporal Scales in Motion Recognition: when Shallow Model can Support Deep Multi Scale Models

Auteurs: Vincenzo D'Amato, Luca Oneto, Antonio Camurri, Davide Anguita
Publié dans: 2022 International Joint Conference on Neural Networks (IJCNN), 2022, Page(s) 1-10, ISBN 978-1-7281-8671-9
Éditeur: IEEE Xplore
DOI: 10.1109/ijcnn55064.2022.9892372

From Motions to Emotions - Classification of Affect from Dance Movements using Deep Learning

Auteurs: Sukumar Karumuri, Radoslaw Niewiadomski, Gualtiero Volpe, Antonio Camurri
Publié dans: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, 2019, Page(s) 1-6, ISBN 9781450359719
Éditeur: ACM
DOI: 10.1145/3290607.3312910

Recurrent network based automatic detection of chronic pain protective behavior using MoCap and sEMG data

Auteurs: Chongyang Wang, Temitayo A. Olugbade, Akhil Mathur, Amanda C. De C. Williams, Nicholas D. Lane, Nadia Bianchi-Berthouze
Publié dans: Proceedings of the 23rd International Symposium on Wearable Computers - ISWC '19, 2019, Page(s) 225-230, ISBN 9781450368704
Éditeur: ACM Press
DOI: 10.1145/3341163.3347728

A Movement in Multiple Time Neural Network for Automatic Detection of Pain Behaviour

Auteurs: T. Olugbade and N. Gold and A. C. de C. Williams and N. Bianchi-Berthouze
Publié dans: Companion Publication of the 2020 International Conference on Multimodal Interaction, 2020, Page(s) 442-445
Éditeur: ACM
DOI: 10.1145/3395035.3425969

Other (1)

Hindustani raga and singer classification using pose estimation

Auteurs: Clayton, Martin; Li, Jin; Clarke, Alison; Weinzierl, Marion; Leante, Laura; Tarsitani, Simone
Publié dans: Open Science Framework, 2022
Éditeur: Center for Open Science
DOI: 10.17605/osf.io/t5bwa