EnTimeMent - ENtrainment and synchronization at multiple TIME scales in the MENTal foundations of expressive gesture

Projektinformationen

EnTimeMent

ID Finanzhilfevereinbarung: 824160

DOI

10.3030/824160

Projekt abgeschlossen

EK-Unterschriftsdatum 24 Oktober 2018

Startdatum 1 Januar 2019

Enddatum 31 Dezember 2022

Finanziert unter

• EXCELLENT SCIENCE - Future and Emerging Technologies (FET)

Gesamtkosten

€ 4 206 385,86

EU-Beitrag

€ 4 188 885,86

Koordiniert durch

UNIVERSITA DEGLI STUDI DI GENOVA
Italy

CORDIS bietet Links zu öffentlichen Ergebnissen und Veröffentlichungen von HORIZONT-Projekten.

Links zu Ergebnissen und Veröffentlichungen von RP7-Projekten sowie Links zu einigen Typen spezifischer Ergebnisse wie Datensätzen und Software werden dynamisch von OpenAIRE abgerufen.

Leistungen

Documents, reports (29)

Data acquisition analytic tools for complex actions

Data acquisition will consist on motion capture video recordings electroencephalography NIRS Near Infrared Spectroscopy fMRI electromyography and autonomic activity Extraction of behavioral and physiological indexes of action prediction will be basedupon computational pipelines inspired to Becchio et al 2017 and to Granger causality indexes of sensorimotor information exchange see the computational pipeline described in DAusilio et al 2012 Badino et al 2014

Final evaluation report - Phase 2

Summative evaluation will be carried out in the final part of the project and will produce the final evaluation report It may also consist of participation in contests and hackathons where teams are supported by the developed technology

Ethics requirements and procedures

A document containing the procedures adopted in EnTimeMent for ethically responsible research, and for recruiting participants, for informed consent, and for data protection, to be used in the first round of experiments.

Proof-of-Concept Testing and Validation in chronic pain management in everyday life - Phase 1

Summative evaluation of the EnTimeMent proofofconcepts carried out in a series of short lab and in situ studies comprising interviews with and observations of users of thetechnology and an evaluation of the effectiveness and efficiency of the users and their satisfaction while performing the envisaged activities

Updated data management plan

A revised and final version of the plan for making data findable accessible interoperable and reusable

Proof-of-Concept Testing and Validation in healing and everyday life support of disabled - Phase 2

Summative evaluation of the EnTimeMent proofofconcepts carried out in a series of short lab and in situ studies comprising interviews with and observations of users of thetechnology and an evaluation of the effectiveness and efficiency of the users and their satisfaction while performing the envisaged activities

Dissemination & Communication plan

Planning of Dissemination & Communication activities during the first year of the project, as well as execution and reporting of the planned Dissemination and Communication Activities, including presentation of scientific papers in top-level international conferences and journals, public events and workshops including the EU FET Conference.

Final evaluation report - Phase 1

Summative evaluation will be carried out in the final part of the project and will produce the final evaluation report It may also consist of participation in contests and hackathons where teams are supported by the developed technology

Updated ethics requirements and procedures

A revision of D71 taking into account the results of quality control to improve operational ethics procedures to be used in the second round of basic research technological developments experiments and scenarios if necessary

Project management handbook and quality assurance manual

A report summarising the activities carried out in the first reporting period.

Research requirements for laboratory and ecological experimental scenarios - Phase 2

Refinement of research requirements after the first experiments, according to the obtained feedback and results.

Research requirements for laboratory and ecological experimental scenarios - Phase 1

Research requirements for the project, definition of hypotheses for experiments, detailed description of experimental scenarios (technical needs, algorithms required for feature extraction and data analysis), procedures for assessment and evaluation.

Models and algorithms - Phase 1

Elaboration of multitemporal predictive models in the context of dyadic and group interaction

Final ethics requirements and procedures

A revision of D71 and D72 containing the ethics procedures to be used in the final summative evaluation

Predictions of multi-scale, temporally aggregated, social-motor synchronization models - Phase 3

Experiments exploring the multiscale nature of human action

Data acquisition analytic tools for IMS & GMS

Data acquisition will consist on motion capture video recordings electromyographyelectroencephalography NIRS Extraction of behavioral and physiological indexes at multiple time scales revealing a Individual Motor Signature IMS of how we move in synchrony will be based upon the use of Multidimensional scaling Analysis and Similarity Space techniques during solo duo and group sensorimotor exchanges see the computational pipeline described in Slowinski et al 2016 2017 GMS indexGroup Motor Signature will be developed based on multiscale IMS index in order to analyse data collected in WP2 and evaluate movement qualities cascading from milliseconds to minutes

Stakeholders Management and Project Clustering

Creation of a Stakeholders Panel comprising Universities Research and Technological Development Institutes innovative SMEs large Industrial Companies and other Policy Making organizations which will be associated to the project and follow its developments and dissemination activities

Data acquisition analytic tools for individual actions

Data acquisition will consist on motion capture, video recordings, electroencephalography, NIRS (Near Infrared Spectroscopy), fMRI, electromyography and autonomic activity. Extraction of behavioral and physiological indexes of action prediction will be based upon computational pipelines inspired to (Becchio et al., 2017) and to Granger causality indexes of sensorimotor information exchange (see the computational pipeline described in D’Ausilio et al., 2012; Badino et al., 2014).

Data management plan

First draft of the plan for making data findable, accessible, interoperable and reusable.

Proof-of-Concept Testing and Validation in dance, living architectures, sports and entertainment - Phase 2

Summative evaluation of the EnTimeMent proofofconcepts carried out in a series of short lab and in situ studies comprising interviews with and observations of users of thetechnology and an evaluation of the effectiveness and efficiency of the users and their satisfaction while performing the envisaged activities

Predictions of multi-scale, temporally aggregated, social-motor synchronization models - Phase 1

Experiments exploring the multi-scale nature of human action.

Models and algorithms - Phase 2

Elaboration of multitemporal predictive models in the context of dyadic and group interaction

Proof-of-Concept Testing and Validation in dance, living architectures, sports and entertainment - Phase 1

Summative evaluation of the EnTimeMent proofofconcepts carried out in a series of short lab and in situ studies comprising interviews with and observations of users of thetechnology and an evaluation of the effectiveness and efficiency of the users and their satisfaction while performing the envisaged activities

Models and algorithms - Phase 3

Elaboration of multitemporal predictive models in the context of dyadic and group interaction

Proof-of-Concept Testing and Validation in healing and everyday life support of disabled - Phase 1

Summative evaluation of the EnTimeMent proofofconcepts carried out in a series of short lab and in situ studies comprising interviews with and observations of users of thetechnology and an evaluation of the effectiveness and efficiency of the users and their satisfaction while performing the envisaged activities

Data acquisition analytic tools for joint actions

Data acquisition will consist on motion capture video recordings electroencephalography NIRS Near Infrared Spectroscopy fMRI electromyography and autonomic activity Extraction of behavioral and physiological indexes of action prediction will be basedupon computational pipelines inspired to Becchio et al 2017 and to Granger causality indexes of sensorimotor information exchange see the computational pipeline described in DAusilio et al 2012 Badino et al 2014

Report on Dissemination Activities, Conferences and other Events

Reporting of the planned Dissemination and Communication Activities includingpresentation of scientific papers in toplevel international conferences and journals public events and workshops including the EU FET Conference

Predictions of multi-scale, temporally aggregated, social-motor synchronization models - Phase 2

Experiments exploring the multiscale nature of human action

Proof-of-Concept Testing and Validation in chronic pain management in everyday life - Phase 2

Summative evaluation of the EnTimeMent proofofconcepts carried out in a series of short lab and in situ studies comprising interviews with and observations of users of thetechnology and an evaluation of the effectiveness and efficiency of the users and their satisfaction while performing the envisaged activities

Open Research Data Pilot (10)

EnTimeMent platform and software libraries for multi-time analysis, entrainment, and prediction - Phase 3

The platform will integrate the sensor systems adopted in the project including motion capture multichannel video and audio recordings electroencephalography NIRS electromyography and autonomic activity to support the software libraries for analysis and measures of entrainment and prediction at multiple temporal scales

Results on prediction in action execution and observation - Phase 2

Testing whether neurobehavioral MoCap EMG EEG TMS fNIRS and autonomic indexes GSR HRV describing the pragmatic details and emotional valence of the distal action goal are anticipatorily modulated both in action execution and observation

Results on prediction in complex action execution and observation - Phase 1

Exploring the existence of multiple channels of sensorimotor communication acting at different timescales during group synchronization situations Investigating if these timescales allow different behavioural prediction at the individual and group level and which one of them correlates with the autonomic indexes reflecting the affective dimension of group coordination Evaluating whether the IMS Individual Motor Signature Slowinski et al 2016 and GMS Group Motor Signature and their dynamics at multiple timescales express the movement social and affective qualities of the complex action of interest

Results on prediction in dyadic action execution and observation - Phase 2

Extrapolating the kinematics features MoCap EMG autonomic responses GSR HRV and neural antecedents EEGfNIRS used to predict the expressive content of others actions

EnTimeMent platform and software libraries for multi-time analysis, entrainment, and prediction - Phase 1

The platform will integrate the sensor systems adopted in the project (including motion capture, multichannel video and audio recordings, electroencephalography, NIRS, electromyography and autonomic activity) to support the software libraries for analysis and measures of entrainment and prediction at multiple temporal scales.

Results on prediction in dyadic action execution and observation - Phase 1

Extrapolating the kinematics features MoCap EMG autonomic responses GSR HRV and neural antecedents EEGfNIRS used to predict the expressive content of others actions

Results on prediction in action execution and observation - Phase 1

Testing whether neurobehavioral MoCap EMG EEG TMS fNIRS and autonomic indexes GSR HRV describing the pragmatic details and emotional valence of the distal action goal are anticipatorily modulated both in action execution and observation

Annotated open-source dataset

A data collection protocol will be defined to maximize the use of the collected data across WPs where possible The dataset will be annotated as needed to reflect the different temporalscale movements and related physiological and neural signals that needs to be captured and represented Part of the dataset will be opened to the community where ethics allows

Results on prediction in Complex Action execution and observation - Phase 2

Exploring the existence of multiple channels of sensorimotor communication acting at different timescales during group synchronization situations Investigating if these timescales allow different behavioural prediction at the individual and group level and which one of them correlates with the autonomic indexes reflecting the affective dimension of group coordination Evaluating whether the IMS Individual Motor Signature Slowinski et al 2016 and GMS Group Motor Signature and their dynamics at multiple timescales express the movement social and affective qualities of the complex action of interest

EnTimeMent platform and software libraries for multi-time analysis, entrainment, and prediction - Phase 2

The platform will integrate the sensor systems adopted in the project including motion capture multichannel video and audio recordings electroencephalography NIRS electromyography and autonomic activity to support the software libraries for analysis and measures of entrainment and prediction at multiple temporal scales

Other (4)

Hackathons and Users Community Workshops - Phase 3

Qualisys will involve their users community and will include EnTimeMent events as main events in their consolidated Qualisys Users Workshops contributing to the consolidation of a multidisciplinary EnTimeMent users community

Hackathons and Users Community Workshops - Phase 1

Qualisys will involve their users’ community, and will include EnTimeMent events as main events in their consolidated Qualisys Users Workshops, contributing to the consolidation of a multidisciplinary EnTimeMent users’ community.

Hackathons and Users Community Workshops - Phase 4

Qualisys will involve their users’ community, and will include EnTimeMent events as main events in their consolidated Qualisys Users Workshops, contributing to the consolidation of a multidisciplinary EnTimeMent users’ community.

Hackathons and Users Community Workshops - Phase 2

Qualisys will involve their users community and will include EnTimeMent events as main events in their consolidated Qualisys Users Workshops contributing to the consolidation of a multidisciplinary EnTimeMent users community

Demonstrators, pilots, prototypes (3)

Proof-of-Concept Testing and Validation in dance, living architectures, sports and entertainment - Phase 3

Summative evaluation of the EnTimeMent proof-of-concepts, carried out in a series of short lab and in situ studies, comprising interviews with and observations of users of thetechnology, and an evaluation of the effectiveness and efficiency of the users and their satisfaction, while performing the envisaged activities.Final demo proposal.

Proof-of-Concept Testing and Validation in chronic pain management in everyday life - Phase 3

Summative evaluation of the EnTimeMent proof-of-concepts, carried out in a series of short lab and in situ studies, comprising interviews with and observations of users of thetechnology, and an evaluation of the effectiveness and efficiency of the users and their satisfaction, while performing the envisaged activities.Final demo proposal.

Proof-of-Concept Testing and Validation in healing and everyday life support of disabled - Phase 3

Summative evaluation of the EnTimeMent proof-of-concepts, carried out in a series of short lab and in situ studies, comprising interviews with and observations of users of thetechnology, and an evaluation of the effectiveness and efficiency of the users and their satisfaction, while performing the envisaged activities.Final demo proposal.

Websites, patent fillings, videos etc. (1)

Project Website

EnTimeMent Website creation, updating, maintenance and support.

Veröffentlichungen

Peer reviewed articles (55)

First-Person Virtual Embodiment Modulates the Cortical Network that Encodes the Bodily Self and Its Surrounding Space during the Experience of Domestic Violence

Autoren: Aline W. de Borst, Maria V. Sanchez-Vives, Mel Slater, Beatrice de Gelder
Veröffentlicht in: eNeuro, Ausgabe Volume:7, Ausgabe:3, 2020, ISSN 2373-2822
Herausgeber: Society for Neuroscience
DOI: 10.1523/eneuro.0263-19.2019

The role of computational and subjective features in emotional body expressions

Autoren: Marta Poyo Solanas, Maarten J. Vaessen, Beatrice de Gelder
Veröffentlicht in: Scientific Reports, Ausgabe Volume:10, Ausgabe:1, 2020, ISSN 2045-2322
Herausgeber: Nature Publishing Group
DOI: 10.1038/s41598-020-63125-1

Role of sensorimotor areas in early detection of motor errors: an EEG and TMS study

Autoren: Laura Maffongelli, Elisabetta Ferrari, Eleonora Bartoli, Claudio Campus, Etienne Olivier, Luciano Fadiga, Alessandro D’Ausilio
Veröffentlicht in: Behavioural Brain Research, Ausgabe Volume:378, Month:January, 2020, ISSN 0166-4328
Herausgeber: Elsevier BV
DOI: 10.1016/j.bbr.2019.112248

Interpersonal Entrainment in Music Performance: Theory, Method, and Model

Autoren: Martin Clayton, Kelly Jakubowski, Tuomas Eerola, Peter E. Keller, Antonio Camurri, Gualtiero Volpe, Paolo Alborno
Veröffentlicht in: Music Perception, Ausgabe Volume:38, Number:2, 2020, Seite(n) 136-194, ISSN 0730-7829
Herausgeber: University of California at Berkeley
DOI: 10.1525/mp.2020.38.2.136

huSync - A Model and System for the Measure of Synchronization in Small Groups: A Case Study on Musical Joint Action

Autoren: Sanket Rajeev Sabharwal, Manuel Varlet, Matthew Breaden, Gualtiero Volpe, Antonio Camurri, Peter E. Keller
Veröffentlicht in: IEEE Access, Ausgabe Volume:10, 2022, Seite(n) 92357-92372, ISSN 2169-3536
Herausgeber: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2022.3202959

Interacting humans use forces in specific frequencies to exchange information by touch

Autoren: C. Colomer, M. Dhamala, G. Ganesh, J. Lagarde
Veröffentlicht in: Scientific Reports, Ausgabe Volume:12, 2022, Seite(n) 1-12, ISSN 2045-2322
Herausgeber: Nature Publishing Group
DOI: 10.1038/s41598-022-19500-1

Automated Analysis of the Origin of Movement: An Approach Based on Cooperative Games on Graphs

Autoren: Ksenia Kolykhalova, Giorgio Gnecco, Marcello Sanguineti, Gualtiero Volpe, Antonio Camurri
Veröffentlicht in: IEEE Transactions on Human-Machine Systems, Ausgabe Volume:50, Month:December, 2020, Seite(n) 550-560, ISSN 2168-2291
Herausgeber: IEEE Systems, Man, and Cybernetics Society
DOI: 10.1109/thms.2020.3016085

The Role of dorsal premotor cortex in joint action stopping

Autoren: Pasquale Cardellicchio, Elisa Dolfini, Alessandro D'Ausilio
Veröffentlicht in: iScience, Ausgabe Volume:24, 2021, ISSN 2589-0042
Herausgeber: Cell Press
DOI: 10.1016/j.isci.2021.103330

Impact of emotion-laden acoustic stimuli on group synchronisation performance

Autoren: Marta M. N. Bieńkiewicz, Stefan Janaqi, Pierre Jean, Benoît G. Bardy
Veröffentlicht in: Scientific Reports, Ausgabe Volume: 13, 2023, ISSN 2045-2322
Herausgeber: Nature Publishing Group
DOI: 10.1038/s41598-023-34406-2

Human Movement Datasets: An Interdisciplinary Scoping Review

Autoren: Temitayo Olugbade, Marta Bieńkiewicz, Giulia Barbareschi, Vincenzo D’amato, Luca Oneto, Antonio Camurri, Catherine Holloway, Mårten Björkman, Peter Keller, Martin Clayton, Amanda C De C Williams, Nicolas Gold, Cristina Becchio, Benoît Bardy, Nadia Bianchi-Berthouze
Veröffentlicht in: Association for Computing Machinery, ACM Comput. Surv., Ausgabe Volume:55, 2022, ISSN 0360-0300
Herausgeber: Association for Computing Machinary, Inc.
DOI: 10.1145/3534970

Positive emotions foster spontaneous synchronisation in a group movement improvisation task

Autoren: Andrii Smykovskyi, Andrii Smykovskyi, Simon Pla, Stefan Janaqi, Benoit G. Bardy
Veröffentlicht in: Frontiers in Human Neuroscience, Ausgabe Volume:16, 2022, Seite(n) 944241, ISSN 0000-0000
Herausgeber: Frontiers
DOI: 10.3389/fnhum.2022.944241

Mechanisms of Hebbian-like plasticity in the ventral premotor--primary motor network

Autoren: Andrea Casarotto, Elisa Dolfini, Pasquale Cardellicchio, Luciano Fadiga, Alessandro D'Ausilio, Giacomo Koch
Veröffentlicht in: The Journal of Physiology, Ausgabe Volume:601, Number:1, 2023, Seite(n) 211-226, ISSN 1469-7793
Herausgeber: Wiley Online Library
DOI: 10.1113/jp283560

Decoding of emotion expression in the face, body and voice reveals sensory modality specific representations

Autoren: Maarten J. Vaessen; Van der Heijden K; de Gelder B; de Gelder B
Veröffentlicht in: bioRxiv, Ausgabe 24, 2019, ISSN 0000-0000
Herausgeber: Cold Spring Harbor Laboratory
DOI: 10.1101/869578

Interpersonal synchronization of movement intermittency

Autoren: A. Tomassini, J. Laroche, M. Emanuele, G. Nazzaro, N. Petrone, L. Fadiga, A. D'Ausilio
Veröffentlicht in: iScience, Ausgabe Volume:25, 2022, Seite(n) 104096, ISSN 2589-0042
Herausgeber: ScienceDirect - Elsevier
DOI: 10.1016/j.isci.2022.104096

Modeling Frequency Reduction in Human Groups Performing a Joint Oscillatory Tasc

Autoren: Calabrese, C., Bardy, B. G., de Lellis, P., & di Bernardo, M.
Veröffentlicht in: Frontiers in Psychology, 2022, ISSN 1664-1078
Herausgeber: Frontiers Research Foundation
DOI: 10.3389/fpsyg.2021.753758

Chronic Pain Protective Behavior Detection with Deep Learning

Autoren: Chongyang Wang, Temitayo A. Olugbade, Akhil Mathur, Amanda C. DE C. Williams, Nicholas D. Lane, Nadia Bianchi-Berthouze
Veröffentlicht in: ACM Transactions on Computing for Healthcare, Ausgabe Volume:2, Number:3, Article:23, 2021, Seite(n) 1-24, ISSN 2691-1957
Herausgeber: ACM
DOI: 10.1145/3449068

Decoding social decisions from movement kinematics

Autoren: Giacomo Turri, Andrea Cavallo, Luca Romeo, Massimiliano Pontil, Alan Sanfey, Stefano Panzeri, Cristina Becchio
Veröffentlicht in: iScience, Ausgabe Volume:25, Number:12, 2022, Seite(n) 105550, ISSN 2589-0042
Herausgeber: ScienceDirect, Elsevier
DOI: 10.1016/j.isci.2022.105550

Anticipatory postural adjustments during joint action coordination

Autoren: A. A. Nogueira-Campos, P. M. Hilt, L. Fadiga, C. Veronesi, A. D’Ausilio, T. Pozzo
Veröffentlicht in: Scientific Reports, Ausgabe 9/1, 2019, ISSN 2045-2322
Herausgeber: Nature Publishing Group
DOI: 10.1038/s41598-019-48758-1

Motor cortical inhibition during concurrent action execution and action observation

Autoren: Pasquale Cardellicchio, Elisa Dolfini, Pauline M. Hilt, Luciano Fadiga, Alessandro D’Ausilio
Veröffentlicht in: NeuroImage, Ausgabe Volume:208, 2020, ISSN 1053-8119
Herausgeber: Academic Press
DOI: 10.1016/j.neuroimage.2019.116445

Interpersonal sensorimotor communication shapes intrapersonal coordination in a musical ensemble

Autoren: J. Laroche, A. Tomassini, G. Volpe, A. Camurri, L. Fadiga, A. D'Ausilio
Veröffentlicht in: Frontiers in Human Neuroscience, Ausgabe Volume: 16, 2022, ISSN 1662-5161
Herausgeber: Frontiers Research Foundation
DOI: 10.3389/fnhum.2022.899676

Visual detection is locked to the internal dynamics of cortico-motor control

Autoren: Alice Tomassini; Eric Maris; Pauline M. Hilt; Luciano Fadiga; Luciano Fadiga; Alessandro D'Ausilio; Alessandro D'Ausilio
Veröffentlicht in: PLoS Biology, Ausgabe Volume:18, Month:October, 2020, ISSN 0000-0000
Herausgeber: PLoS Biology
DOI: 10.1371/journal.pbio.3000898

Computation-Based Feature Representation of Body Expressions in the Human Brain

Autoren: Marta Poyo Solanas, Maarten Vaessen, Beatrice de Gelder
Veröffentlicht in: Cerebral Cortex, 2020, ISSN 1047-3211
Herausgeber: Oxford University Press
DOI: 10.1093/cercor/bhaa196

Spontaneous emergence of leadership patterns drives synchronization in complex human networks

Autoren: Calabrese, C., Lombardi, M., Bollt, E., De Lellis, P., Bardy, B. G., & di Bernardo, M.
Veröffentlicht in: Scientific Reports, 2021, ISSN 2045-2322
Herausgeber: Nature Publishing Group
DOI: 10.1038/s41598-021-97656-y

Parallel fast and slow motor inhibition processes regulate Joint Action coordination

Autoren: Pasquale Cardellicchio, Elisa Dolfini, Luciano Fadiga, Alessandro D'Ausilio
Veröffentlicht in: Cortex, Ausgabe Volume:133, 2020, Seite(n) 346-357, ISSN 0010-9452
Herausgeber: Masson Publishing
DOI: 10.1016/j.cortex.2020.09.029

The classical mean negative asynchrony in sensorimotor synchronization is not universal in humans. A cross-cultural study.

Autoren: Julien Lagarde
Veröffentlicht in: PsyArXiv, Ausgabe Month:July, 2021, ISSN 0000-0000
Herausgeber: Center for Open Science
DOI: 10.31234/osf.io/rf7ku

Intersecting kinematic encoding and readout of intention in autism

Autoren: Noemi Montobbio, Andrea Cavallo , Dalila Albergo, Caterina Ansuini, Francesca Battaglia, Jessica Podda, Lino Nobili, Stefano Panzeri, Cristina Becchio
Veröffentlicht in: Proceedings of the National Academy of Sciences, 2022, Seite(n) e2114648119, ISSN 1091-6490
Herausgeber: United States National Academy of Sciences
DOI: 10.1073/pnas.2114648119

Understanding joint action: Current theoretical and empirical approaches

Autoren: Robrecht P.R.D.van der Wel, Cristina Becchio, Arianna Curioni, ThomasWolf
Veröffentlicht in: Acta Psychologica, 2021, Seite(n) 103285, ISSN 0001-6918
Herausgeber: Elsevier BV
DOI: 10.1016/j.actpsy.2021.103285

Why do we move to the beat? A multi-scale approach, from physical principles to brain dynamics

Autoren: Loïc Damm, Déborah Varoqui, Valérie Cochen De Cock, Simone Dalla Bella, Benoît Bardy,
Veröffentlicht in: Neuroscience & Biobehavioral Reviews, Ausgabe Volume: 112, 2020, Seite(n) Pages 553-584, ISSN 0149-7634
Herausgeber: Pergamon Press Ltd.
DOI: 10.1016/j.neubiorev.2019.12.024

Decoding identity from motion: how motor similarities colour our perception of self and others

Autoren: Alexandre Coste, Benoît G. Bardy, Stefan Janaqi, Piotr Słowiński, Krasimira Tsaneva-Atanasova, Juliette Lozano Goupil, Ludovic Marin
Veröffentlicht in: Psychological Research, 2020, ISSN 0340-0727
Herausgeber: Springer Verlag
DOI: 10.1007/s00426-020-01290-8

Modeling Multiple Temporal Scales of Full-body Movements for Emotion Classification

Autoren: Cigdem Beyan; Sukumar Karumuri; Gualtiero Volpe; Antonio Camurri; Radoslaw Niewiadomski
Veröffentlicht in: IEEE Transactions on Affective Computing, Ausgabe 4, 2021, ISSN 1949-3045
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.1109/taffc.2021.3095425

Beta rebound as an index temporal integration of somatosensory and motor signals

Autoren: Pasquale Cardellicchio, Pauline M. Hilt, Elisa Dolfini, Luciano Fadiga, Alessandro D’Ausilio
Veröffentlicht in: Frontiers in Systems Neuroscience, Ausgabe Volume:14, Number:63, 2020, ISSN 0000-0000
Herausgeber: Frontiers Media
DOI: 10.3389/fnsys.2020.00063

Understanding Violin Players Skills Level based on Motion Capture: a Data Driven Perspective

Autoren: Vincenzo D'Amato, Erica Volta, Luca Oneto, Gualtiero Volpe, Antonio Camurri, Davide Anguita
Veröffentlicht in: Cognitive Computation, 2020, ISSN 1866-9964
Herausgeber: Springer

The role of respiration audio in multimodal analysis of movement qualities

Autoren: Vincenzo Lussu, Radoslaw Niewiadomski, Gualtiero Volpe, Antonio Camurri
Veröffentlicht in: Journal on Multimodal User Interfaces, Ausgabe 14/1, 2020, Seite(n) 1-15, ISSN 1783-7677
Herausgeber: Springer Verlag
DOI: 10.1007/s12193-019-00302-1

Moving in unison after perceptual interruption

Autoren: Bardy, B.G., Calabrese, C., De Lellis, P. et al.
Veröffentlicht in: Scientific Reports, 2020, ISSN 2045-2322
Herausgeber: Nature Publishing Group
DOI: 10.1038/s41598-020-74914-z

Subjective understanding of actions and emotions involves the interplay of the semantic and action observation networks in the brain

Autoren: Minye Zhan, Rainer Goebel, Beatrice de Gelder
Veröffentlicht in: bioRxiv, 2021, ISSN 0000-0000
Herausgeber: Cold Spring Harbor Laboratory
DOI: 10.1101/2021.04.15.439961

A computational neuroethology perspective on body and expression perception

Autoren: Beatrice de Gelder, Marta Poyo Solanas
Veröffentlicht in: Trends in Cognitive Sciences, Ausgabe Volume:25, Number:9, 2021, Seite(n) 744-756, ISSN 1364-6613
Herausgeber: Elsevier BV
DOI: 10.1016/j.tics.2021.05.010

Towards an Embodied Signature of Improvisation Skills

Autoren: Alexandre Coste, Benoît G. Bardy, Ludovic Marin
Veröffentlicht in: Frontiers in Psychology, Ausgabe 10, 2019, ISSN 1664-1078
Herausgeber: Frontiers Research Foundation
DOI: 10.3389/fpsyg.2019.02441

Accuracy and Intrusiveness in Data-Driven Violin Players Skill Levels Prediction: MOCAP Against MYO Against KINECT

Autoren: Vincenzo D’Amato, Erica Volta, Luca Oneto, Gualtiero Volpe, Antonio Camurri, Davide Anguita
Veröffentlicht in: Proceedings of the 16th International Work-Conference on Artificial Neural Networks - IWANN 2021, Ausgabe Volume:12862, 2021, Seite(n) 367-379, ISSN 0000-0000
Herausgeber: Springer Nature
DOI: 10.1007/978-3-030-85099-9_30

Motor overload: GABAergic index of parallel buffer costs

Autoren: Pasquale Cardellicchio, Giacomo Koch, Luciano Fadiga, Alessandro D'Ausilio
Veröffentlicht in: Brain Stimulation, Ausgabe Volume:14, Month:August, 2021, Seite(n) 1106-1108, ISSN 1935-861X
Herausgeber: Elsevier BV
DOI: 10.1016/j.brs.2021.07.061

Author Correction: Multi-layer adaptation of group coordination in musical ensembles

Autoren: Pauline M. Hilt, Leonardo Badino, Alessandro D’Ausilio, Gualtiero Volpe, Serâ Tokay, Luciano Fadiga, Antonio Camurri
Veröffentlicht in: Scientific Reports, Ausgabe 10/1, 2020, ISSN 2045-2322
Herausgeber: Nature Publishing Group
DOI: 10.1038/s41598-019-55965-3

Motor invariants in action execution and perception

Autoren: Francesco Torricelli, Alice Tomassini, Giovanni Pezzulo, Thierry Pozzo, Luciano Fadiga, Alessandro D'Ausilio
Veröffentlicht in: Physics of Life Reviews, Ausgabe Volume:44, 2023, Seite(n) 13-47, ISSN 1571-0645
Herausgeber: Elsevier BV
DOI: 10.1016/j.plrev.2022.11.003

Multi-layer adaptation of group coordination in musical ensembles

Autoren: Pauline M. Hilt, Leonardo Badino, Alessandro D’Ausilio, Gualtiero Volpe, Serâ Tokay, Luciano Fadiga, Antonio Camurri
Veröffentlicht in: Scientific Reports, Ausgabe 9/1, 2019, ISSN 2045-2322
Herausgeber: Nature Publishing Group
DOI: 10.1038/s41598-019-42395-4

Motor Recruitment during Action Observation: Effect of Interindividual Differences in Action Strategy

Autoren: P M Hilt, P Cardellicchio, E Dolfini, T Pozzo, L Fadiga, A D’Ausilio
Veröffentlicht in: Cerebral Cortex, Ausgabe 30/7, 2020, Seite(n) 3910-3920, ISSN 1047-3211
Herausgeber: Oxford University Press
DOI: 10.1093/cercor/bhaa006

Bridging the gap between emotion and joint action.

Autoren: Marta Bienkiewicz; Andrii P. Smykovskyi; Temitayo A. Olugbade; Stefan Janaqi; Antonio Camurri; Nadia Bianchi-Berthouze; Mårten Björkman; Benoît G. Bardy
Veröffentlicht in: ISSN: 1873-7528, Ausgabe 131, December 2021, 2021, Seite(n) 806-833, ISSN 0149-7634
Herausgeber: Pergamon Press Ltd.
DOI: 10.1016/j.neubiorev.2021.08.014

Some properties of transportation network cooperative games

Autoren: Giorgio Gnecco, Yuval Hadas, Marcello Sanguineti
Veröffentlicht in: Networks, Ausgabe Volume:74, Ausgabe_2, Month:September, 2019, Seite(n) 161-173, ISSN 0028-3045
Herausgeber: John Wiley & Sons Inc.
DOI: 10.1002/net.21887

Decoding the difference between explicit and implicit body expression representation in high level visual, prefrontal and inferior parietal cortex

Autoren: Giuseppe Marrazzo, Maarten J. Vaessen, Beatrice de Gelder
Veröffentlicht in: Neuroimage, 2021, ISSN 1053-8119
Herausgeber: Academic Press
DOI: 10.1016/j.neuroimage.2021.118545

Modulation of corticospinal output during goal-directed actions: Evidence for a contingent coding hypothesis.

Autoren: Marco Soriano; Marco Soriano; Atesh Koul; Atesh Koul; Cristina Becchio; Cristina Becchio; Andrea Cavallo; Andrea Cavallo
Veröffentlicht in: Neuropsychologia, Ausgabe 10, 2019, Seite(n) 107205, ISSN 0028-3932
Herausgeber: Pergamon Press Ltd.
DOI: 10.1016/j.neuropsychologia.2019.107205

Leveraging Activity Recognition to Enable Protective Behavior Detection in Continuous Data

Autoren: Chongyang Wang, Yuan Gao, Akhil Mathur, Amanda C. De C. Williams, Nicholas D. Lane, and Nadia Bianchi-Berthouze
Veröffentlicht in: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Ausgabe 5, 2, 81, 2021, Seite(n) 1-27, ISSN 2474-9567
Herausgeber: ACM
DOI: 10.1145/3463508

Correlations of random classifiers on large data sets

Autoren: Vera Kurkova, Marcello Sanguineti
Veröffentlicht in: Soft Computing, Ausgabe Volume:25, Month:October, 2021, Seite(n) 12641–12648, ISSN 1433-7479
Herausgeber: Springer
DOI: 10.1007/s00500-021-05938-4

Tracking the Leader: Gaze Behavior in Group Interactions

Autoren: Francesca Capozzi, Cigdem Beyan, Antonio Pierro, Atesh Koul, Vittorio Murino, Stefano Livi, Andrew P. Bayliss, Jelena Ristic, Cristina Becchio
Veröffentlicht in: iScience, Ausgabe 16, 2019, Seite(n) 242-249, ISSN 2589-0042
Herausgeber: Cell Press, Elsevier
DOI: 10.1016/j.isci.2019.05.035

Threat Detection in Nearby Space Mobilizes Human Ventral Premotor Cortex, Intraparietal Sulcus, and Amygdala

Autoren: Aline W. de Borst, Beatrice de Gelder
Veröffentlicht in: Brain Sciences, Ausgabe Volume:12, 2022, ISSN 2076-3425
Herausgeber: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/brainsci12030391

Toward an Emotional Individual Motor Signature

Autoren: Lozano-Goupil, J., Bardy, B., & Marin, L.
Veröffentlicht in: Frontiers in Psychology, 2021, ISSN 1664-1078
Herausgeber: Frontiers Research Foundation
DOI: 10.3389/fpsyg.2021.647704

Frozen in (e) motion: How reactive motor inhibition is influenced by the emotional content of stimuli in healthy and psychiatric populations

Autoren: Simone Battaglia, Gianluigi Serio, Cristina Scarpazza, Alessandro D'Ausilio, Sara Borgomaneri
Veröffentlicht in: Behaviour Research and Therapy, Ausgabe Volume:146, 2021, Seite(n) 103963, ISSN 0005-7967
Herausgeber: Pergamon Press Ltd.
DOI: 10.1016/j.brat.2021.103963

Motor synergies: Evidence for a novel motor signature in autism spectrum disorder

Autoren: M. Emanuele, G. Nazzaro, M. Marini, C. Veronesi, S. Boni, G. Polletta, A. D’Ausilio, L. Fadiga
Veröffentlicht in: Cognition, Ausgabe Volume:213, 2021, ISSN 0010-0277
Herausgeber: Elsevier BV
DOI: 10.1016/j.cognition.2021.104652

Neurons of rat motor cortex become active during both grasping execution and grasping observation

Autoren: Riccardo Viaro, Emma Maggiolini, Emanuele Farina, Rosario Canto, Atsushi Iriki, Alessandro D’Ausilio, Luciano Fadiga
Veröffentlicht in: Current Biology, Ausgabe Volume:31, 2021, Seite(n) 4405-4412.e4, ISSN 0960-9822
Herausgeber: Cell Press
DOI: 10.1016/j.cub.2021.07.054

Conference proceedings (19)

Graph-based Normalizing Flow for Human Motion Generation and Reconstruction

Autoren: Wenjie Yin; Hang Yin; Danica Kragic; Mårten Björkman
Veröffentlicht in: RO-MAN, Ausgabe 4, 2021
Herausgeber: IEEE
DOI: 10.1109/ro-man50785.2021.9515316

EmoPain(at)Home: Dataset and Automatic Assessment within Functional Activity for Chronic Pain Rehabilitation

Autoren: Temitayo Olugbade, Raffaele Andrea Buono, Amanda C De C Williams, Santiago De Ossorno Garcia, Nicolas Gold, Catherine Holloway, Nadia Bianchi-Berthouze
Veröffentlicht in: 10th International Conference on Affective Computing and Intelligent Interaction (ACII), 2022, Seite(n) 1-8, ISSN 0000-0000
Herausgeber: IEEE Xplore
DOI: 10.1109/acii55700.2022.9953831

Hindustani raga and singer classification using pose estimation

Autoren: Clayton, Martin; Li, Jin; Clarke, Alison; Weinzierl, Marion; Leante, Laura; Tarsitani, Simone
Veröffentlicht in: Open Science Framework, 2022
Herausgeber: Center for Open Science
DOI: 10.17605/osf.io/t5bwa

Raga Classification From Vocal Performances Using Multimodal Analysis

Autoren: Martin Clayton; Preeti Rao; Nithya Shikarpur; Sujoy Roychowdhury; Jin Li
Veröffentlicht in: Proceedings of the 23rd International Society for Music Information Retrieval Conference, Ausgabe Month:December, 2022, Seite(n) 283-290, ISSN 0000-0000
Herausgeber: ISMIR
DOI: 10.5281/zenodo.7316650

Functional Musical Sonification for Chronic Pain Support

Autoren: Neubauer, L; Gold, N; Olugbade, T; Williams, A; Berthouze, N
Veröffentlicht in: Proceedings of X Ubiquitous Music, 2021
Herausgeber: https://dei.fe.up.pt/ubimus/

Towards Chatbot-Supported Self-Reporting for Increased Reliability and Richness of Ground Truth for Automatic Pain Recognition: Reflections on Long-Distance Runners and People with Chronic Pain

Autoren: Bi T, Buono RA, Olugbade T, Singh A, Holloway C, Costanza E, Williams A, Gold N, Berthouze N
Veröffentlicht in: ICMI '21 Companion: Companion Publication of the 2021 International Conference on Multimodal Interaction, Ausgabe ACM, 2021, Seite(n) 43–53, ISBN 9781450384711
Herausgeber: ACM
DOI: 10.1145/3461615.3485670

The AffectMove 2021 Challenge-Affect Recognition from Naturalistic Movement Data

Autoren: T. Olugbade and R. Sagoleo and S. Ghisio and N. Gold and A. C de C Williams and B. de Gelder and A. Camurri and G. Volpe and N. Bianchi-Berthouze
Veröffentlicht in: 9th International Conference on Affective Computing & Intelligent Interaction (ACII 2021) Workshops and Demos, 2021, 2021
Herausgeber: IEEE

Exploring Multimodal Fusion for Continuous Protective Behavior Detection

Autoren: Guanting Cen, Chongyang Wang, Temitayo A. Olugbade, Amanda C. de C. Williams, Nadia Bianchi-Berthouze
Veröffentlicht in: 2022 10th International Conference on Affective Computing and Intelligent Interaction (ACII), 2022, Seite(n) 1-8, ISSN 2156-8111
Herausgeber: IEEE Xplore
DOI: 10.1109/acii55700.2022.9953851

Group Behavior Recognition Using Attention- and Graph-Based Neural Networks

Autoren: Fangkai Yang, Wenjie Yin, Tetsunari Inamura, Mårten Björkman, Christopher Peters
Veröffentlicht in: Frontiers in Artificial Intelligence and Applications, Ausgabe Volume 325: ECAI 2020, 2020, Seite(n) 1626 - 1633, ISSN 1879-8314
Herausgeber: IOS Press

Impact of Trajectory Generation Methods on Viewer Perception of Robot Approaching Group Behaviors

Autoren: Yang Fangkai, Yin Wenjie, Björkman Mårten, Peters Christopher
Veröffentlicht in: 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 2020, Seite(n) 509-516, ISBN 978-1-7281-6075-7
Herausgeber: IEEE
DOI: 10.1109/ro-man47096.2020.9223584

Improving EEG-based Motor Execution Classification for Robot Control

Autoren: Sumeyra U. Demir Kanik, Wenjie Yin, Arzu Guneysu Ozgur, Ali Ghadirzadeh, Mårten Björkman & Danica Kragic
Veröffentlicht in: Social Computing and Social Media: Design, User Experience and Impact, 2022, Seite(n) 65–82, ISBN 978-3-031-05061-9
Herausgeber: Springer, Cham
DOI: 10.1007/978-3-031-05061-9_5

P(l)aying Attention: Multi-modal, multi-temporal music control

Autoren: Nicolas Gold, Chongyang Wang, Temitayo Olugbade, Nadia Bianchi-Berthouze, and Amanda C. de C. Williams
Veröffentlicht in: Proceedings - International Conference on New Interfaces for Musical Expression, 2020
Herausgeber: Proceedings - International Conference on New Interfaces for Musical Expression

Learning Bodily and Temporal Attention in Protective Movement Behavior Detection

Autoren: Wang, Chongyang; Peng, Min; Olugbade, Temitayo A.; Lane, Nicholas D.; Williams, Amanda C. De C.; Bianchi-Berthouze, Nadia
Veröffentlicht in: Proceedings of 2019 8th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW). (pp. pp. 324-330). IEEE: Cambridge, UK. (2019), 2019
Herausgeber: IEEE
DOI: 10.1109/aciiw.2019.8925084

Multimodal Data Fusion based on the Global Workspace Theory

Autoren: Cong Bao, Zafeirios Fountas, Temitayo Olugbade, Nadia Bianchi-Berthouze
Veröffentlicht in: International Conference on Multimodal Interaction, 2020
Herausgeber: Association for Computing Machinery (ACM)

The Importance of Multiple Temporal Scales in Motion Recognition: when Shallow Model can Support Deep Multi Scale Models

Autoren: Vincenzo D'Amato, Luca Oneto, Antonio Camurri, Davide Anguita
Veröffentlicht in: 2022 International Joint Conference on Neural Networks (IJCNN), 2022, Seite(n) 1-10, ISBN 978-1-7281-8671-9
Herausgeber: IEEE Xplore
DOI: 10.1109/ijcnn55064.2022.9892372

From Motions to Emotions - Classification of Affect from Dance Movements using Deep Learning

Autoren: Sukumar Karumuri, Radoslaw Niewiadomski, Gualtiero Volpe, Antonio Camurri
Veröffentlicht in: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, 2019, Seite(n) 1-6, ISBN 9781450359719
Herausgeber: ACM
DOI: 10.1145/3290607.3312910

Recurrent network based automatic detection of chronic pain protective behavior using MoCap and sEMG data

Autoren: Chongyang Wang, Temitayo A. Olugbade, Akhil Mathur, Amanda C. De C. Williams, Nicholas D. Lane, Nadia Bianchi-Berthouze
Veröffentlicht in: Proceedings of the 23rd International Symposium on Wearable Computers - ISWC '19, 2019, Seite(n) 225-230, ISBN 9781450368704
Herausgeber: ACM Press
DOI: 10.1145/3341163.3347728

The Importance of Multiple Temporal Scales in Motion Recognition: from Shallow to Deep Multi Scale Models

Autoren: Vincenzo D'Amato, Luca Oneto, Antonio Camurri, Davide Anguita, Zinat Zarandi, Luciano Fadiga, Alessandro D'Ausilio, Thierry Pozzo
Veröffentlicht in: 2022 International Joint Conference on Neural Networks (IJCNN), 2022, Seite(n) 1-9, ISSN 2161-4407
Herausgeber: IEEE Xplore
DOI: 10.1109/ijcnn55064.2022.9892519

A Movement in Multiple Time Neural Network for Automatic Detection of Pain Behaviour

Autoren: T. Olugbade and N. Gold and A. C. de C. Williams and N. Bianchi-Berthouze
Veröffentlicht in: Companion Publication of the 2020 International Conference on Multimodal Interaction, 2020, Seite(n) 442-445
Herausgeber: ACM
DOI: 10.1145/3395035.3425969