Skip to main content

EnTimeMent - ENtrainment and synchronization at multiple TIME scales in the MENTal foundations of expressive gesture

Periodic Reporting for period 1 - EnTimeMent (EnTimeMent - ENtrainment and synchronization at multiple TIME scales in the MENTal foundations of expressive gesture)

Reporting period: 2019-01-01 to 2020-06-30

In 1973, the Swedish psychologist Gunnar Johansson and his colleagues showed that the human visual system can perceive the movement of a human body from a limited number of moving points. This landmark study grounded the scientific basis of current motion capture technologies. However, the state of the art of motion capture technology only considers low-level temporal and spatial information, limited to computation of kinematic measures whose time-frame is usually too short for an effective perception and prediction of complex phenomena. While a lot of effort is being spent improving such technologies in the direction of more accurate and more portable systems (e.g. wearable and wireless), such developments are incremental with respect to a conceptual and technological paradigm that remains unchanged. The Future and Emerging Technologies (FET PROACTIVE) project EnTimeMent proposes a radical change of paradigm and technology in human movement analysis. Under this new perspective, the time-frame for analysis is grounded on novel neuroscientific, biomechanical, psychological, and computational evidence, inspired by the arts, and dynamically adapted to the human time governing the phenomena under investigation, the multiple temporal scales concurrently interacting in the brain.

EnTimeMent includes measurable scientific, technological, and community-building objectives.
Scientific objectives include (i) the definition and empirical validation of neuro-cognitive models of the multiple and mutually interactive time scales that contribute to human perception of gesture qualities and action prediction, (ii) the development of computational models grounded on such neuro-cognitive models, (iii) the investigation of music and dance performers movements synchronised at different temporal scales, and a broader set of controlled as well as ecological experiments.
Technological objectives consist of the development of computational methods and software modules integrated in the project platform, to support experiments and proof-of-concepts in three different real-world scenarios focusing on healing and support of everyday life in disabled persons, sensory-motor entrainment and commitment in sport, dance and music.
Community-building objectives include the building of a novel scientific interdisciplinary community leading the transformation of the current generation of motion capture systems into a novel generation of time-aware motion perception and prediction technologies.
A number of joint scientific experiments were started by scientific partners; some are concluded and results are available in the project web portal and some of them are already published in scientific journals and conference proceedings (see https://entimement.dibris.unige.it/documents). Scientific results include the development of computational models and software modules based on machine learning, on graph and game theory, on synchronization theories, and on theories on individual motor signature.
Technological results consist in the consolidation of the project platform, including novel Qualisys software on motion capture, integrated with other sensing technologies, and used in scientific experiments and public events and in videos.
Details on dissemination activities are available at https://entimement.dibris.unige.it/events and https://entimement.dibris.unige.it/press.
EnTimeMent presented its activities and objectives to invited stakeholders from industry and institutions at several public events, including the following:
- the First EnTimeMent Workshop, part of the H2020 FET Future Tech Week (September 2019);
- the EU STARTS Event at Festival della Scienza, Genoa (October 2019)
- the Qualisys Users Workshop (November 2019)

The dissemination activities of EnTimeMent include a video submission to FETFX 2020, a number of interviews and media (e.g. https://ec.europa.eu/digital-single-market/en/news/improving-human-movement-analysis-interview-antonio-camurri).
Furthermore, EnTimeMent organizes the ICMI 2020 Intl Workshop on Multi-Scale Movement Technologies (October 2020), and participates to
several other dissemination initiatives, including the artistic projects on Living Architectures by the artist Philip Beesley (UW).
"EnTimeMent includes measurable scientific, technological, and community-building objectives.
Scientific objectives include (i) the definition and empirical validation of neuro-cognitive models of the multiple and mutually interactive time scales that contribute to human perception of gesture qualities and action prediction, (ii) the development of computational models grounded on such neuro-cognitive models, (iii) the investigation of music and dance performers movements synchronised at different temporal scales, and a broader set of controlled as well as ecological experiments.
Technological objectives consist of the development of computational methods and software modules integrated in the project platform, to support experiments and proof-of-concepts in three different real-world scenarios focusing on healing and support of everyday life in disabled persons, sensory-motor entrainment and commitment in sport, dance and music. Community-building objectives include the building of a novel scientific interdisciplinary community leading the transformation of the current generation of motion capture systems into a novel generation of time-aware motion perception and prediction technologies.
The EnTimeMent project will move away from traditional motion capture technology, emphasizing movement analysis, that will not only record movements, but also compute on-the-fly their origins and their emotional and social qualities; This will allow novel scientific approaches for individualized predictions, from the identification of relations between time-scales, prediction of longer time-scales from shorter ones, with impact on individualisation of learning and the design of learning accelerators for healthy and patients. EnTimeMent will also shape new research directions addressing multiple temporal scales, capturing ""individual motor signature"" and ""group motor signature"", from biology to social interaction, from support to everyday life of disabled, to therapy and rehabilitation, to dance and music, and in general impact in the Creative and Cultural Sector."