Embodied Social Experiences in Hybrid Shared Spaces

Información del proyecto

SHARESPACE

Identificador del acuerdo de subvención: 101092889

DOI

10.3030/101092889

Fecha de la firma de la CE 14 Noviembre 2022

Fecha de inicio 1 Enero 2023

Fecha de finalización 31 Diciembre 2025

Financiado con arreglo a

• Digital, Industry and Space

Coste total

€ 5 947 573,50

Aportación de la UE

€ 5 947 573,50

Coordinado por

DEUTSCHES FORSCHUNGSZENTRUM FUR KUNSTLICHE INTELLIGENZ GMBH
Germany

CORDIS proporciona enlaces a los documentos públicos y las publicaciones de los proyectos de los programas marco HORIZONTE.

Los enlaces a los documentos y las publicaciones de los proyectos del Séptimo Programa Marco, así como los enlaces a algunos tipos de resultados específicos, como conjuntos de datos y «software», se obtienen dinámicamente de OpenAIRE .

Resultado final

Demonstrators, pilots, prototypes (10)

Implemented integrated SHARESPACE prototypes v1

The deliverable consists of the first integrated prototype demonstration of SHS-system which will be used in the trial.

Avatar adaptation v1

The deliverable consists of the first implementation demonstrating the capability of the avatar to adapt to the local context, meaning avatar-to-environment interactions and social engagement with multiple humans/avatars.

Accurate Hand Kinematics Predictions from ego-vision v1

The deliverable presents the first implementation of hand tracking and reconstruction from an ego-perspective.

XR communication platform design and validation v1

The deliverable presents the XR-communication platform which will be used for the trials.

Self-calibrating ego-centric visual-intertial bofy tracking v1

The deliverable presents succinctly the first implementation of the self-calibration capability of the visual-inertial ego-centric body sensor network.

Multi-sensors and Multifocal XR display v1

The deliverable consists of the demonstrator with the first integration of the cameras and sensor system in the head-mounted display. The demonstrator is presented in a document, which is submitted as a deliverable.

Spherical RGB and ToF scene capturing v1

This demonstrator consists of an evaluation of the 3D capability of the spherical ToF-camera for scanning a room or large space. The results are described succinctly in a document submitted as deliverable.

Style Preserving animation of avatars v1

This deliverable consists of a demonstrator presenting the animated avatar with a certain degree of autonomy. The motion styles are preserved and do violate the sensorimotor primitives.

Avatar animation v1

This deliverable consists of a demonstrator presenting the capability of the avatar animation. The results will be succinctly documented in a report.

Photo-realistic scene neutral rendering v1

The report presents the first results on neural rendering with spherical images for large spaces.

Documents, reports (7)

Interim impact and communication assessment report phase 1

The deliverable presents the first assessment of the communication measures. The impact is evaluated through measurable metrics and will lead to an adjustment of the communication strategy.

Architecture design and validation (L3 avatars) v1

The deliverable describes the first approaches and results of the capability of the avatars L3.

Research Requirements for challenges and scenarios v1

This deliverable will present the results of task 1.3 about the use-case description and requirement definition at the project beginning. It will allow for the development of the system architecture.

SHARESPACE avatar definition v1

The deliverable describes the virtual avatar from a technical point of view. This includes the definition of the animation and rendering features as well as API for integration.

Detailed planning on scenario validation v1

The deliverable presents a detailed planning of the trial as conceived in task 6.1. It addresses all aspects of the trial preparation and proposed a detailed timeline with corresponding milestones.

Ethical Framework v1

This report presents the ethical approach and principles of the SHS project, the constitution of the Advisory Board and its activities within the first 12 months.

Architecture design and validation (L1 and L2 avatars) v1

The deliverable presents the results of the first architecture for L1 and L2 avatars, which generate reference motions for the avatar by considering the metrics to be minimised.

Publicaciones

Peer reviewed articles (7)

Distributed control for geometric pattern formation of large-scale multirobot systems

Autores: Andrea Giusti, Gian Carlo Maffettone, Davide Fiore, Marco Coraggio, Mario di Bernardo
Publicado en: Frontiers in Robotics and AI, Edición 10-2023, 2023, ISSN 1664-3224
Editor: Frontiers
DOI: 10.48550/arXiv.2207.14567

Kinematic priming of action predictions

Autores: Eugenio Scaliti, Kiri Pullar, Giulia Borghini, Andrea Cavallo, Stefano Panzeri, Cristina Becchio
Publicado en: CellPress, Edición 33-13, 2023, ISSN 0092-8674
Editor: Cell Press
DOI: 10.1016/j.cub.2023.05.055

The emerging role of virtual reality as an adjunct to procedural sedation and anesthesia

Autores: Rita Hitching; Hunter G. Hoffman; Azucena Garcia-Palacios; Maheen M. Adamson; Esmeralda Madrigal; Wadee Alhalabi; Ahad Alhudali; Mariana Sampaio; Barry Peterson; Miles R. Fontenot; Keira P. Mason
Publicado en: Journal of Clinical Medicine, Edición 12-3, 2023, ISSN 2077-0383
Editor: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/jcm12030843

Guaranteeing Control Requirements via Reward Shaping in Reinforcement Learning

Autores: De Lellis, Francesco; Coraggio, Marco; Russo, Giovanni; Musolesi, Mirco; di Bernardo, Mario
Publicado en: IEEE, 2023, ISSN 1803-7232
Editor: IEEE
DOI: 10.48550/arxiv.2311.10026

Local Convergence of Multi-Agent Systems Toward Rigid Lattices

Autores: Andrea Giusti; Marco Coraggio; Mario di Bernardo
Publicado en: IEEE, 2023, ISSN 1803-7232
Editor: IEEE
DOI: 10.1109/lcsys.2023.3289060

Data-driven architecture to encode information in the kinematics of robots and artificial avatars

Autores: Francesco De Lellis, Marco Coraggio, Nathan C. Foster, Riccardo Villa, Cristina Becchio, Mario di Bernardo
Publicado en: IEEE, 2024, ISSN 1803-7232
Editor: IEEE
DOI: 10.48550/arXiv.2403.06557

Action prediction in psychosis

Autores: Noemi Montobio
Publicado en: SpringerNature, Edición 1264, 2024, ISSN 2193-1801
Editor: Springer Science and Business Media Deutschland GmbH
DOI: 10.1038/s41537-023-00429-x.

Other (4)

Local convergence of multi-agent systems towards triangular patterns

Autores: Giusti, Andrea; Coraggio, Marco; di Bernardo, Mario
Publicado en: IEEE, 2023, ISSN 1803-7232
Editor: IEEE
DOI: 10.48550/arxiv.2303.11865

eXtended Reality of socio-motor interactions: Current Trends and Ethical Considerations for Mixed Reality Environments Design

Autores: Julia Ayache, Marta Bienkiewicz, Kathleen Richardson, Benoit Bardy
Publicado en: ACM, 2023
Editor: ACM
DOI: 10.1145/3610661.361798

Data-driven design of complex network structures to promote synchronization

Autores: Coraggio, Marco; di Bernardo, Mario
Publicado en: 2023
Editor: N/A
DOI: 10.48550/arxiv.2309.10941

Continuification Control of Large-Scale Multiagent Systems Under Limited Sensing and Structural Perturbations

Autores: Gian Carlo Maffettone; Maurizio Porfiri; Mario Di Bernardo
Publicado en: IEEE, 2023
Editor: 1803-7232
DOI: 10.48550/arxiv.2303.13246

Conference proceedings (3)

Improving Image Reconstruction using Incremental PCA-Embedded Convolutional Variational Auto- Encoder

Autores: Amir Azizi, Panayiotis Charalambous, Yiorgos Chrysanthou
Publicado en: WSCG, 2024
Editor: WSCG
DOI: 10.24132/10.24132/CSRN.3401.12

Control- Tutored Deep Reinforcement Learning

Autores: Francesco De Lellis, Marco Coraggio, Giovanni Russo, Mirco Musolesi, Mario di Bernardo
Publicado en: PMLR, Edición 211, 2023, ISSN 2640-3498
Editor: PMLR
DOI: 10.48550/arXiv.2212.01343

Learning-based cognitive architecture for enhancing coordination in human groups

Autores: Antonio Grotta, Marco Coraggio, Antonio Spallone, Francesco De Lellis, Mario di Bernardo
Publicado en: IFAC, 2024, ISSN 0000-1118
Editor: IFAC
DOI: 10.48550/arXiv.2406.06297