A toolset for hyper-realistic and XR-based human-human and human-machine interactions

Información del proyecto

PRESENCE

Identificador del acuerdo de subvención: 101135025

DOI

10.3030/101135025

Fecha de la firma de la CE 20 Octubre 2023

Fecha de inicio 1 Enero 2024

Fecha de finalización 31 Diciembre 2026

Financiado con arreglo a

• Digital, Industry and Space

Coste total

€ 7 655 707,51

Aportación de la UE

€ 7 655 707,50

Coordinado por

FUNDACIO PRIVADA I2CAT, INTERNET I INNOVACIO DIGITAL A CATALUNYA
Spain

CORDIS proporciona enlaces a los documentos públicos y las publicaciones de los proyectos de los programas marco HORIZONTE.

Los enlaces a los documentos y las publicaciones de los proyectos del Séptimo Programa Marco, así como los enlaces a algunos tipos de resultados específicos, como conjuntos de datos y «software», se obtienen dinámicamente de OpenAIRE .

Resultado final

Documents, reports (9)

Dissemination, communication & exploitation strategy and its first results aiming to maximise the outreach of the results generated in the project.
Dissemination, communication, and exploitation strategy plan

Dissemination, communication & exploitation strategy and its planned activities aiming to maximise the --+outreach of the results generated in the project.

Virtual humans technologies report I

Details about the first iteration of smart avatars and intelligent virtual agents (IVAs ) developed in WP4.

Integration and Demonstration II – Intermediate integration, testing & validation

Phase II related APIs development for the technological pillars, their integration and the deployment, running and validation of the first set of demonstrators. It willinclude the Use Case integrated applications (KPI 5.2).

Human centred Development Phase I - Foundations, Requirements and Initial Planning

Theoretical framework and methodology for user-centred approach, recruitment strategy. Initial Requirements, use case definition and evaluation activities will also be part of this report.

Haptics technologies report I

Middle term details about the work and methods related to the haptic technologies, covering research and development of the haptic technologies.

Volumetric and holoconferencing technologies report I

Middle term details about the work and methods related to WP2, covering volumetric capturing, reconstruction and holoportation compression and optimization techniques.

Integration and Demonstration I - Initial definition and planning

Documenting the initial planning and definition of the activities performed in WP5, such as APIs definition and integration interfaces, architecture and demonstrators.

Human centred Development Phase II - Intermediate User Testing, Presence Evaluation, Ethics, Trust & Privacy

Intermediate report with: usability and UX testing intermediate phase; first iteration of presence evaluation testing; validation of the requirements and use case definition, together with the planning for the future iterations; overview of the ethical, trust & privacy related themes and where these emerge according to use cases, stakeholder and technological components.

Other (1)

Project Management Handbook

Overview of management and procedures to ensure efficient execution of the project and thus contribute to the production of high quality project results: management structure, procedures, tasks and responsibilities on all levels of project execution

Data Management Plan (1)

Data Management Plan II

Intermediary Report on Data Management Plan: information on the implementation and updates in the initial DMP: agreements concluded, new data, changes in the consortium policies, etc.

Publicaciones

Conference proceedings (5)

A Toolkit for Creating Intelligent Virtual Humans in Extended Reality

Autores: Fariba Mostajeran, Ke Li, Sebastian Rings, Lucie Kruse, Erik Wolf, Susanne Schmidt, Michael Arz, Joan Llobera, Pierre Nagorny, Caecilia Charbonnier, Hannes Fassold, Xenxo Alvarez, André Tavares, Nuno Santos, João Orvalho, Sergi Fernández, Frank Steinicke
Publicado en: 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2025
Editor: IEEE
DOI: 10.1109/VRW66409.2025.00149

Methodological Reflections on Early-Stage Requirement Gathering and Prioritization For Immersive Extended Reality Applications

Autores: Elias Blanckaert, Fariba Mostajeran, Louise Hallström, Iris Jennes
Publicado en: Proceedings of the ACM International Conference on Interactive Media Experiences Workshops (ACM IMXw 2025), 2025
Editor: Sociedade Brasileira de Computação
DOI: 10.5753/IMXW.2025.7940

I Hear, See, Speak & Do: Bringing Multimodal Information Processing to Intelligent Virtual Agents for Natural Human-AI Communication

Autores: Ke Li, Fariba Mostajeran, Sebastian Rings, Lucie Kruse, Susanne Schmidt, Michael Arz, Erik Wolf, Frank Steinicke
Publicado en: 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2025
Editor: IEEE
DOI: 10.1109/VRW66409.2025.00469

LiveSkeleton: High-Quality Real-Time Human Tracking and Pose Estimation

Autores: Fassold, Hannes
Publicado en: IEEE Xplore: 2024 International Symposium on Multimedia (ISM), 2024
Editor: IEEE
DOI: 10.1109/ISM63611.2024.00054

A flexible toolkit for real-time action recognition of virtual humans in XR/AR environments

Autores: Hannes Fassold
Publicado en: ACIS International Symposium on Emotional Artificial Intelligence & Metaverse (EAIM) 2025, 2025
Editor: ACIS
DOI: 10.5281/ZENODO.15974094

Peer reviewed articles (3)

Immersive documentary journalism: exploring the impact of 360° virtual reality compared with a 2D screen display on the responses of people toward undocumented young migrants to Spain

Autores: Raúl Gallego Abellán; Carla Teruel Teruel Piñol; Mel Slater
Publicado en: Frontiers in Communication, 2024, ISSN 2297-900X
Editor: Frontiers in Communication
DOI: 10.3389/FCOMM.2024.1474524

The Role of Sensorimotor Contingencies and Eye Scanpath Entropy in Presence in Virtual Reality: a Reinforcement Learning Paradigm

Autores: Esen Küçüktütüncü, Francisco Macia-Varela, Joan Llobera, Mel Slater
Publicado en: IEEE Transactions on Visualization and Computer Graphics, 2025, ISSN 1077-2626
Editor: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/TVCG.2025.3547241

Confusing virtual reality with reality – An experimental study

Autores: Michael Wiesing, Gemma Comadran, Mel Slater
Publicado en: iScience, Edición 28, 2025, ISSN 2589-0042
Editor: Elsevier BV
DOI: 10.1016/J.ISCI.2025.112655