A toolset for hyper-realistic and XR-based human-human and human-machine interactions

Informations projet

PRESENCE

N° de convention de subvention: 101135025

DOI

10.3030/101135025

Date de signature de la CE 20 Octobre 2023

Date de début 1 Janvier 2024

Date de fin 31 Decembre 2026

Financé au titre de

• Digital, Industry and Space

Coût total

€ 7 655 707,51

Contribution de l’UE

€ 7 655 707,50

Coordonné par

FUNDACIO PRIVADA I2CAT, INTERNET I INNOVACIO DIGITAL A CATALUNYA
Spain

CORDIS fournit des liens vers les livrables publics et les publications des projets HORIZON.

Les liens vers les livrables et les publications des projets du 7e PC, ainsi que les liens vers certains types de résultats spécifiques tels que les jeux de données et les logiciels, sont récupérés dynamiquement sur OpenAIRE .

Livrables

Documents, reports (9)

Dissemination, communication & exploitation strategy and its first results aiming to maximise the outreach of the results generated in the project.
Dissemination, communication, and exploitation strategy plan

Dissemination, communication & exploitation strategy and its planned activities aiming to maximise the --+outreach of the results generated in the project.

Virtual humans technologies report I

Details about the first iteration of smart avatars and intelligent virtual agents (IVAs ) developed in WP4.

Integration and Demonstration II – Intermediate integration, testing & validation

Phase II related APIs development for the technological pillars, their integration and the deployment, running and validation of the first set of demonstrators. It willinclude the Use Case integrated applications (KPI 5.2).

Human centred Development Phase I - Foundations, Requirements and Initial Planning

Theoretical framework and methodology for user-centred approach, recruitment strategy. Initial Requirements, use case definition and evaluation activities will also be part of this report.

Haptics technologies report I

Middle term details about the work and methods related to the haptic technologies, covering research and development of the haptic technologies.

Volumetric and holoconferencing technologies report I

Middle term details about the work and methods related to WP2, covering volumetric capturing, reconstruction and holoportation compression and optimization techniques.

Integration and Demonstration I - Initial definition and planning

Documenting the initial planning and definition of the activities performed in WP5, such as APIs definition and integration interfaces, architecture and demonstrators.

Human centred Development Phase II - Intermediate User Testing, Presence Evaluation, Ethics, Trust & Privacy

Intermediate report with: usability and UX testing intermediate phase; first iteration of presence evaluation testing; validation of the requirements and use case definition, together with the planning for the future iterations; overview of the ethical, trust & privacy related themes and where these emerge according to use cases, stakeholder and technological components.

Other (1)

Project Management Handbook

Overview of management and procedures to ensure efficient execution of the project and thus contribute to the production of high quality project results: management structure, procedures, tasks and responsibilities on all levels of project execution

Data Management Plan (1)

Data Management Plan II

Intermediary Report on Data Management Plan: information on the implementation and updates in the initial DMP: agreements concluded, new data, changes in the consortium policies, etc.

Publications

Conference proceedings (5)

A Toolkit for Creating Intelligent Virtual Humans in Extended Reality

Auteurs: Fariba Mostajeran, Ke Li, Sebastian Rings, Lucie Kruse, Erik Wolf, Susanne Schmidt, Michael Arz, Joan Llobera, Pierre Nagorny, Caecilia Charbonnier, Hannes Fassold, Xenxo Alvarez, André Tavares, Nuno Santos, João Orvalho, Sergi Fernández, Frank Steinicke
Publié dans: 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2025
Éditeur: IEEE
DOI: 10.1109/VRW66409.2025.00149

Methodological Reflections on Early-Stage Requirement Gathering and Prioritization For Immersive Extended Reality Applications

Auteurs: Elias Blanckaert, Fariba Mostajeran, Louise Hallström, Iris Jennes
Publié dans: Proceedings of the ACM International Conference on Interactive Media Experiences Workshops (ACM IMXw 2025), 2025
Éditeur: Sociedade Brasileira de Computação
DOI: 10.5753/IMXW.2025.7940

I Hear, See, Speak & Do: Bringing Multimodal Information Processing to Intelligent Virtual Agents for Natural Human-AI Communication

Auteurs: Ke Li, Fariba Mostajeran, Sebastian Rings, Lucie Kruse, Susanne Schmidt, Michael Arz, Erik Wolf, Frank Steinicke
Publié dans: 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2025
Éditeur: IEEE
DOI: 10.1109/VRW66409.2025.00469

LiveSkeleton: High-Quality Real-Time Human Tracking and Pose Estimation

Auteurs: Fassold, Hannes
Publié dans: IEEE Xplore: 2024 International Symposium on Multimedia (ISM), 2024
Éditeur: IEEE
DOI: 10.1109/ISM63611.2024.00054

A flexible toolkit for real-time action recognition of virtual humans in XR/AR environments

Auteurs: Hannes Fassold
Publié dans: ACIS International Symposium on Emotional Artificial Intelligence & Metaverse (EAIM) 2025, 2025
Éditeur: ACIS
DOI: 10.5281/ZENODO.15974094

Peer reviewed articles (3)

Immersive documentary journalism: exploring the impact of 360° virtual reality compared with a 2D screen display on the responses of people toward undocumented young migrants to Spain

Auteurs: Raúl Gallego Abellán; Carla Teruel Teruel Piñol; Mel Slater
Publié dans: Frontiers in Communication, 2024, ISSN 2297-900X
Éditeur: Frontiers in Communication
DOI: 10.3389/FCOMM.2024.1474524

The Role of Sensorimotor Contingencies and Eye Scanpath Entropy in Presence in Virtual Reality: a Reinforcement Learning Paradigm

Auteurs: Esen Küçüktütüncü, Francisco Macia-Varela, Joan Llobera, Mel Slater
Publié dans: IEEE Transactions on Visualization and Computer Graphics, 2025, ISSN 1077-2626
Éditeur: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/TVCG.2025.3547241

Confusing virtual reality with reality – An experimental study

Auteurs: Michael Wiesing, Gemma Comadran, Mel Slater
Publié dans: iScience, Numéro 28, 2025, ISSN 2589-0042
Éditeur: Elsevier BV
DOI: 10.1016/J.ISCI.2025.112655