A toolset for hyper-realistic and XR-based human-human and human-machine interactions

Informazioni relative al progetto

PRESENCE

ID dell’accordo di sovvenzione: 101135025

DOI

10.3030/101135025

Data della firma CE 20 Ottobre 2023

Data di avvio 1 Gennaio 2024

Data di completamento 31 Dicembre 2026

Finanziato da

• Digital, Industry and Space

Costo totale

€ 7 655 707,51

Contributo UE

€ 7 655 707,50

Coordinato da

FUNDACIO PRIVADA I2CAT, INTERNET I INNOVACIO DIGITAL A CATALUNYA
Spain

CORDIS fornisce collegamenti ai risultati finali pubblici e alle pubblicazioni dei progetti ORIZZONTE.

I link ai risultati e alle pubblicazioni dei progetti del 7° PQ, così come i link ad alcuni tipi di risultati specifici come dataset e software, sono recuperati dinamicamente da .OpenAIRE .

Risultati finali

Documents, reports (9)

Dissemination, communication & exploitation strategy and its first results aiming to maximise the outreach of the results generated in the project.
Dissemination, communication, and exploitation strategy plan

Dissemination, communication & exploitation strategy and its planned activities aiming to maximise the --+outreach of the results generated in the project.

Virtual humans technologies report I

Details about the first iteration of smart avatars and intelligent virtual agents (IVAs ) developed in WP4.

Integration and Demonstration II – Intermediate integration, testing & validation

Phase II related APIs development for the technological pillars, their integration and the deployment, running and validation of the first set of demonstrators. It willinclude the Use Case integrated applications (KPI 5.2).

Human centred Development Phase I - Foundations, Requirements and Initial Planning

Theoretical framework and methodology for user-centred approach, recruitment strategy. Initial Requirements, use case definition and evaluation activities will also be part of this report.

Haptics technologies report I

Middle term details about the work and methods related to the haptic technologies, covering research and development of the haptic technologies.

Volumetric and holoconferencing technologies report I

Middle term details about the work and methods related to WP2, covering volumetric capturing, reconstruction and holoportation compression and optimization techniques.

Integration and Demonstration I - Initial definition and planning

Documenting the initial planning and definition of the activities performed in WP5, such as APIs definition and integration interfaces, architecture and demonstrators.

Human centred Development Phase II - Intermediate User Testing, Presence Evaluation, Ethics, Trust & Privacy

Intermediate report with: usability and UX testing intermediate phase; first iteration of presence evaluation testing; validation of the requirements and use case definition, together with the planning for the future iterations; overview of the ethical, trust & privacy related themes and where these emerge according to use cases, stakeholder and technological components.

Other (1)

Project Management Handbook

Overview of management and procedures to ensure efficient execution of the project and thus contribute to the production of high quality project results: management structure, procedures, tasks and responsibilities on all levels of project execution

Data Management Plan (1)

Data Management Plan II

Intermediary Report on Data Management Plan: information on the implementation and updates in the initial DMP: agreements concluded, new data, changes in the consortium policies, etc.

Pubblicazioni

Conference proceedings (5)

A Toolkit for Creating Intelligent Virtual Humans in Extended Reality

Autori: Fariba Mostajeran, Ke Li, Sebastian Rings, Lucie Kruse, Erik Wolf, Susanne Schmidt, Michael Arz, Joan Llobera, Pierre Nagorny, Caecilia Charbonnier, Hannes Fassold, Xenxo Alvarez, André Tavares, Nuno Santos, João Orvalho, Sergi Fernández, Frank Steinicke
Pubblicato in: 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2025
Editore: IEEE
DOI: 10.1109/VRW66409.2025.00149

Methodological Reflections on Early-Stage Requirement Gathering and Prioritization For Immersive Extended Reality Applications

Autori: Elias Blanckaert, Fariba Mostajeran, Louise Hallström, Iris Jennes
Pubblicato in: Proceedings of the ACM International Conference on Interactive Media Experiences Workshops (ACM IMXw 2025), 2025
Editore: Sociedade Brasileira de Computação
DOI: 10.5753/IMXW.2025.7940

I Hear, See, Speak & Do: Bringing Multimodal Information Processing to Intelligent Virtual Agents for Natural Human-AI Communication

Autori: Ke Li, Fariba Mostajeran, Sebastian Rings, Lucie Kruse, Susanne Schmidt, Michael Arz, Erik Wolf, Frank Steinicke
Pubblicato in: 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2025
Editore: IEEE
DOI: 10.1109/VRW66409.2025.00469

LiveSkeleton: High-Quality Real-Time Human Tracking and Pose Estimation

Autori: Fassold, Hannes
Pubblicato in: IEEE Xplore: 2024 International Symposium on Multimedia (ISM), 2024
Editore: IEEE
DOI: 10.1109/ISM63611.2024.00054

A flexible toolkit for real-time action recognition of virtual humans in XR/AR environments

Autori: Hannes Fassold
Pubblicato in: ACIS International Symposium on Emotional Artificial Intelligence & Metaverse (EAIM) 2025, 2025
Editore: ACIS
DOI: 10.5281/ZENODO.15974094

Peer reviewed articles (3)

Immersive documentary journalism: exploring the impact of 360° virtual reality compared with a 2D screen display on the responses of people toward undocumented young migrants to Spain

Autori: Raúl Gallego Abellán; Carla Teruel Teruel Piñol; Mel Slater
Pubblicato in: Frontiers in Communication, 2024, ISSN 2297-900X
Editore: Frontiers in Communication
DOI: 10.3389/FCOMM.2024.1474524

The Role of Sensorimotor Contingencies and Eye Scanpath Entropy in Presence in Virtual Reality: a Reinforcement Learning Paradigm

Autori: Esen Küçüktütüncü, Francisco Macia-Varela, Joan Llobera, Mel Slater
Pubblicato in: IEEE Transactions on Visualization and Computer Graphics, 2025, ISSN 1077-2626
Editore: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/TVCG.2025.3547241

Confusing virtual reality with reality – An experimental study

Autori: Michael Wiesing, Gemma Comadran, Mel Slater
Pubblicato in: iScience, Numero 28, 2025, ISSN 2589-0042
Editore: Elsevier BV
DOI: 10.1016/J.ISCI.2025.112655