Scalable Platform for Innovations on Real-time Immersive Telepresence

Project Information

SPIRIT

Grant agreement ID: 101070672

DOI

10.3030/101070672

Project closed

EC signature date 23 June 2022

Start date 1 October 2022

End date 31 December 2025

Funded under

• Digital, Industry and Space

Total cost

€ 6 550 608,00

EU contribution

€ 6 097 399,50

Coordinated by

INTERUNIVERSITAIR MICRO-ELECTRONICA CENTRUM
Belgium

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Deliverables

Documents, reports (9)

SPIRIT platform (version 2)

Updated version of tested platform with all defined components and interfaces based on open call experiment results.

Innovation platform enablers (version 2)

Updated technology innovation platforms considering deployment of individual components into the network platform. Considering the role of network components such as edge clouds and impact on technology enablers and distribution of functionalities across the different layers.

Use case requirements, system architecture and interface definition (version 2)

Second version of use case requirements, system architecture and interface definition

Preliminary innovation platform enablers

Preliminary innovation platform enablers across the different layers including input from architecture and requirements inputs.

Open Call toolkit

Report including Open Call text, Guide for Applicants, Guide for Evaluators, and Proposal template.

Project Handbook

Project templates and explanations on the project management process, review process, quality checks, and meeting organisation.

First version of use case requirements, system architecture and interface definition
First version of SPIRIT platform

First version of tested and validated platform with all defined components and interfaces, based on internal use cases.

Communication, dissemination, standardisation and exploitation plan

This plan will define strategies and tools and describe the planned activities to guarantee broad visibility, promotion and up-take of the project results.

Data Management Plan (1)

Data Management Plan - version 1

Best practices and specific standards for the generated data, assess their suitability for sharing/reuse in accordance with official EC guidelines, describe the plan for the IPR management and its implementation.Any updates deemed necessary during the project will be included in the Project Periodic Reports (PPR are contractual by default and therefore not included in this deliverables list).

Publications

Conference proceedings (18)

ComPEQ-MR

Author(s): Minh Nguyen, Shivi Vats, Xuemei Zhou, Irene Viola, Pablo Cesar, Christian Timmerer, Hermann Hellwagner
Published in: Proceedings of the ACM Multimedia Systems Conference 2024 on ZZZ, Issue 12, 2024
Publisher: ACM
DOI: 10.1145/3625468.3652182

Enabling Generative AI based Multi-sensory XR Applications with Mobile Edge Computing

Author(s): Peng Qian, Carlos Velez Redondo, Ning Wang, Carl Udora, JingXuan Men, Rahim Tafazolli
Published in: IEEE INFOCOM 2025 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), 2025
Publisher: IEEE
DOI: 10.1109/INFOCOMWKSHPS65812.2025.11152969

Enabling eBPF-based packet duplication for robust volumetric video streaming

Author(s): Peng Qian, Ning Wang, Foh Chuan Heng, Jia Zhang, Carl Udora, Rahim Tafazolli
Published in: 2024 IEEE Symposium on Computers and Communications (ISCC), 2024
Publisher: IEEE
DOI: 10.1109/ISCC61673.2024.10733617

Quality of Experience Modelling and Analysis for Live Holographic Teleportation

Author(s): Carl Udora, Peng Qian, Sweta Anmulwar, Anil Fernando, and Ning Wang
Published in: International Conference on Computing, Networking and Communications 2024 (ICNC 2024), 2024, ISSN 2473-7585
Publisher: IEEE
DOI: 10.1109/ICNC59896.2024.10556032

STEP-MR: A Subjective Testing and Eye-Tracking Platform for Dynamic Point Clouds in Mixed Reality

Author(s): Shivi Vats, Christian Timmerer, Hermann Hellwagner
Published in: Proceedings of EuroXR
Publisher: Zurich University of Applied Sciences (ZHAW)

Video-Driven Animation of Neural Head Avatars

Author(s): W. Paier, P. Hinzer, A. Hilsmann, P. Eisert
Published in: Proc. International Workshop on Vision, Modeling, and Visualization (VMV), Braunschweig, Germany, Sep. 2023, 2023
Publisher: The Eurographics Association
DOI: 10.2312/vmv.20231237

Demonstration of Viewport-Aware Hybrid Broadcast-Unicast Streaming for Volumetric Video

Author(s): Casper Haems, Matthias De Fré, Tim Wauters, Filip De Turck
Published in: 2025 16th International Conference on Network of the Future (NoF), 2025
Publisher: IEEE
DOI: 10.1109/NOF66640.2025.11223293

Enabling Haptic-Integrated Interactive Holographic Video Streaming Powered by 5G Edge Computing

Author(s): Peng Qian, Ning Wang, Carl Udora, Carlos Velez Redondo, JingXuan Men, Rahim Tafazolli
Published in: 2025 IEEE International Conference on Multimedia and Expo (ICME), 2025
Publisher: IEEE
DOI: 10.1109/ICME59968.2025.11209485

Impact of Quality and Distance on the Perception of Point Clouds in Mixed Reality

Author(s): Nguyen, Minh; Vats, Shivi; Van Damme, Sam; van der Hooft, Jeroen; Torres Vega, Maria; Wauters, Tim; Timmerer, Christian; Hellwagner, Hermann
Published in: 15th International Conference on Quality of Multimedia Experience (QoMEX), 2023, ISBN 979-8-3503-1173-0
Publisher: IEEE
DOI: 10.1109/qomex58391.2023.10178491

User-Intent Aware Transport-Layer Intelligence for Frame Synchronisation in Multi-Party XR Application

Author(s): Vu San Ha Huynh, Peng Qian, Ning Wang, Carl Udora, Rahim Tafazolli
Published in: 2024 IEEE Gaming, Entertainment, and Media Conference (GEM), 2024
Publisher: IEEE
DOI: 10.1109/GEM61861.2024.10585795

Enabling User Intent-based Network Path Adaptation for Live Volumetric Streaming

Author(s): Peng Qian, Ning Wang, Foh Chuan Heng, Carl Udora, Rahim Tafazolli
Published in: 2024 IFIP Networking Conference (IFIP Networking), Issue 23.7, 2024
Publisher: IEEE
DOI: 10.23919/IFIPNetworking62109.2024.10619068

Immersive and Interactive Subjective Quality Assessment of Dynamic Volumetric Meshes

Author(s): Van Damme, Sam; Mahdi, Imen; Ravuri, Hemanth Kumar; van der Hooft, Jeroen; De Turck, Filip; Torres Vega, Maria
Published in: 15th International Conference on Quality of Multimedia Experience (QoMEX), 2023, ISBN 979-8-3503-1173-0
Publisher: IEEE
DOI: 10.1109/qomex58391.2023.10178610

Towards Efficient Transport for Real-Time Immersive Applications over Hybrid Networks

Author(s): Casper Haems; Matthias De Fré; Tim Wauters; Filip De Turck
Published in: 2025 16th International Conference on Network of the Future (NoF), 2025, ISSN 2833-0072
Publisher: IEEE

No-Reference Quality of Experience Model for Dynamic Point Clouds in Augmented Reality

Author(s): Minh Nguyen, Shivi Vats, Hermann Hellwagner
Published in: Proceedings of the 3rd Mile-High Video Conference on zzz, 2024, ISBN 979-8-4007-0493-2
Publisher: ACM
DOI: 10.1145/3638036.3640248

Scalable MDC-Based Volumetric Video Delivery for Real-Time One-to-Many WebRTC Conferencing

Author(s): Matthias De Fré, Jeroen van der Hooft, Tim Wauters, Filip De Turck
Published in: Proceedings of the ACM Multimedia Systems Conference 2024 on ZZZ, Issue 2, 2024
Publisher: ACM
DOI: 10.1145/3625468.3647617

GreenWise: Intelligent Application Migration for Containerized Machine Learning Services in the Computing Continuum

Author(s): Peini Liu, José Santos, Filip De Turck, Jordi Guitart
Published in: Proceedings of the 18th IEEE/ACM International Conference on Utility and Cloud Computing, 2025
Publisher: ACM
DOI: 10.1145/3773274.3774275

Demonstrating Adaptive Many-to-Many Immersive Teleconferencing for Volumetric Video

Author(s): Matthias De Fré, Jeroen van der Hooft, Tim Wauters, Filip De Turck
Published in: Proceedings of the ACM Multimedia Systems Conference 2024 on ZZZ, Issue 2, 2024
Publisher: ACM
DOI: 10.1145/3625468.3652192

A Platform for Subjective Quality Assessment in Mixed Reality Environments

Author(s): Vats, Shivi; Nguyen, Minh; Van Damme, Sam; van der Hooft, Jeroen; Torres Vega, Maria; Wauters, Tim; Timmerer, Christian; Hellwagner, Hermann
Published in: 15th International Conference on Quality of Multimedia Experience (QoMEX) - Towards Sustainable and Inclusive Multimedia Experiences, 2023, ISSN 2372-7179
Publisher: IEEE
DOI: 10.1109/qomex58391.2023.10178443

Peer reviewed articles (6)

IEEE Transactions on Visualization and Computer Graphics

Author(s): Morgenstern, Wieland; Bagdasarian, Milena T.; Hilsmann, Anna; Eisert, Peter
Published in: IEEE Transactions on Visualization and Computer Graphics, Issue Volume 30, Issue 5, 2024, ISSN 1077-2626
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.48550/arxiv.2310.03615

Scalable MDC-Based WebRTC Streaming for One-to-Many Volumetric Video Conferencing

Author(s): Matthias De Fré, Jeroen van der Hooft, Tim Wauters, Filip De Turck
Published in: ACM Transactions on Multimedia Computing, Communications, and Applications, 2025, ISSN 1551-6857
Publisher: Association for Computing Machinery (ACM)
DOI: 10.1145/3768314

Characterization of the Quality of Experience and Immersion of Point Cloud Videos in Augmented Reality Through a Subjective Study

Author(s): Minh Nguyen, Shivi Vats, Sam Van Damme, Jeroen Van Der Hooft, Maria Torres Vega, Tim Wauters, Filip de Turck, Christian Timmerer, and Hermann Hellwagner
Published in: IEEE Access, Issue vol. 11, 2023, 2023, ISSN 2169-3536
Publisher: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/ACCESS.2023.3326374

Animatable Virtual Humans: Learning Pose-Dependent Human Representations in UV Space for Interactive Performance Synthesis

Author(s): Wieland Morgenstern, Milena T. Bagdasarian, Anna Hilsmann, Peter Eisert
Published in: IEEE Transactions on Visualization and Computer Graphics, Issue 30, 2024, ISSN 1077-2626
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/TVCG.2024.3372117

A Multidimensional Media Adaptation Framework for Live Holographic Communication

Author(s): Carl Udora, Peng Qian, Jingxuan Men, Ning Wang
Published in: IEEE Transactions on Multimedia, Issue 28, 2026, ISSN 1520-9210
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/TMM.2025.3623505

Eye-Tracking, Quality Assessment, and QoE Prediction Models for Point Cloud Videos: Extended Analysis of the ComPEQ-MR Dataset

Author(s): Shivi Vats, Minh Nguyen, Christian Timmerer, Hermann Hellwagner
Published in: IEEE Access, Issue 13, 2025, ISSN 2169-3536
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/ACCESS.2025.3635789