Scalable Platform for Innovations on Real-time Immersive Telepresence

Informations projet

SPIRIT

N° de convention de subvention: 101070672

DOI

10.3030/101070672

Projet clôturé

Date de signature de la CE 23 Juin 2022

Date de début 1 Octobre 2022

Date de fin 31 Decembre 2025

Financé au titre de

• Digital, Industry and Space

Coût total

€ 6 550 608,00

Contribution de l’UE

€ 6 097 399,50

Coordonné par

INTERUNIVERSITAIR MICRO-ELECTRONICA CENTRUM
Belgium

CORDIS fournit des liens vers les livrables publics et les publications des projets HORIZON.

Les liens vers les livrables et les publications des projets du 7e PC, ainsi que les liens vers certains types de résultats spécifiques tels que les jeux de données et les logiciels, sont récupérés dynamiquement sur OpenAIRE .

Livrables

Documents, reports (9)

SPIRIT platform (version 2)

Updated version of tested platform with all defined components and interfaces based on open call experiment results.

Innovation platform enablers (version 2)

Updated technology innovation platforms considering deployment of individual components into the network platform. Considering the role of network components such as edge clouds and impact on technology enablers and distribution of functionalities across the different layers.

Use case requirements, system architecture and interface definition (version 2)

Second version of use case requirements, system architecture and interface definition

Preliminary innovation platform enablers

Preliminary innovation platform enablers across the different layers including input from architecture and requirements inputs.

Open Call toolkit

Report including Open Call text, Guide for Applicants, Guide for Evaluators, and Proposal template.

Project Handbook

Project templates and explanations on the project management process, review process, quality checks, and meeting organisation.

First version of use case requirements, system architecture and interface definition
First version of SPIRIT platform

First version of tested and validated platform with all defined components and interfaces, based on internal use cases.

Communication, dissemination, standardisation and exploitation plan

This plan will define strategies and tools and describe the planned activities to guarantee broad visibility, promotion and up-take of the project results.

Data Management Plan (1)

Data Management Plan - version 1

Best practices and specific standards for the generated data, assess their suitability for sharing/reuse in accordance with official EC guidelines, describe the plan for the IPR management and its implementation.Any updates deemed necessary during the project will be included in the Project Periodic Reports (PPR are contractual by default and therefore not included in this deliverables list).

Publications

Conference proceedings (18)

ComPEQ-MR

Auteurs: Minh Nguyen, Shivi Vats, Xuemei Zhou, Irene Viola, Pablo Cesar, Christian Timmerer, Hermann Hellwagner
Publié dans: Proceedings of the ACM Multimedia Systems Conference 2024 on ZZZ, Numéro 12, 2024
Éditeur: ACM
DOI: 10.1145/3625468.3652182

Enabling Generative AI based Multi-sensory XR Applications with Mobile Edge Computing

Auteurs: Peng Qian, Carlos Velez Redondo, Ning Wang, Carl Udora, JingXuan Men, Rahim Tafazolli
Publié dans: IEEE INFOCOM 2025 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), 2025
Éditeur: IEEE
DOI: 10.1109/INFOCOMWKSHPS65812.2025.11152969

Enabling eBPF-based packet duplication for robust volumetric video streaming

Auteurs: Peng Qian, Ning Wang, Foh Chuan Heng, Jia Zhang, Carl Udora, Rahim Tafazolli
Publié dans: 2024 IEEE Symposium on Computers and Communications (ISCC), 2024
Éditeur: IEEE
DOI: 10.1109/ISCC61673.2024.10733617

Quality of Experience Modelling and Analysis for Live Holographic Teleportation

Auteurs: Carl Udora, Peng Qian, Sweta Anmulwar, Anil Fernando, and Ning Wang
Publié dans: International Conference on Computing, Networking and Communications 2024 (ICNC 2024), 2024, ISSN 2473-7585
Éditeur: IEEE
DOI: 10.1109/ICNC59896.2024.10556032

STEP-MR: A Subjective Testing and Eye-Tracking Platform for Dynamic Point Clouds in Mixed Reality

Auteurs: Shivi Vats, Christian Timmerer, Hermann Hellwagner
Publié dans: Proceedings of EuroXR
Éditeur: Zurich University of Applied Sciences (ZHAW)

Video-Driven Animation of Neural Head Avatars

Auteurs: W. Paier, P. Hinzer, A. Hilsmann, P. Eisert
Publié dans: Proc. International Workshop on Vision, Modeling, and Visualization (VMV), Braunschweig, Germany, Sep. 2023, 2023
Éditeur: The Eurographics Association
DOI: 10.2312/vmv.20231237

Demonstration of Viewport-Aware Hybrid Broadcast-Unicast Streaming for Volumetric Video

Auteurs: Casper Haems, Matthias De Fré, Tim Wauters, Filip De Turck
Publié dans: 2025 16th International Conference on Network of the Future (NoF), 2025
Éditeur: IEEE
DOI: 10.1109/NOF66640.2025.11223293

Enabling Haptic-Integrated Interactive Holographic Video Streaming Powered by 5G Edge Computing

Auteurs: Peng Qian, Ning Wang, Carl Udora, Carlos Velez Redondo, JingXuan Men, Rahim Tafazolli
Publié dans: 2025 IEEE International Conference on Multimedia and Expo (ICME), 2025
Éditeur: IEEE
DOI: 10.1109/ICME59968.2025.11209485

Impact of Quality and Distance on the Perception of Point Clouds in Mixed Reality

Auteurs: Nguyen, Minh; Vats, Shivi; Van Damme, Sam; van der Hooft, Jeroen; Torres Vega, Maria; Wauters, Tim; Timmerer, Christian; Hellwagner, Hermann
Publié dans: 15th International Conference on Quality of Multimedia Experience (QoMEX), 2023, ISBN 979-8-3503-1173-0
Éditeur: IEEE
DOI: 10.1109/qomex58391.2023.10178491

User-Intent Aware Transport-Layer Intelligence for Frame Synchronisation in Multi-Party XR Application

Auteurs: Vu San Ha Huynh, Peng Qian, Ning Wang, Carl Udora, Rahim Tafazolli
Publié dans: 2024 IEEE Gaming, Entertainment, and Media Conference (GEM), 2024
Éditeur: IEEE
DOI: 10.1109/GEM61861.2024.10585795

Enabling User Intent-based Network Path Adaptation for Live Volumetric Streaming

Auteurs: Peng Qian, Ning Wang, Foh Chuan Heng, Carl Udora, Rahim Tafazolli
Publié dans: 2024 IFIP Networking Conference (IFIP Networking), Numéro 23.7, 2024
Éditeur: IEEE
DOI: 10.23919/IFIPNetworking62109.2024.10619068

Immersive and Interactive Subjective Quality Assessment of Dynamic Volumetric Meshes

Auteurs: Van Damme, Sam; Mahdi, Imen; Ravuri, Hemanth Kumar; van der Hooft, Jeroen; De Turck, Filip; Torres Vega, Maria
Publié dans: 15th International Conference on Quality of Multimedia Experience (QoMEX), 2023, ISBN 979-8-3503-1173-0
Éditeur: IEEE
DOI: 10.1109/qomex58391.2023.10178610

Towards Efficient Transport for Real-Time Immersive Applications over Hybrid Networks

Auteurs: Casper Haems; Matthias De Fré; Tim Wauters; Filip De Turck
Publié dans: 2025 16th International Conference on Network of the Future (NoF), 2025, ISSN 2833-0072
Éditeur: IEEE

No-Reference Quality of Experience Model for Dynamic Point Clouds in Augmented Reality

Auteurs: Minh Nguyen, Shivi Vats, Hermann Hellwagner
Publié dans: Proceedings of the 3rd Mile-High Video Conference on zzz, 2024, ISBN 979-8-4007-0493-2
Éditeur: ACM
DOI: 10.1145/3638036.3640248

Scalable MDC-Based Volumetric Video Delivery for Real-Time One-to-Many WebRTC Conferencing

Auteurs: Matthias De Fré, Jeroen van der Hooft, Tim Wauters, Filip De Turck
Publié dans: Proceedings of the ACM Multimedia Systems Conference 2024 on ZZZ, Numéro 2, 2024
Éditeur: ACM
DOI: 10.1145/3625468.3647617

GreenWise: Intelligent Application Migration for Containerized Machine Learning Services in the Computing Continuum

Auteurs: Peini Liu, José Santos, Filip De Turck, Jordi Guitart
Publié dans: Proceedings of the 18th IEEE/ACM International Conference on Utility and Cloud Computing, 2025
Éditeur: ACM
DOI: 10.1145/3773274.3774275

Demonstrating Adaptive Many-to-Many Immersive Teleconferencing for Volumetric Video

Auteurs: Matthias De Fré, Jeroen van der Hooft, Tim Wauters, Filip De Turck
Publié dans: Proceedings of the ACM Multimedia Systems Conference 2024 on ZZZ, Numéro 2, 2024
Éditeur: ACM
DOI: 10.1145/3625468.3652192

A Platform for Subjective Quality Assessment in Mixed Reality Environments

Auteurs: Vats, Shivi; Nguyen, Minh; Van Damme, Sam; van der Hooft, Jeroen; Torres Vega, Maria; Wauters, Tim; Timmerer, Christian; Hellwagner, Hermann
Publié dans: 15th International Conference on Quality of Multimedia Experience (QoMEX) - Towards Sustainable and Inclusive Multimedia Experiences, 2023, ISSN 2372-7179
Éditeur: IEEE
DOI: 10.1109/qomex58391.2023.10178443

Peer reviewed articles (6)

IEEE Transactions on Visualization and Computer Graphics

Auteurs: Morgenstern, Wieland; Bagdasarian, Milena T.; Hilsmann, Anna; Eisert, Peter
Publié dans: IEEE Transactions on Visualization and Computer Graphics, Numéro Volume 30, Numéro 5, 2024, ISSN 1077-2626
Éditeur: Institute of Electrical and Electronics Engineers
DOI: 10.48550/arxiv.2310.03615

Scalable MDC-Based WebRTC Streaming for One-to-Many Volumetric Video Conferencing

Auteurs: Matthias De Fré, Jeroen van der Hooft, Tim Wauters, Filip De Turck
Publié dans: ACM Transactions on Multimedia Computing, Communications, and Applications, 2025, ISSN 1551-6857
Éditeur: Association for Computing Machinery (ACM)
DOI: 10.1145/3768314

Characterization of the Quality of Experience and Immersion of Point Cloud Videos in Augmented Reality Through a Subjective Study

Auteurs: Minh Nguyen, Shivi Vats, Sam Van Damme, Jeroen Van Der Hooft, Maria Torres Vega, Tim Wauters, Filip de Turck, Christian Timmerer, and Hermann Hellwagner
Publié dans: IEEE Access, Numéro vol. 11, 2023, 2023, ISSN 2169-3536
Éditeur: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/ACCESS.2023.3326374

Animatable Virtual Humans: Learning Pose-Dependent Human Representations in UV Space for Interactive Performance Synthesis

Auteurs: Wieland Morgenstern, Milena T. Bagdasarian, Anna Hilsmann, Peter Eisert
Publié dans: IEEE Transactions on Visualization and Computer Graphics, Numéro 30, 2024, ISSN 1077-2626
Éditeur: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/TVCG.2024.3372117

A Multidimensional Media Adaptation Framework for Live Holographic Communication

Auteurs: Carl Udora, Peng Qian, Jingxuan Men, Ning Wang
Publié dans: IEEE Transactions on Multimedia, Numéro 28, 2026, ISSN 1520-9210
Éditeur: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/TMM.2025.3623505

Eye-Tracking, Quality Assessment, and QoE Prediction Models for Point Cloud Videos: Extended Analysis of the ComPEQ-MR Dataset

Auteurs: Shivi Vats, Minh Nguyen, Christian Timmerer, Hermann Hellwagner
Publié dans: IEEE Access, Numéro 13, 2025, ISSN 2169-3536
Éditeur: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/ACCESS.2025.3635789