Scalable Platform for Innovations on Real-time Immersive Telepresence

Informacje na temat projektu

SPIRIT

Identyfikator umowy o grant: 101070672

DOI

10.3030/101070672

Projekt został zamknięty

Data podpisania przez KE 23 Czerwca 2022

Data rozpoczęcia 1 Października 2022

Data zakończenia 31 Grudnia 2025

Finansowanie w ramach

• Digital, Industry and Space

Koszt całkowity

€ 6 550 608,00

Wkład UE

€ 6 097 399,50

Koordynowany przez

INTERUNIVERSITAIR MICRO-ELECTRONICA CENTRUM
Belgium

CORDIS oferuje możliwość skorzystania z odnośników do publicznie dostępnych publikacji i rezultatów projektów realizowanych w ramach programów ramowych HORYZONT.

Odnośniki do rezultatów i publikacji związanych z poszczególnymi projektami 7PR, a także odnośniki do niektórych konkretnych kategorii wyników, takich jak zbiory danych i oprogramowanie, są dynamicznie pobierane z systemu OpenAIRE .

Rezultaty

Documents, reports (9)

SPIRIT platform (version 2)

Updated version of tested platform with all defined components and interfaces based on open call experiment results.

Innovation platform enablers (version 2)

Updated technology innovation platforms considering deployment of individual components into the network platform. Considering the role of network components such as edge clouds and impact on technology enablers and distribution of functionalities across the different layers.

Use case requirements, system architecture and interface definition (version 2)

Second version of use case requirements, system architecture and interface definition

Preliminary innovation platform enablers

Preliminary innovation platform enablers across the different layers including input from architecture and requirements inputs.

Open Call toolkit

Report including Open Call text, Guide for Applicants, Guide for Evaluators, and Proposal template.

Project Handbook

Project templates and explanations on the project management process, review process, quality checks, and meeting organisation.

First version of use case requirements, system architecture and interface definition
First version of SPIRIT platform

First version of tested and validated platform with all defined components and interfaces, based on internal use cases.

Communication, dissemination, standardisation and exploitation plan

This plan will define strategies and tools and describe the planned activities to guarantee broad visibility, promotion and up-take of the project results.

Data Management Plan (1)

Data Management Plan - version 1

Best practices and specific standards for the generated data, assess their suitability for sharing/reuse in accordance with official EC guidelines, describe the plan for the IPR management and its implementation.Any updates deemed necessary during the project will be included in the Project Periodic Reports (PPR are contractual by default and therefore not included in this deliverables list).

Publikacje

Conference proceedings (18)

ComPEQ-MR

Autorzy: Minh Nguyen, Shivi Vats, Xuemei Zhou, Irene Viola, Pablo Cesar, Christian Timmerer, Hermann Hellwagner
Opublikowane w: Proceedings of the ACM Multimedia Systems Conference 2024 on ZZZ, Numer 12, 2024
Wydawca: ACM
DOI: 10.1145/3625468.3652182

Enabling Generative AI based Multi-sensory XR Applications with Mobile Edge Computing

Autorzy: Peng Qian, Carlos Velez Redondo, Ning Wang, Carl Udora, JingXuan Men, Rahim Tafazolli
Opublikowane w: IEEE INFOCOM 2025 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), 2025
Wydawca: IEEE
DOI: 10.1109/INFOCOMWKSHPS65812.2025.11152969

Enabling eBPF-based packet duplication for robust volumetric video streaming

Autorzy: Peng Qian, Ning Wang, Foh Chuan Heng, Jia Zhang, Carl Udora, Rahim Tafazolli
Opublikowane w: 2024 IEEE Symposium on Computers and Communications (ISCC), 2024
Wydawca: IEEE
DOI: 10.1109/ISCC61673.2024.10733617

Quality of Experience Modelling and Analysis for Live Holographic Teleportation

Autorzy: Carl Udora, Peng Qian, Sweta Anmulwar, Anil Fernando, and Ning Wang
Opublikowane w: International Conference on Computing, Networking and Communications 2024 (ICNC 2024), 2024, ISSN 2473-7585
Wydawca: IEEE
DOI: 10.1109/ICNC59896.2024.10556032

STEP-MR: A Subjective Testing and Eye-Tracking Platform for Dynamic Point Clouds in Mixed Reality

Autorzy: Shivi Vats, Christian Timmerer, Hermann Hellwagner
Opublikowane w: Proceedings of EuroXR
Wydawca: Zurich University of Applied Sciences (ZHAW)

Video-Driven Animation of Neural Head Avatars

Autorzy: W. Paier, P. Hinzer, A. Hilsmann, P. Eisert
Opublikowane w: Proc. International Workshop on Vision, Modeling, and Visualization (VMV), Braunschweig, Germany, Sep. 2023, 2023
Wydawca: The Eurographics Association
DOI: 10.2312/vmv.20231237

Demonstration of Viewport-Aware Hybrid Broadcast-Unicast Streaming for Volumetric Video

Autorzy: Casper Haems, Matthias De Fré, Tim Wauters, Filip De Turck
Opublikowane w: 2025 16th International Conference on Network of the Future (NoF), 2025
Wydawca: IEEE
DOI: 10.1109/NOF66640.2025.11223293

Enabling Haptic-Integrated Interactive Holographic Video Streaming Powered by 5G Edge Computing

Autorzy: Peng Qian, Ning Wang, Carl Udora, Carlos Velez Redondo, JingXuan Men, Rahim Tafazolli
Opublikowane w: 2025 IEEE International Conference on Multimedia and Expo (ICME), 2025
Wydawca: IEEE
DOI: 10.1109/ICME59968.2025.11209485

Impact of Quality and Distance on the Perception of Point Clouds in Mixed Reality

Autorzy: Nguyen, Minh; Vats, Shivi; Van Damme, Sam; van der Hooft, Jeroen; Torres Vega, Maria; Wauters, Tim; Timmerer, Christian; Hellwagner, Hermann
Opublikowane w: 15th International Conference on Quality of Multimedia Experience (QoMEX), 2023, ISBN 979-8-3503-1173-0
Wydawca: IEEE
DOI: 10.1109/qomex58391.2023.10178491

User-Intent Aware Transport-Layer Intelligence for Frame Synchronisation in Multi-Party XR Application

Autorzy: Vu San Ha Huynh, Peng Qian, Ning Wang, Carl Udora, Rahim Tafazolli
Opublikowane w: 2024 IEEE Gaming, Entertainment, and Media Conference (GEM), 2024
Wydawca: IEEE
DOI: 10.1109/GEM61861.2024.10585795

Enabling User Intent-based Network Path Adaptation for Live Volumetric Streaming

Autorzy: Peng Qian, Ning Wang, Foh Chuan Heng, Carl Udora, Rahim Tafazolli
Opublikowane w: 2024 IFIP Networking Conference (IFIP Networking), Numer 23.7, 2024
Wydawca: IEEE
DOI: 10.23919/IFIPNetworking62109.2024.10619068

Immersive and Interactive Subjective Quality Assessment of Dynamic Volumetric Meshes

Autorzy: Van Damme, Sam; Mahdi, Imen; Ravuri, Hemanth Kumar; van der Hooft, Jeroen; De Turck, Filip; Torres Vega, Maria
Opublikowane w: 15th International Conference on Quality of Multimedia Experience (QoMEX), 2023, ISBN 979-8-3503-1173-0
Wydawca: IEEE
DOI: 10.1109/qomex58391.2023.10178610

Towards Efficient Transport for Real-Time Immersive Applications over Hybrid Networks

Autorzy: Casper Haems; Matthias De Fré; Tim Wauters; Filip De Turck
Opublikowane w: 2025 16th International Conference on Network of the Future (NoF), 2025, ISSN 2833-0072
Wydawca: IEEE

No-Reference Quality of Experience Model for Dynamic Point Clouds in Augmented Reality

Autorzy: Minh Nguyen, Shivi Vats, Hermann Hellwagner
Opublikowane w: Proceedings of the 3rd Mile-High Video Conference on zzz, 2024, ISBN 979-8-4007-0493-2
Wydawca: ACM
DOI: 10.1145/3638036.3640248

Scalable MDC-Based Volumetric Video Delivery for Real-Time One-to-Many WebRTC Conferencing

Autorzy: Matthias De Fré, Jeroen van der Hooft, Tim Wauters, Filip De Turck
Opublikowane w: Proceedings of the ACM Multimedia Systems Conference 2024 on ZZZ, Numer 2, 2024
Wydawca: ACM
DOI: 10.1145/3625468.3647617

GreenWise: Intelligent Application Migration for Containerized Machine Learning Services in the Computing Continuum

Autorzy: Peini Liu, José Santos, Filip De Turck, Jordi Guitart
Opublikowane w: Proceedings of the 18th IEEE/ACM International Conference on Utility and Cloud Computing, 2025
Wydawca: ACM
DOI: 10.1145/3773274.3774275

Demonstrating Adaptive Many-to-Many Immersive Teleconferencing for Volumetric Video

Autorzy: Matthias De Fré, Jeroen van der Hooft, Tim Wauters, Filip De Turck
Opublikowane w: Proceedings of the ACM Multimedia Systems Conference 2024 on ZZZ, Numer 2, 2024
Wydawca: ACM
DOI: 10.1145/3625468.3652192

A Platform for Subjective Quality Assessment in Mixed Reality Environments

Autorzy: Vats, Shivi; Nguyen, Minh; Van Damme, Sam; van der Hooft, Jeroen; Torres Vega, Maria; Wauters, Tim; Timmerer, Christian; Hellwagner, Hermann
Opublikowane w: 15th International Conference on Quality of Multimedia Experience (QoMEX) - Towards Sustainable and Inclusive Multimedia Experiences, 2023, ISSN 2372-7179
Wydawca: IEEE
DOI: 10.1109/qomex58391.2023.10178443

Peer reviewed articles (6)

IEEE Transactions on Visualization and Computer Graphics

Autorzy: Morgenstern, Wieland; Bagdasarian, Milena T.; Hilsmann, Anna; Eisert, Peter
Opublikowane w: IEEE Transactions on Visualization and Computer Graphics, Numer Volume 30, Numer 5, 2024, ISSN 1077-2626
Wydawca: Institute of Electrical and Electronics Engineers
DOI: 10.48550/arxiv.2310.03615

Scalable MDC-Based WebRTC Streaming for One-to-Many Volumetric Video Conferencing

Autorzy: Matthias De Fré, Jeroen van der Hooft, Tim Wauters, Filip De Turck
Opublikowane w: ACM Transactions on Multimedia Computing, Communications, and Applications, 2025, ISSN 1551-6857
Wydawca: Association for Computing Machinery (ACM)
DOI: 10.1145/3768314

Characterization of the Quality of Experience and Immersion of Point Cloud Videos in Augmented Reality Through a Subjective Study

Autorzy: Minh Nguyen, Shivi Vats, Sam Van Damme, Jeroen Van Der Hooft, Maria Torres Vega, Tim Wauters, Filip de Turck, Christian Timmerer, and Hermann Hellwagner
Opublikowane w: IEEE Access, Numer vol. 11, 2023, 2023, ISSN 2169-3536
Wydawca: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/ACCESS.2023.3326374

Animatable Virtual Humans: Learning Pose-Dependent Human Representations in UV Space for Interactive Performance Synthesis

Autorzy: Wieland Morgenstern, Milena T. Bagdasarian, Anna Hilsmann, Peter Eisert
Opublikowane w: IEEE Transactions on Visualization and Computer Graphics, Numer 30, 2024, ISSN 1077-2626
Wydawca: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/TVCG.2024.3372117

A Multidimensional Media Adaptation Framework for Live Holographic Communication

Autorzy: Carl Udora, Peng Qian, Jingxuan Men, Ning Wang
Opublikowane w: IEEE Transactions on Multimedia, Numer 28, 2026, ISSN 1520-9210
Wydawca: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/TMM.2025.3623505

Eye-Tracking, Quality Assessment, and QoE Prediction Models for Point Cloud Videos: Extended Analysis of the ComPEQ-MR Dataset

Autorzy: Shivi Vats, Minh Nguyen, Christian Timmerer, Hermann Hellwagner
Opublikowane w: IEEE Access, Numer 13, 2025, ISSN 2169-3536
Wydawca: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/ACCESS.2025.3635789