Mixed Augmented and eXtended Reality media pipeline

Projektinformationen

MAX-R

ID Finanzhilfevereinbarung: 101070072

DOI

10.3030/101070072

Projekt abgeschlossen

EK-Unterschriftsdatum 20 Juni 2022

Startdatum 1 September 2022

Enddatum 28 Februar 2025

Finanziert unter

• Digital, Industry and Space

Gesamtkosten

€ 7 468 158,75

EU-Beitrag

€ 6 176 036,00

Koordiniert durch

UNIVERSIDAD POMPEU FABRA
Spain

CORDIS bietet Links zu öffentlichen Ergebnissen und Veröffentlichungen von HORIZONT-Projekten.

Links zu Ergebnissen und Veröffentlichungen von RP7-Projekten sowie Links zu einigen Typen spezifischer Ergebnisse wie Datensätzen und Software werden dynamisch von OpenAIRE abgerufen.

Leistungen

Documents, reports (27)

Final Integration Report

D4.4 Final Integration Report (R, PU, M30) describing the final MAX-R pipeline, new created workflows, developed APIs, plugins, Data Hubs, and tools

Final Validation Report

D4.5 Final Validation Report (R, PU, M30) describing the validation, field trials and performance tests of the MAX-R components and integrated tools

Data pipelines, Interoperability, APIs and Cloudmigration

D3.4 Data Pipelines, Interoperability APIs and Cloud-migration (R, PU, M24). Final report on the developed data pipelines and interoperability APIs

Operational Framework for Networking, Rendering and Audio in MILES

D3.6 Operational Framework for Networking, Rendering and Audio in MILES (R, PU, M24) running on a cloud deployment platform, and with support from IMP’s managed services team.

MAX-R architecture, requirements, specifications and standards

D2.1 MAX-R Architecture, Requirements, Specifications and Standards (R, PU, M6) detailing the pipeline architecture, requirements and specifications, open standards, data manifests, data exchange and assets

Data Management in the XR Pipeline

D2.7 Data Management in the XR Pipeline (R, PU, M24) Final report on the integrated pipeline with its APIs, Data Vaults and Hubs

Final Evaluation Report

D5.6 Final Evaluation Report (R, PU, 30) on the evaluation of the MAX-R pipeline operation (workflows, APIs, data hubs, data pipelines, and others), tools and user responses to demonstrated XR media experiences

Plan for Dissemination, Communication and Exploitation v2

D6.3 Plan for Dissemination, Communication and Exploitation v2 (R, PU, 18) Report on exploitation and dissemination activities in the previous period and an update of the plan for future exploitation, dissemination and use of knowledge

Tools for XR Media Data Creation in Live Events

D3.5 Toolset for XR Media Data Creation in Live Events (R, PU, M24). Final report on the different tools developed to support mixed virtual events

Data Exchange Protocols for XR Production and Distribution

D2.8 Data Exchange Protocols for XR Production and Distribution (R, PU, M24) Streaming protocols, network configurations, interfaces, protocols and technologies for interactive real-time data distribution

Third Party Testing Plans & Case Studies

D4.3 Third Party Testing Plans & Case Studies (R, PU, M24) will describe the case studies and plans.

Evaluation Plan

D5.1 Evaluation Plan (R, PU, 12) Report on how the partners plan to evaluate and test the MAX-R pipeline operation (workflows, APIs, data hubs, data pipelines, and others) and developed tools.

Open APIs and Data Manifests for XR production pipelines and tools

D2.3 Open APIs and Data Manifests for XR Production Pipelines and Tools (R, PU, M12) Specification and description of Open APIs and Data Manifests.

Tools for Real Time Compositing and Rendering

D3.2 Toolset for Real Time Compositing and Rendering (R, PU, M18), will describe the tools, APIs and ML algorithms developed to support real time compositing and rendering in the cloud.

Project Handbook and Quality Plan

D1.1 Project Handbook and Quality Plan (R, SEN, M3) contains general operational information, contact details, reporting processes, communication protocols, document templates and numbering methods, logos et cetera. Quality plan elements include technical quality control, risk logs and the procedures for risk monitoring, procedures for Deliverables planning and schedule, and peer reviews.

Interim Evaluation report

D5.2 Interim Evaluation report (R, PU, 24) presenting the interim results based on demonstrations.

Interim Integration Report

D4.1 Interim Integration Report (R, PU, M18) will show the progress on the integration of WP2 and WP3 outcomes in the MAX-R pipeline and establish a firm basis for the integration and evaluation activities

Final Dissemination Report

D6.5 Final Dissemination Report (R, PU, M30) Final report on dissemination and communication activities

Towards integrated all-IP MR production

D2.5 Towards Integrated all-IP XR Production (R, PU, M12) Architecture and network components to support real-time on-set, distributed and cloud-based MR production pipelines

Final Exploitation Plan

D6.6 Final Exploitation Plan (R, PU, M30) Plan for the future dissemination and exploitation of results with sector-by-sector market review, competitor analysis, SWOT, business plans for products and services and routes to market.

Plan for Dissemination, Communication and Exploitation

D6.2 Plan for Dissemination, Communication and Exploitation (R, PU, M3) Report on dissemination activities for Years 1-3 and plans for further dissemination of results, with links to the white papers, web resources and academic publications produced during the project.

Report on Scenario use-cases using Pipelines for Virtual and XR production

D2.2 Report on Scenario Use-cases for Demonstration and Evaluation (R, PU, M6) A document and diagrams to show the use cases planned, and the use of pipelines to enable multiple outputs

Toolset for Colour Management in XR Production

D3.3 Toolset for Colour Management in XR Production (R, PU, M18), will report the final developments introduced in Metagrade, as well as its integration in the MAX-R pipeline

Best Practice Guidelines and Recommendations for XR Specifications

D6.4 Best Practice Guidelines and Recommendations for XR Specifications (R, PU, M30)

Interim report on Tools and Data Pipelines for XR Media

D3.1. Interim Report on Tools and Data Pipelines for XR Media (R, PU, M12) will show the specifications and initial results in the different tools and data pipelines for creation, processing and distribution

Feedback from Professional Test Productions, and Case Studies

D4.6 Feedback from Professional Test Productions, and Case Studies (R, PU, M30) Final report on the feedback and evaluation from external professionals in the different case-studies

In-house Validation and Performance Tests

D4.2 In-house Validation and Performance Tests (R, PU, M24) will show the initial progress on in-house validation and performance tests of the pipeline components and integrated tools.

Data sets, microdata, etc (1)

XR Media Data for Demonstrations

D5.3. XR Media Data for Demonstrations (DATA, PU, 24) a body of media data objects created to be used in the different demonstration events, with an inventory accessible via the MAX-R website

Other (1)

Data Hubs

D2.6 Data Hubs (OTHER, PU, M24) Open-source Software associated with XRDataHub, AnimHost, and XR enabling of browser-based tools.

Data Management Plan (1)

Data Management Plan

D1.2 Data Management Plan (DMP, PU, M6) lays out the data strategy for the project, the implementation measures, updates, responsibilities and reporting, in line with B1.2.6

Websites, patent fillings, videos etc. (3)

Final MAX-R Demonstration and Showreel

D5.5 Final MAX-R Demonstration and Showreel (DEC, PU, M30) Final Demonstration at a major event and showreel of demonstration activities performed and results obtained

Project Website and social media channels

D6.1 Project Website and social media channels (DEC, PU, M2) with public deliverables and information, links to demonstration materials and data repositories, regular and frequent posts replicated in social media.

XR Media Production Demonstration Showreel

D5.4 XR Media Production Demonstration Showreel (DEC, PU, M24) First set of ‘how to’ demos

Demonstrators, pilots, prototypes (1)

Data Vault, OpenAssetIO and Data Manifest for XR tools

D2.4 Data Vault, OpenAssetIO and Data Manifest for XR Tools (DEM, PU, M12) Demonstration of the functionalities of the Data Vault, OpenAssetIO and Data Manifest

Veröffentlichungen

Conference proceedings (9)

HTTP/3's Extensible Prioritization Scheme in the Wild

Autoren: Joris Herbots; Robin Marx; Maarten Wijnants; Peter Quax; Wim Lamotte
Veröffentlicht in: Proceedings of the Applied Networking Research Workshop on zzz, 2024
Herausgeber: Association for Computing Machinery (ACM)
DOI: 10.1145/3673422.3674887

Cross that boundary: Investigating the feasibility of cross-layer information sharing for enhancing ABR decision logic over QUIC

Autoren: Joris Herbots; Arno Verstraete; Maarten Wijnants; Peter Quax; Wim Lamotte
Veröffentlicht in: Proceedings of the 33rd Workshop on Network and Operating System Support for Digital Audio and Video, 2023, ISSN 1551-3688
Herausgeber: Association for Computing Machinery
DOI: 10.1145/3592473.3592563

Vegvisir: A testing framework for HTTP/3 media streaming

Autoren: Joris Herbots; Mike Vandersanden; Peter Quax; Wim Lamotte
Veröffentlicht in: Proceedings of the 14th ACM Multimedia Systems Conference, 2023
Herausgeber: Association for Computing Machinery (ACM)
DOI: 10.1145/3587819.3592550

Performance Evaluation of MLO for XR Streaming: Can Wi-Fi 7 Meet the Expectations?

Autoren: Marc Carrascosa-Zamacois, Lorenzo Galati-Giordano, Francesc Wilhelmi, Gianluca Fontanesi, Anders Jonsson, Giovanni Geraci, Boris Bellalta
Veröffentlicht in: 2024 IEEE 29th International Workshop on Computer Aided Modeling and Design of Communication Links and Networks (CAMAD), 2025
Herausgeber: IEEE
DOI: 10.1109/CAMAD62243.2024.10943088

Is Wi-Fi 6 Ready for Virtual Reality Mayhem? A Case Study Using One AP and Three HMDs

Autoren: Michaelides, C., Casasnovas, M., Marchitelli, D., & Bellalta, B.
Veröffentlicht in: IEEE Future Networks 2023, 2023
Herausgeber: IEEE
DOI: 10.36227/techrxiv.24230728.v1

Experimenting with Adaptive Bitrate Algorithms for Virtual Reality Streaming over Wi-Fi

Autoren: Ferran Maura, Miguel Casasnovas, Boris Bellalta
Veröffentlicht in: Proceedings of the 30th Annual International Conference on Mobile Computing and Networking, 2025
Herausgeber: ACM
DOI: 10.1145/3636534.3697322

Responsive and Timely Virtual Reality Gaming: Which Frame Rate Should One Choose?

Autoren: Costas Michaelides, Boris Bellalta
Veröffentlicht in: 2024 IEEE Conference on Games (CoG), 2024
Herausgeber: IEEE
DOI: 10.1109/COG60054.2024.10645558

Large-Area Spatially Aligned Anchors

Autoren: Joni Vanherck, Brent Zoomers, Lode Jorissen, Isjtar Vandebroeck, Eric Joris, Nick Michiels
Veröffentlicht in: Lecture Notes in Computer Science, Extended Reality, 2024
Herausgeber: Springer Nature Switzerland
DOI: 10.1007/978-3-031-71707-9_3

PRoGS: Progressive Rendering of Gaussian Splats

Autoren: Zoomers, Brent; Wijnants, Maarten; Molenaers, Ivan; Vanherck, Joni; Put, Jeroen; Jorissen, Lode; Michiels, Nick
Veröffentlicht in: 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2025
Herausgeber: IEEE
DOI: 10.48550/ARXIV.2409.01761

Peer reviewed articles (4)

Lessons Learned From a Large-Scale Virtual Reality Experience Over Wi-Fi

Autoren: Costas Michaelides, Miguel Casasnovas, David Nunez, Boris Bellalta
Veröffentlicht in: IEEE Transactions on Networking, 2025, ISSN 2998-4157
Herausgeber: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/TON.2025.3582033

Tracking and Co-Location of Global Point Clouds for Large-Area Indoor Environments

Autoren: MICHIELS, Nick; JORISSEN, Lode; PUT, Jeroen; LIESENBORGS, Jori; Vandebroeck, Isjtar; Joris , Eric; VAN REETH, Frank
Veröffentlicht in: Virtual Reality, 2023, ISSN 1434-9957
Herausgeber: Springer Science + Business Media
DOI: 10.1007/S10055-024-01004-0

Projector-camera calibration with non-overlapping fields of view using a planar mirror

Autoren: VANHERCK, Joni; JORISSEN, Lode; ZOOMERS, Brent; MICHIELS, Nick
Veröffentlicht in: Virtual Reality, 2024, ISSN 1434-9957
Herausgeber: Springer Science+Business Media
DOI: 10.21203/RS.3.RS-4605720/V1

Experimental evaluation of interactive Edge/Cloud Virtual Reality gaming over Wi-Fi using unity render streaming

Autoren: Miguel Casasnovas, Costas Michaelides, Marc Carrascosa-Zamacois, Boris Bellalta
Veröffentlicht in: Computer Communications, Ausgabe 226-227, 2024, ISSN 0140-3664
Herausgeber: Elsevier BV
DOI: 10.1016/J.COMCOM.2024.08.001