Ignite the Immersive Media Sector by Enabling New Narrative Visions

Informazioni relative al progetto

TransMIXR

ID dell’accordo di sovvenzione: 101070109

DOI

10.3030/101070109

Progetto chiuso

Data della firma CE 21 Giugno 2022

Data di avvio 1 Ottobre 2022

Data di completamento 31 Dicembre 2025

Finanziato da

• Digital, Industry and Space

Costo totale

€ 10 087 267,49

Contributo UE

€ 8 997 632,25

Coordinato da

Technological University of the Shannon: Midlands Midwest
Ireland

CORDIS fornisce collegamenti ai risultati finali pubblici e alle pubblicazioni dei progetti ORIZZONTE.

I link ai risultati e alle pubblicazioni dei progetti del 7° PQ, così come i link ad alcuni tipi di risultati specifici come dataset e software, sono recuperati dinamicamente da .OpenAIRE .

Risultati finali

Documents, reports (7)

Technical and Innovation Coordination and Quality Assurance

This will define the project plan from the technical and innovation perspective in addition to appropriate Quality Assurance (see Section 1.2.6) processes and Risk Management to be put in place. It will define the roles, responsibilities and operating procedures (incl. measures to ensure gender equality and diversity).

Specifications of Alpha and Beta versions of the environment

Technical report (living) with initial version in M5 (as per the gantt chart) outlining the design and technology configuration underlying the rendering engine of the TransMIXR project inclusive of interaction, user experience capture framework

Initial media ingestion understanding and summarisation components

This deliverable reports on the first prototypes of the media ingestion, understanding and summarisation components (T2.1-3)

Media content metrics and visual analytics dashboards

This deliverable reports on the first prototypes of the media content metrics and visual analytics dashboard.

Communication and Dissemination Plan

Plans for project communication incl. design and setup of the website, social media channels and the creation of the project’s first promotional materials (presentation and communication kit; publicly available via the website).

Interim Dissemination and Engagement Report

Quantitative and qualitative report on planned and completed D.E.C. dissemination and stakeholder engagement activities, success measures against the stated goals and recommended refinements of the original plans.

UCD methodology and planning

Description of the UCD methodology. Provides details on: planning of iterative user research phases, piloting activities. success factors, risks and mitigation strategies.

Pubblicazioni

Conference proceedings (42)

LMM-Regularized CLIP Embeddings for Image Classification

Autori: Tzelepi, M., & Mezaris, V.
Editore: Zenodo
DOI: 10.48550/ARXIV.2412.11663

A Platform for Collecting User Behaviour Data during Social VR Experiments Using Mozilla Hubs

Autori: Thomas Röggla, David A. Shamma, Julie R. Williamson, Irene Viola, Silvia Rossi, Pablo Cesar
Pubblicato in: Proceedings of the 16th International Workshop on Immersive Mixed and Virtual Environment Systems, 2025
Editore: ACM
DOI: 10.1145/3652212.3652225

Integrating Head Mounted Displays into Live Broadcasting Workflows: Implications and Possibilities from an Industry Perspective

Autori: Bryan Dunphy, Gareth W. Young, Grace Dinan, Niall Murray
Pubblicato in: IMXw '24: Proceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops
Editore: ACM

Exploiting LMM-based knowledge for image classification tasks

Autori: M. Tzelepi, V. Mezaris
Pubblicato in: Proc. 25th Int. Conf. on Engineering Applications of Neural Networks (EANN/EAAAI 2024)
Editore: Springer
DOI: 10.48550/ARXIV.2406.03071

Online Anchor-based Training for Image Classification Tasks

Autori: M. Tzelepi, V. Mezaris
Editore: IEEE
DOI: 10.1109/ICIP51287.2024.10648148

Ethical Considerations in the Production and Consumption of Music in the Metaverse

Autori: Gareth W. Young
Pubblicato in: 2024 IEEE 5th International Symposium on the Internet of Sounds (IS2), 2024
Editore: IEEE
DOI: 10.1109/IS262782.2024.10704197

TSalV360: A Method and Dataset for Text-driven Saliency Detection in 360-Degrees Videos

Autori: Kontostathis, I., Apostolidis, E., & Mezaris, V.
Editore: Zenodo
DOI: 10.5281/ZENODO.17649129

Video Shot Discovery Through Text2Video Embeddings in a News Analytics Dashboard

Autori: Lyndon Nixon, Damianos Galanopoulos, Vasileios Mezaris, Alexander Hubmann-Haidvogel, Daniel Fischl, Arno Scharl
Pubblicato in: 2024 International Conference on Content-Based Multimedia Indexing (CBMI), 2025
Editore: IEEE
DOI: 10.1109/CBMI62980.2024.10859251

Emerging Telepresence Technologies for Hybrid Meetings: Experiences and Lessons Learned from an Interactive Workshop

Autori: Marta Orduna, Ester Gonzalez-Sosa, Andriana Boudouraki, Houda Elmimouni, Pablo Perez, Jesus Gutierrez, Veronica Ahumada-Newhart, Pablo Cesar
Pubblicato in: Proceedings of the 17th International Workshop on IMmersive Mixed and Virtual Environment Systems, 2025
Editore: ACM
DOI: 10.1145/3712677.3720464

Open-Sourcing VR2Gather: A Collaborative Social VR System for Adaptive Multi-Party Real Time Communication

Autori: Jack Jansen, Thomas Röggla, Silvia Rossi, Irene Viola, Pablo Cesar
Pubblicato in: Proceedings of the 32nd ACM International Conference on Multimedia, 2025
Editore: ACM
DOI: 10.1145/3664647.3685515

Gaussian Splatting vs. Classical Photogrammetry: A Comparison for Virtual Backdrops

Autori: Philipp Haslbauer, Mike Pullen, Carolin Reichherzer, Aljosa Smolic
Pubblicato in: 2025 17th International Conference on Quality of Multimedia Experience (QoMEX), 2025
Editore: IEEE
DOI: 10.1109/QOMEX65720.2025.11219987

Prototype Anchoring for Image Classification Tasks

Autori: Maria Tzelepi, Vasileios Mezaris
Pubblicato in: 2024 32nd European Signal Processing Conference (EUSIPCO), 2024
Editore: IEEE
DOI: 10.23919/EUSIPCO63174.2024.10715272

VERGE in VBS 2026

Autori: Pantelidis, N., Kosmidou, E., Galanopoulos, D., Georgalis, D., Stefanos, P., Apostolidis, K., Goulas, A., Pegia, M., Tsionkis, G., Gkountakos, K., Kouvrakis, G., Moumtzidou, A., Gialampoukidis, I., Vrochidis, S., Mezaris, V., & Kompatsiaris, I.
Editore: Zenodo
DOI: 10.5281/ZENODO.18268841

Directed Views in Virtual Reality: A Semantic Approach to Volumetric Video Storytelling

Autori: Colm O Fearghail, Nivesh Gadipudi, Gareth W. Young, John Dingliana
Pubblicato in: ACM Symposium on Applied Perception 2024, 2025
Editore: ACM
DOI: 10.1145/3675231.3678872

Spatial Media Controller: Exploring the Potential of Augmented Reality, Virtual Reality, Volumetric Capture and 360 Videos for News Broadcasting

Autori: Charles Bailly, Lucas Pometti, Joseph Fadel, Juliette Vauchez, Julien Castet
Pubblicato in: Proceedings of the 2025 ACM International Conference on Interactive Media Experiences, 2025
Editore: ACM
DOI: 10.1145/3706370.3727868

Communication Challenges between Clients and Producers of Immersive Media Applications: can Social XR help?

Autori: Sueyoon Lee, Irene Viola, Ashutosh Singla, Pablo Cesar
Pubblicato in: ACM International Conference on Interactive Media Experiences, 2025
Editore: ACM
DOI: 10.1145/3639701.3656307

IXR '25: 3rd International Workshop on Interactive eXtended Reality

Autori: Viola, I., Rossi, S., Orduna, M., & Torres Vega, M
Pubblicato in: ACM International Conference on Multimedia
Editore: ACM
DOI: 10.1145/3746027.3762385

From Individual QoE to Shared Mental Models: A Novel Evaluation Paradigm for Collaborative XR

Autori: Sam Van Damme, Jack Jansen, Silvia Rossi, Pablo Cesar
Pubblicato in: 2025 17th International Conference on Quality of Multimedia Experience (QoMEX), 2025
Editore: IEEE
DOI: 10.1109/QOMEX65720.2025.11219992

Visual-Saliency Guided Multi-modal Learning for No Reference Point Cloud Quality Assessment

Autori: Xuemei Zhou, Irene Viola, Ruihong Yin, Pablo Cesar
Pubblicato in: Proceedings of the 3rd Workshop on Quality of Experience in Visual Multimedia Applications, 2025
Editore: ACM
DOI: 10.1145/3689093.3689183

Exploring entropy-based solutions for trajectory prediction in virtual reality

Autori: Pradhan, V., Rossi, S., & Cesar, P.
Pubblicato in: E
Editore: Zenodo
DOI: 10.1145/3712677.3720460

Finding Video Shots for Immersive Journalism Through Text-to-Video Search

Autori: Lyndon Nixon, Damianos Galanopoulos, Vasileios Mezaris
Pubblicato in: 2024 International Conference on Content-Based Multimedia Indexing (CBMI), 2025
Editore: IEEE
DOI: 10.1109/CBMI62980.2024.10859220

An Experimental Study on Generating Plausible Textual Explanations for Video Summarization

Autori: Eleftheriadis, T., Apostolidis, E., & Mezaris, V.
Editore: IEEE
DOI: 10.5281/ZENODO.17650009

Back to the Virtual Future: Presence in Cinematic Virtual Reality

Autori: Colm O Fearghail, Nivesh Gadipudi, Gareth William Young
Pubblicato in: Proceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops, 2025
Editore: ACM
DOI: 10.1145/3672406.3672418

Voices Unveiled: Quality of Experience in Collaborative VR via AssemblyAI and NASA-TLX Analysis

Autori: Moharana, B., Keighrey, C., & Murray, N.
Editore: Zenodo
DOI: 10.5281/ZENODO.13343703

Exploring engagement dynamics between journalists and news consumers in Social XR

Autori: Arno Verhofstadt, Iris Jennes, Wendy Van den Broeck, Natasja Van Buggenhout, Marie Hospital, Delphine Ramond, Alexandre Grosbois, Matej Praprotnik, Sabrina Povsic Stimec, Kaella Kolle
Pubblicato in: Proceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops, 2025
Editore: ACM
DOI: 10.1145/3672406.3672420

Enhancing User Control in AI-Based Video Summarization for Social Media

Autori: Ioannis Kontostathis, Evlampios Apostolidis, Konstantinos Apostolidis, Vasileios Mezaris
Pubblicato in: Lecture Notes in Computer Science, MultiMedia Modeling, 2024
Editore: Springer Nature Singapore
DOI: 10.1007/978-981-96-2074-6_12

MLLM Frame Subset Ensembling for Audio-Visual Video QA and MLLM-based Reranking for Ad-hoc Video Search in TRECVID 2025

Autori: Goulas, A., Galanopoulos, D., Patras, I., & Mezaris, V.
Editore: Zenodo
DOI: 10.5281/ZENODO.18346563

A Human-Annotated Video Dataset for Training and Evaluation of 360-Degree Video Summarization Methods

Autori: Ioannis Kontostathis, Evlampios Apostolidis, Vasileios Mezaris
Pubblicato in: Proceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops, 2025
Editore: ACM
DOI: 10.1145/3672406.3672417

VR Planica: Gaussian Splatting Workflows for Immersive Storytelling

Autori: Philipp Haslbauer, Mike Pullen, Matej Praprotnik, Sabrina Povsic Stimec, Marie Hospital, Alexandre Grosbois, Carolin Reichherzer, Aljosa Smolic
Pubblicato in: Proceedings of the ACM International Conference on Interactive Media Experiences Workshops (ACM IMXw 2025), 2025
Editore: Sociedade Brasileira de Computação
DOI: 10.5753/IMXW.2025.8141

Exploring user feedback in VR: the added value of qualitative evaluation methods

Autori: Arno, V., Hallström, L., Van den Broeck, W., Reichherzer, C., & Smolic, A.
Editore: Zenodo
DOI: 10.5753/IMXW.2025.4030

VidCtx: Context-aware Video Question Answering with Image Models

Autori: Goulas, A., Mezaris, V., & Patras, I.
Editore: IEEE
DOI: 10.5281/ZENODO.17198741

Social Density and its Impact on Behaviour in Virtual Environments

Autori: Julie Williamson, Silvia Rossi, Ross Johnstone, Irene Viola, John Williamson, Thomas Röggla, David A. Shamma, Pablo Cesar
Pubblicato in: Proceedings of the 3rd International Workshop on Interactive eXtended Reality, 2025
Editore: ACM
DOI: 10.1145/3746269.3760421

An LLM Framework for Long-Form Video Retrieval and Audio-Visual Question Answering Using Qwen2/2.5

Autori: Damianos Galanopoulos, Andreas Goulas, Antonios Leventakis, Ioannis Patras, Vasileios Mezaris
Pubblicato in: 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2025
Editore: IEEE
DOI: 10.1109/CVPRW67362.2025.00358

Exploring the impact of volumetric graphics on the engagement of broadcast media professionals

Autori: Dinan, Grace; Young, Gareth William; Smolic, Aljosa; Jan, Ondřej; Pagés, Rafael
Pubblicato in: Multimedia Systems, 2024
Editore: Zenodo
DOI: 10.21203/RS.3.RS-3994643/V1

Tangible Authoring of Embedded-Object Visualizations in Mixed Reality

Autori: Xuyu Li, John Dingliana
Pubblicato in: Proceedings of the 17th International Symposium on Visual Information Communication and Interaction, 2025
Editore: ACM
DOI: 10.1145/3678698.3687187

Disturbing Image Detection Using LMM-Elicited Emotion Embeddings

Autori: M. Tzelepi, V. Mezaris
Editore: Arxiv
DOI: 10.48550/ARXIV.2406.12668

VVGLTF: Efficient Streaming of Volumetric Video with GLTF

Autori: Lam, K. Y., Croci, S., Haslbauer, P., & Smolic, A.
Editore: IBC
DOI: 10.5281/ZENODO.17651190

Auto-summarization of Human Volumetric Videos

Autori: Nivesh Gadipudi, Colm O. Fearghail, John Dingliana
Pubblicato in: Proceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops, 2025
Editore: ACM
DOI: 10.1145/3672406.3672416

A Volumetric Video Application to Enhance Museum Experiences

Autori: Nguyen, T. A. N., Lässig, J., Kälin, A. F., Huwiler, A., Haslbauer, P., Young, G. W., Lam, K. Y., & Smolic, A.
Editore: Zenodo
DOI: 10.1145/3641825.3689695

UVG-CWI-DQPC: Dual-Quality Point Cloud Dataset for Volumetric Video Applications

Autori: Guillaume Gautier, Xuemei Zhou, Thong Nguyen, Jack Jansen, Louis Fréneau, Marko Viitanen, Uyen Phan, Jani Käpylä, Irene Viola, Alexandre Mercat, Pablo Cesar, Jarno Vanne
Pubblicato in: Proceedings of the 33rd ACM International Conference on Multimedia, 2025
Editore: ACM
DOI: 10.1145/3746027.3758263

QoE Evaluation of Remote Physiotherapy in Volumetric Video and Video-Based Real-Time Communication

Autori: Ashutosh Singla, Irene Viola, Jack Jansen, Pablo Cesar
Pubblicato in: 2025 IEEE International Conference on Multimedia and Expo (ICME), 2025
Editore: IEEE
DOI: 10.1109/ICME59968.2025.11209852

Enhancing Immersive Experiences through 3D Point Cloud Analysis: A Novel Framework for Applying 2D Visual Saliency Models to 3D Point Clouds

Autori: Marouane Tliba, Xuemei Zhou, Irene Viola, Pablo Cesar, Aladine Chetouani, Giuseppe Valenzise, Frederic Dufaux
Pubblicato in: 2024 16th International Conference on Quality of Multimedia Experience (QoMEX), 2024
Editore: IEEE
DOI: 10.1109/QOMEX61742.2024.10598254

Peer reviewed articles (11)

Designing the Space Archivists: A Metadata-Driven VR Game Concept for Children to Engage with Cultural Heritage

Autori: Alina Goldman; Rasa Bocyte; Elana B. Blinder; Arno Verhofstadt; Elizabeth Bonsignore; Pablo Cesar
Pubblicato in: Heritage, 2025, ISSN 2571-9408
Editore: MDPI
DOI: 10.3390/HERITAGE8070238

Subjective and Objective Quality Assessment for Dynamic Point Cloud with Visual Attention in 6 DoF

Autori: Zhou, X., Viola, I., Alexiou, E., Jansen, J., & Cesar, P. (
Pubblicato in: ACM Transactions on Multimedia Computing, Communications, and Applications, ISSN 2168-4081
Editore: ACM
DOI: 10.1145/3731759

Cognitive Representations and Personal Experiences of COVID-19 Using Social Virtual Reality

Autori: Gareth W. Young, Néill O'Dwyer, Aljosa Smolic
Pubblicato in: PRESENCE: Virtual and Augmented Reality, Numero 33, 2024, ISSN 1531-3263
Editore: MIT Press
DOI: 10.1162/PRES_A_00429

PointPCA+: A full-reference Point Cloud Quality Assessment metric with PCA-based features

Autori: Xuemei Zhou, Evangelos Alexiou, Irene Viola, Pablo Cesar
Pubblicato in: Signal Processing: Image Communication, Numero 135, 2025, ISSN 0923-5965
Editore: Elsevier BV
DOI: 10.1016/J.IMAGE.2025.117262

Comparison of Visual Saliency for Dynamic Point Clouds: Task-free vs. Task-dependent

Autori: Xuemei Zhou, Irene Viola, Silvia Rossi, Pablo Cesar
Pubblicato in: IEEE Transactions on Visualization and Computer Graphics, Numero 31, 2025, ISSN 1077-2626
Editore: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/TVCG.2025.3549863

ACM Transactions on Multimedia Computing, Communications and Applications

Autori: Amit, H., Yuansong, Q., & Murray, N.
Pubblicato in: ACM Transactions on Multimedia Computing, Communications and Applications, ISSN 1551-6857
Editore: Association for Computing Machinary, Inc.
DOI: 10.5281/ZENODO.13343545

UVG-CWI-DQPC: Dual-Quality Point Cloud Dataset for Volumetric Video Applications

Autori: Guillaume Gautier; Xuemei Zhou; Thong Nguyen; Jack Jansen; Louis Fréneau; Marko Viitanen; Uyen Phan; Jani Käpylä; Irene Viola; Alexandre Mercat; Pablo Cesar; Jarno Vanne
Pubblicato in: Proceedings of the 33rd ACM International Conference on Multimedia, 2025, ISSN 2168-4081
Editore: ACM Digital
DOI: 10.1145/3746027.3758263

PointPCA: Point Cloud Objective Quality Assessment Using PCA-Based Descriptors

Autori: Evangelos Alexiou; Xuemei Zhou; Irene Viola; Pablo Cesar
Pubblicato in: EURASIP Journal on Image and Video Processing, 2024, ISSN 1687-5281
Editore: EURASIP Journal on Image and Video Processing
DOI: 10.1186/S13640-024-00626-3

VVGLTF: Efficient Streaming of Volumetric Video with GLTF

Autori: Kit Yung Lam, Simone Croci, Philipp Haslbauer, Aljosa Smolic
Pubblicato in: SMPTE Motion Imaging Journal, Numero 134, 2025, ISSN 1545-0279
Editore: Society of Motion Picture and Television Engineers (SMPTE)
DOI: 10.5594/JMI.2025/GLNG7938

Designing the Space Archivists: A Metadata-Driven VR Game Concept for Children to Engage with Cultural Heritage

Autori: Alina Goldman, Rasa Bocyte, Elana B. Blinder, Arno Verhofstadt, Elizabeth Bonsignore, Pablo Cesar
Pubblicato in: Heritage, Numero 8, 2025, ISSN 2571-9408
Editore: MDPI AG
DOI: 10.3390/HERITAGE8070238

Predicting Quality of Multimedia Experience Using Electrocardiogram and Respiration Signals

Autori: Sowmya Vijayakumar, Ronan Flynn, Peter Corcoran, Niall Murray
Pubblicato in: IEEE Access, Numero 13, 2025, ISSN 2169-3536
Editore: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/ACCESS.2024.3420103

Other (12)

RCQoEA-360VR: Real-time Continuous QoE Scores for HMD-based 360° VR Dataset

Autori: Sowmya Vijayakumar, Tong Xue, Abdallah El Ali, Irene Viola, Ronan Flynn, Peter Corcoran, Pablo Cesar, Niall Murray
Pubblicato in: Proceedings of the 33rd ACM International Conference on Multimedia, 2025
Editore: ACM
DOI: 10.1145/3746027.3758259

Avatar Customization, Personality, and the Perception of Work Group Inclusion in Immersive Virtual Reality

Autori: Lauren Buck; Gareth W. Young; Rachel McDonnell
Pubblicato in: Crossref, 2023
DOI: 10.1145/3584931.3606992

Gaussian Splatting vs. Classical Photogrammetry: 3D Models

Autori: Haslbauer, P., Pullen, M., Reichherzer, C., & Smolic, A
Editore: Zenodo
DOI: 10.5281/ZENODO.17143763

Feel the Music!—Audience Experiences of Audio–Tactile Feedback in a Novel Virtual Reality Volumetric Music Video

Autori: Gareth W. Young; Néill O’Dwyer; Mauricio Flores Vargas; Rachel Mc Donnell; Aljosa Smolic
Pubblicato in: Arts; Volume 12; Numero 4; Pages: 156, 2023
DOI: 10.3390/arts12040156

Gaussian Splatting vs. Classical Photogrammetry: Input Data

Autori: Haslbauer, P., Pullen, M., Reichherzer, C., & Smolic, A.
Editore: Zenodo
DOI: 10.5281/ZENODO.17185795

An Integrated System for Spatio-temporal Summarization of 360-Degrees Videos

Autori: Ioannis Kontostathis; Evlampios Apostolidis; Vasileios Mezaris
Pubblicato in: MultiMedia Modeling ISBN: 9783031533013, 2024

VR2Gather: A collaborative social VR system for adaptive multi-party real-time communication

Autori: Viola, Irene; Jansen, Jack; Subramanyam, Shishir; Reimat, Ignacio; César Garcia, Pablo Santiago
Pubblicato in: urn:issn:1070-986X, 2023

Physiological Synchrony: A Novel Approach to Evaluating User Quality of Experience in Collaborative Distributed Virtual Reality Environments

Autori: Moharana, Bhagyabati; Keighrey, Dr. Conor; Murray, Dr. Niall
Pubblicato in: 2023
DOI: 10.5281/zenodo.8224881

TSV360: A dataset for training and objective evaluation of text-driven 360-degrees video saliency detection methods

Autori: Kontostathis, I., Apostolidis, E., & Mezaris, V.
Editore: Zenodo
DOI: 10.5281/ZENODO.16991178

TangibleMRCreate: Intuitive Authoring of Mixed Reality Content

Autori: Dingliana, J., & Li, X.
Editore: Zenodo
DOI: 10.2312/EGVE.20231339

PointPCA+: Extending PointPCA Objective Quality Assessment Metric

Autori: Zhou, Xuemei; Alexiou, Evangelos; Viola, Irene; Cesar, Pablo
Pubblicato in: Crossref, 2023

A Case Study on Student Experiences of Social VR in a Remote STEM Classroom

Autori: Gareth W. Young; Néill C. O'Dwyer; Aljosa Smolic
Pubblicato in: Crossref, 2023