Ignite the Immersive Media Sector by Enabling New Narrative Visions

Informations projet

TransMIXR

N° de convention de subvention: 101070109

DOI

10.3030/101070109

Projet clôturé

Date de signature de la CE 21 Juin 2022

Date de début 1 Octobre 2022

Date de fin 31 Decembre 2025

Financé au titre de

• Digital, Industry and Space

Coût total

€ 10 087 267,49

Contribution de l’UE

€ 8 997 632,25

Coordonné par

Technological University of the Shannon: Midlands Midwest
Ireland

CORDIS fournit des liens vers les livrables publics et les publications des projets HORIZON.

Les liens vers les livrables et les publications des projets du 7e PC, ainsi que les liens vers certains types de résultats spécifiques tels que les jeux de données et les logiciels, sont récupérés dynamiquement sur OpenAIRE .

Livrables

Documents, reports (7)

Technical and Innovation Coordination and Quality Assurance

This will define the project plan from the technical and innovation perspective in addition to appropriate Quality Assurance (see Section 1.2.6) processes and Risk Management to be put in place. It will define the roles, responsibilities and operating procedures (incl. measures to ensure gender equality and diversity).

Specifications of Alpha and Beta versions of the environment

Technical report (living) with initial version in M5 (as per the gantt chart) outlining the design and technology configuration underlying the rendering engine of the TransMIXR project inclusive of interaction, user experience capture framework

Initial media ingestion understanding and summarisation components

This deliverable reports on the first prototypes of the media ingestion, understanding and summarisation components (T2.1-3)

Media content metrics and visual analytics dashboards

This deliverable reports on the first prototypes of the media content metrics and visual analytics dashboard.

Communication and Dissemination Plan

Plans for project communication incl. design and setup of the website, social media channels and the creation of the project’s first promotional materials (presentation and communication kit; publicly available via the website).

Interim Dissemination and Engagement Report

Quantitative and qualitative report on planned and completed D.E.C. dissemination and stakeholder engagement activities, success measures against the stated goals and recommended refinements of the original plans.

UCD methodology and planning

Description of the UCD methodology. Provides details on: planning of iterative user research phases, piloting activities. success factors, risks and mitigation strategies.

Publications

Conference proceedings (42)

LMM-Regularized CLIP Embeddings for Image Classification

Auteurs: Tzelepi, M., & Mezaris, V.
Éditeur: Zenodo
DOI: 10.48550/ARXIV.2412.11663

A Platform for Collecting User Behaviour Data during Social VR Experiments Using Mozilla Hubs

Auteurs: Thomas Röggla, David A. Shamma, Julie R. Williamson, Irene Viola, Silvia Rossi, Pablo Cesar
Publié dans: Proceedings of the 16th International Workshop on Immersive Mixed and Virtual Environment Systems, 2025
Éditeur: ACM
DOI: 10.1145/3652212.3652225

Integrating Head Mounted Displays into Live Broadcasting Workflows: Implications and Possibilities from an Industry Perspective

Auteurs: Bryan Dunphy, Gareth W. Young, Grace Dinan, Niall Murray
Publié dans: IMXw '24: Proceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops
Éditeur: ACM

Exploiting LMM-based knowledge for image classification tasks

Auteurs: M. Tzelepi, V. Mezaris
Publié dans: Proc. 25th Int. Conf. on Engineering Applications of Neural Networks (EANN/EAAAI 2024)
Éditeur: Springer
DOI: 10.48550/ARXIV.2406.03071

Online Anchor-based Training for Image Classification Tasks

Auteurs: M. Tzelepi, V. Mezaris
Éditeur: IEEE
DOI: 10.1109/ICIP51287.2024.10648148

Ethical Considerations in the Production and Consumption of Music in the Metaverse

Auteurs: Gareth W. Young
Publié dans: 2024 IEEE 5th International Symposium on the Internet of Sounds (IS2), 2024
Éditeur: IEEE
DOI: 10.1109/IS262782.2024.10704197

TSalV360: A Method and Dataset for Text-driven Saliency Detection in 360-Degrees Videos

Auteurs: Kontostathis, I., Apostolidis, E., & Mezaris, V.
Éditeur: Zenodo
DOI: 10.5281/ZENODO.17649129

Video Shot Discovery Through Text2Video Embeddings in a News Analytics Dashboard

Auteurs: Lyndon Nixon, Damianos Galanopoulos, Vasileios Mezaris, Alexander Hubmann-Haidvogel, Daniel Fischl, Arno Scharl
Publié dans: 2024 International Conference on Content-Based Multimedia Indexing (CBMI), 2025
Éditeur: IEEE
DOI: 10.1109/CBMI62980.2024.10859251

Emerging Telepresence Technologies for Hybrid Meetings: Experiences and Lessons Learned from an Interactive Workshop

Auteurs: Marta Orduna, Ester Gonzalez-Sosa, Andriana Boudouraki, Houda Elmimouni, Pablo Perez, Jesus Gutierrez, Veronica Ahumada-Newhart, Pablo Cesar
Publié dans: Proceedings of the 17th International Workshop on IMmersive Mixed and Virtual Environment Systems, 2025
Éditeur: ACM
DOI: 10.1145/3712677.3720464

Open-Sourcing VR2Gather: A Collaborative Social VR System for Adaptive Multi-Party Real Time Communication

Auteurs: Jack Jansen, Thomas Röggla, Silvia Rossi, Irene Viola, Pablo Cesar
Publié dans: Proceedings of the 32nd ACM International Conference on Multimedia, 2025
Éditeur: ACM
DOI: 10.1145/3664647.3685515

Gaussian Splatting vs. Classical Photogrammetry: A Comparison for Virtual Backdrops

Auteurs: Philipp Haslbauer, Mike Pullen, Carolin Reichherzer, Aljosa Smolic
Publié dans: 2025 17th International Conference on Quality of Multimedia Experience (QoMEX), 2025
Éditeur: IEEE
DOI: 10.1109/QOMEX65720.2025.11219987

Prototype Anchoring for Image Classification Tasks

Auteurs: Maria Tzelepi, Vasileios Mezaris
Publié dans: 2024 32nd European Signal Processing Conference (EUSIPCO), 2024
Éditeur: IEEE
DOI: 10.23919/EUSIPCO63174.2024.10715272

VERGE in VBS 2026

Auteurs: Pantelidis, N., Kosmidou, E., Galanopoulos, D., Georgalis, D., Stefanos, P., Apostolidis, K., Goulas, A., Pegia, M., Tsionkis, G., Gkountakos, K., Kouvrakis, G., Moumtzidou, A., Gialampoukidis, I., Vrochidis, S., Mezaris, V., & Kompatsiaris, I.
Éditeur: Zenodo
DOI: 10.5281/ZENODO.18268841

Directed Views in Virtual Reality: A Semantic Approach to Volumetric Video Storytelling

Auteurs: Colm O Fearghail, Nivesh Gadipudi, Gareth W. Young, John Dingliana
Publié dans: ACM Symposium on Applied Perception 2024, 2025
Éditeur: ACM
DOI: 10.1145/3675231.3678872

Spatial Media Controller: Exploring the Potential of Augmented Reality, Virtual Reality, Volumetric Capture and 360 Videos for News Broadcasting

Auteurs: Charles Bailly, Lucas Pometti, Joseph Fadel, Juliette Vauchez, Julien Castet
Publié dans: Proceedings of the 2025 ACM International Conference on Interactive Media Experiences, 2025
Éditeur: ACM
DOI: 10.1145/3706370.3727868

Communication Challenges between Clients and Producers of Immersive Media Applications: can Social XR help?

Auteurs: Sueyoon Lee, Irene Viola, Ashutosh Singla, Pablo Cesar
Publié dans: ACM International Conference on Interactive Media Experiences, 2025
Éditeur: ACM
DOI: 10.1145/3639701.3656307

IXR '25: 3rd International Workshop on Interactive eXtended Reality

Auteurs: Viola, I., Rossi, S., Orduna, M., & Torres Vega, M
Publié dans: ACM International Conference on Multimedia
Éditeur: ACM
DOI: 10.1145/3746027.3762385

From Individual QoE to Shared Mental Models: A Novel Evaluation Paradigm for Collaborative XR

Auteurs: Sam Van Damme, Jack Jansen, Silvia Rossi, Pablo Cesar
Publié dans: 2025 17th International Conference on Quality of Multimedia Experience (QoMEX), 2025
Éditeur: IEEE
DOI: 10.1109/QOMEX65720.2025.11219992

Visual-Saliency Guided Multi-modal Learning for No Reference Point Cloud Quality Assessment

Auteurs: Xuemei Zhou, Irene Viola, Ruihong Yin, Pablo Cesar
Publié dans: Proceedings of the 3rd Workshop on Quality of Experience in Visual Multimedia Applications, 2025
Éditeur: ACM
DOI: 10.1145/3689093.3689183

Exploring entropy-based solutions for trajectory prediction in virtual reality

Auteurs: Pradhan, V., Rossi, S., & Cesar, P.
Publié dans: E
Éditeur: Zenodo
DOI: 10.1145/3712677.3720460

Finding Video Shots for Immersive Journalism Through Text-to-Video Search

Auteurs: Lyndon Nixon, Damianos Galanopoulos, Vasileios Mezaris
Publié dans: 2024 International Conference on Content-Based Multimedia Indexing (CBMI), 2025
Éditeur: IEEE
DOI: 10.1109/CBMI62980.2024.10859220

An Experimental Study on Generating Plausible Textual Explanations for Video Summarization

Auteurs: Eleftheriadis, T., Apostolidis, E., & Mezaris, V.
Éditeur: IEEE
DOI: 10.5281/ZENODO.17650009

Back to the Virtual Future: Presence in Cinematic Virtual Reality

Auteurs: Colm O Fearghail, Nivesh Gadipudi, Gareth William Young
Publié dans: Proceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops, 2025
Éditeur: ACM
DOI: 10.1145/3672406.3672418

Voices Unveiled: Quality of Experience in Collaborative VR via AssemblyAI and NASA-TLX Analysis

Auteurs: Moharana, B., Keighrey, C., & Murray, N.
Éditeur: Zenodo
DOI: 10.5281/ZENODO.13343703

Exploring engagement dynamics between journalists and news consumers in Social XR

Auteurs: Arno Verhofstadt, Iris Jennes, Wendy Van den Broeck, Natasja Van Buggenhout, Marie Hospital, Delphine Ramond, Alexandre Grosbois, Matej Praprotnik, Sabrina Povsic Stimec, Kaella Kolle
Publié dans: Proceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops, 2025
Éditeur: ACM
DOI: 10.1145/3672406.3672420

Enhancing User Control in AI-Based Video Summarization for Social Media

Auteurs: Ioannis Kontostathis, Evlampios Apostolidis, Konstantinos Apostolidis, Vasileios Mezaris
Publié dans: Lecture Notes in Computer Science, MultiMedia Modeling, 2024
Éditeur: Springer Nature Singapore
DOI: 10.1007/978-981-96-2074-6_12

MLLM Frame Subset Ensembling for Audio-Visual Video QA and MLLM-based Reranking for Ad-hoc Video Search in TRECVID 2025

Auteurs: Goulas, A., Galanopoulos, D., Patras, I., & Mezaris, V.
Éditeur: Zenodo
DOI: 10.5281/ZENODO.18346563

A Human-Annotated Video Dataset for Training and Evaluation of 360-Degree Video Summarization Methods

Auteurs: Ioannis Kontostathis, Evlampios Apostolidis, Vasileios Mezaris
Publié dans: Proceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops, 2025
Éditeur: ACM
DOI: 10.1145/3672406.3672417

VR Planica: Gaussian Splatting Workflows for Immersive Storytelling

Auteurs: Philipp Haslbauer, Mike Pullen, Matej Praprotnik, Sabrina Povsic Stimec, Marie Hospital, Alexandre Grosbois, Carolin Reichherzer, Aljosa Smolic
Publié dans: Proceedings of the ACM International Conference on Interactive Media Experiences Workshops (ACM IMXw 2025), 2025
Éditeur: Sociedade Brasileira de Computação
DOI: 10.5753/IMXW.2025.8141

Exploring user feedback in VR: the added value of qualitative evaluation methods

Auteurs: Arno, V., Hallström, L., Van den Broeck, W., Reichherzer, C., & Smolic, A.
Éditeur: Zenodo
DOI: 10.5753/IMXW.2025.4030

VidCtx: Context-aware Video Question Answering with Image Models

Auteurs: Goulas, A., Mezaris, V., & Patras, I.
Éditeur: IEEE
DOI: 10.5281/ZENODO.17198741

Social Density and its Impact on Behaviour in Virtual Environments

Auteurs: Julie Williamson, Silvia Rossi, Ross Johnstone, Irene Viola, John Williamson, Thomas Röggla, David A. Shamma, Pablo Cesar
Publié dans: Proceedings of the 3rd International Workshop on Interactive eXtended Reality, 2025
Éditeur: ACM
DOI: 10.1145/3746269.3760421

An LLM Framework for Long-Form Video Retrieval and Audio-Visual Question Answering Using Qwen2/2.5

Auteurs: Damianos Galanopoulos, Andreas Goulas, Antonios Leventakis, Ioannis Patras, Vasileios Mezaris
Publié dans: 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2025
Éditeur: IEEE
DOI: 10.1109/CVPRW67362.2025.00358

Exploring the impact of volumetric graphics on the engagement of broadcast media professionals

Auteurs: Dinan, Grace; Young, Gareth William; Smolic, Aljosa; Jan, Ondřej; Pagés, Rafael
Publié dans: Multimedia Systems, 2024
Éditeur: Zenodo
DOI: 10.21203/RS.3.RS-3994643/V1

Tangible Authoring of Embedded-Object Visualizations in Mixed Reality

Auteurs: Xuyu Li, John Dingliana
Publié dans: Proceedings of the 17th International Symposium on Visual Information Communication and Interaction, 2025
Éditeur: ACM
DOI: 10.1145/3678698.3687187

Disturbing Image Detection Using LMM-Elicited Emotion Embeddings

Auteurs: M. Tzelepi, V. Mezaris
Éditeur: Arxiv
DOI: 10.48550/ARXIV.2406.12668

VVGLTF: Efficient Streaming of Volumetric Video with GLTF

Auteurs: Lam, K. Y., Croci, S., Haslbauer, P., & Smolic, A.
Éditeur: IBC
DOI: 10.5281/ZENODO.17651190

Auto-summarization of Human Volumetric Videos

Auteurs: Nivesh Gadipudi, Colm O. Fearghail, John Dingliana
Publié dans: Proceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops, 2025
Éditeur: ACM
DOI: 10.1145/3672406.3672416

A Volumetric Video Application to Enhance Museum Experiences

Auteurs: Nguyen, T. A. N., Lässig, J., Kälin, A. F., Huwiler, A., Haslbauer, P., Young, G. W., Lam, K. Y., & Smolic, A.
Éditeur: Zenodo
DOI: 10.1145/3641825.3689695

UVG-CWI-DQPC: Dual-Quality Point Cloud Dataset for Volumetric Video Applications

Auteurs: Guillaume Gautier, Xuemei Zhou, Thong Nguyen, Jack Jansen, Louis Fréneau, Marko Viitanen, Uyen Phan, Jani Käpylä, Irene Viola, Alexandre Mercat, Pablo Cesar, Jarno Vanne
Publié dans: Proceedings of the 33rd ACM International Conference on Multimedia, 2025
Éditeur: ACM
DOI: 10.1145/3746027.3758263

QoE Evaluation of Remote Physiotherapy in Volumetric Video and Video-Based Real-Time Communication

Auteurs: Ashutosh Singla, Irene Viola, Jack Jansen, Pablo Cesar
Publié dans: 2025 IEEE International Conference on Multimedia and Expo (ICME), 2025
Éditeur: IEEE
DOI: 10.1109/ICME59968.2025.11209852

Enhancing Immersive Experiences through 3D Point Cloud Analysis: A Novel Framework for Applying 2D Visual Saliency Models to 3D Point Clouds

Auteurs: Marouane Tliba, Xuemei Zhou, Irene Viola, Pablo Cesar, Aladine Chetouani, Giuseppe Valenzise, Frederic Dufaux
Publié dans: 2024 16th International Conference on Quality of Multimedia Experience (QoMEX), 2024
Éditeur: IEEE
DOI: 10.1109/QOMEX61742.2024.10598254

Peer reviewed articles (11)

Designing the Space Archivists: A Metadata-Driven VR Game Concept for Children to Engage with Cultural Heritage

Auteurs: Alina Goldman; Rasa Bocyte; Elana B. Blinder; Arno Verhofstadt; Elizabeth Bonsignore; Pablo Cesar
Publié dans: Heritage, 2025, ISSN 2571-9408
Éditeur: MDPI
DOI: 10.3390/HERITAGE8070238

Subjective and Objective Quality Assessment for Dynamic Point Cloud with Visual Attention in 6 DoF

Auteurs: Zhou, X., Viola, I., Alexiou, E., Jansen, J., & Cesar, P. (
Publié dans: ACM Transactions on Multimedia Computing, Communications, and Applications, ISSN 2168-4081
Éditeur: ACM
DOI: 10.1145/3731759

Cognitive Representations and Personal Experiences of COVID-19 Using Social Virtual Reality

Auteurs: Gareth W. Young, Néill O'Dwyer, Aljosa Smolic
Publié dans: PRESENCE: Virtual and Augmented Reality, Numéro 33, 2024, ISSN 1531-3263
Éditeur: MIT Press
DOI: 10.1162/PRES_A_00429

PointPCA+: A full-reference Point Cloud Quality Assessment metric with PCA-based features

Auteurs: Xuemei Zhou, Evangelos Alexiou, Irene Viola, Pablo Cesar
Publié dans: Signal Processing: Image Communication, Numéro 135, 2025, ISSN 0923-5965
Éditeur: Elsevier BV
DOI: 10.1016/J.IMAGE.2025.117262

Comparison of Visual Saliency for Dynamic Point Clouds: Task-free vs. Task-dependent

Auteurs: Xuemei Zhou, Irene Viola, Silvia Rossi, Pablo Cesar
Publié dans: IEEE Transactions on Visualization and Computer Graphics, Numéro 31, 2025, ISSN 1077-2626
Éditeur: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/TVCG.2025.3549863

ACM Transactions on Multimedia Computing, Communications and Applications

Auteurs: Amit, H., Yuansong, Q., & Murray, N.
Publié dans: ACM Transactions on Multimedia Computing, Communications and Applications, ISSN 1551-6857
Éditeur: Association for Computing Machinary, Inc.
DOI: 10.5281/ZENODO.13343545

UVG-CWI-DQPC: Dual-Quality Point Cloud Dataset for Volumetric Video Applications

Auteurs: Guillaume Gautier; Xuemei Zhou; Thong Nguyen; Jack Jansen; Louis Fréneau; Marko Viitanen; Uyen Phan; Jani Käpylä; Irene Viola; Alexandre Mercat; Pablo Cesar; Jarno Vanne
Publié dans: Proceedings of the 33rd ACM International Conference on Multimedia, 2025, ISSN 2168-4081
Éditeur: ACM Digital
DOI: 10.1145/3746027.3758263

PointPCA: Point Cloud Objective Quality Assessment Using PCA-Based Descriptors

Auteurs: Evangelos Alexiou; Xuemei Zhou; Irene Viola; Pablo Cesar
Publié dans: EURASIP Journal on Image and Video Processing, 2024, ISSN 1687-5281
Éditeur: EURASIP Journal on Image and Video Processing
DOI: 10.1186/S13640-024-00626-3

VVGLTF: Efficient Streaming of Volumetric Video with GLTF

Auteurs: Kit Yung Lam, Simone Croci, Philipp Haslbauer, Aljosa Smolic
Publié dans: SMPTE Motion Imaging Journal, Numéro 134, 2025, ISSN 1545-0279
Éditeur: Society of Motion Picture and Television Engineers (SMPTE)
DOI: 10.5594/JMI.2025/GLNG7938

Designing the Space Archivists: A Metadata-Driven VR Game Concept for Children to Engage with Cultural Heritage

Auteurs: Alina Goldman, Rasa Bocyte, Elana B. Blinder, Arno Verhofstadt, Elizabeth Bonsignore, Pablo Cesar
Publié dans: Heritage, Numéro 8, 2025, ISSN 2571-9408
Éditeur: MDPI AG
DOI: 10.3390/HERITAGE8070238

Predicting Quality of Multimedia Experience Using Electrocardiogram and Respiration Signals

Auteurs: Sowmya Vijayakumar, Ronan Flynn, Peter Corcoran, Niall Murray
Publié dans: IEEE Access, Numéro 13, 2025, ISSN 2169-3536
Éditeur: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/ACCESS.2024.3420103

Other (12)

RCQoEA-360VR: Real-time Continuous QoE Scores for HMD-based 360° VR Dataset

Auteurs: Sowmya Vijayakumar, Tong Xue, Abdallah El Ali, Irene Viola, Ronan Flynn, Peter Corcoran, Pablo Cesar, Niall Murray
Publié dans: Proceedings of the 33rd ACM International Conference on Multimedia, 2025
Éditeur: ACM
DOI: 10.1145/3746027.3758259

Avatar Customization, Personality, and the Perception of Work Group Inclusion in Immersive Virtual Reality

Auteurs: Lauren Buck; Gareth W. Young; Rachel McDonnell
Publié dans: Crossref, 2023
DOI: 10.1145/3584931.3606992

Gaussian Splatting vs. Classical Photogrammetry: 3D Models

Auteurs: Haslbauer, P., Pullen, M., Reichherzer, C., & Smolic, A
Éditeur: Zenodo
DOI: 10.5281/ZENODO.17143763

Feel the Music!—Audience Experiences of Audio–Tactile Feedback in a Novel Virtual Reality Volumetric Music Video

Auteurs: Gareth W. Young; Néill O’Dwyer; Mauricio Flores Vargas; Rachel Mc Donnell; Aljosa Smolic
Publié dans: Arts; Volume 12; Numéro 4; Pages: 156, 2023
DOI: 10.3390/arts12040156

Gaussian Splatting vs. Classical Photogrammetry: Input Data

Auteurs: Haslbauer, P., Pullen, M., Reichherzer, C., & Smolic, A.
Éditeur: Zenodo
DOI: 10.5281/ZENODO.17185795

An Integrated System for Spatio-temporal Summarization of 360-Degrees Videos

Auteurs: Ioannis Kontostathis; Evlampios Apostolidis; Vasileios Mezaris
Publié dans: MultiMedia Modeling ISBN: 9783031533013, 2024

VR2Gather: A collaborative social VR system for adaptive multi-party real-time communication

Auteurs: Viola, Irene; Jansen, Jack; Subramanyam, Shishir; Reimat, Ignacio; César Garcia, Pablo Santiago
Publié dans: urn:issn:1070-986X, 2023

Physiological Synchrony: A Novel Approach to Evaluating User Quality of Experience in Collaborative Distributed Virtual Reality Environments

Auteurs: Moharana, Bhagyabati; Keighrey, Dr. Conor; Murray, Dr. Niall
Publié dans: 2023
DOI: 10.5281/zenodo.8224881

TSV360: A dataset for training and objective evaluation of text-driven 360-degrees video saliency detection methods

Auteurs: Kontostathis, I., Apostolidis, E., & Mezaris, V.
Éditeur: Zenodo
DOI: 10.5281/ZENODO.16991178

TangibleMRCreate: Intuitive Authoring of Mixed Reality Content

Auteurs: Dingliana, J., & Li, X.
Éditeur: Zenodo
DOI: 10.2312/EGVE.20231339

PointPCA+: Extending PointPCA Objective Quality Assessment Metric

Auteurs: Zhou, Xuemei; Alexiou, Evangelos; Viola, Irene; Cesar, Pablo
Publié dans: Crossref, 2023

A Case Study on Student Experiences of Social VR in a Remote STEM Classroom

Auteurs: Gareth W. Young; Néill C. O'Dwyer; Aljosa Smolic
Publié dans: Crossref, 2023