Ignite the Immersive Media Sector by Enabling New Narrative Visions

Información del proyecto

TransMIXR

Identificador del acuerdo de subvención: 101070109

DOI

10.3030/101070109

Proyecto cerrado

Fecha de la firma de la CE 21 Junio 2022

Fecha de inicio 1 Octubre 2022

Fecha de finalización 31 Diciembre 2025

Financiado con arreglo a

• Digital, Industry and Space

Coste total

€ 10 087 267,49

Aportación de la UE

€ 8 997 632,25

Coordinado por

Technological University of the Shannon: Midlands Midwest
Ireland

CORDIS proporciona enlaces a los documentos públicos y las publicaciones de los proyectos de los programas marco HORIZONTE.

Los enlaces a los documentos y las publicaciones de los proyectos del Séptimo Programa Marco, así como los enlaces a algunos tipos de resultados específicos, como conjuntos de datos y «software», se obtienen dinámicamente de OpenAIRE .

Resultado final

Documents, reports (7)

Technical and Innovation Coordination and Quality Assurance

This will define the project plan from the technical and innovation perspective in addition to appropriate Quality Assurance (see Section 1.2.6) processes and Risk Management to be put in place. It will define the roles, responsibilities and operating procedures (incl. measures to ensure gender equality and diversity).

Specifications of Alpha and Beta versions of the environment

Technical report (living) with initial version in M5 (as per the gantt chart) outlining the design and technology configuration underlying the rendering engine of the TransMIXR project inclusive of interaction, user experience capture framework

Initial media ingestion understanding and summarisation components

This deliverable reports on the first prototypes of the media ingestion, understanding and summarisation components (T2.1-3)

Media content metrics and visual analytics dashboards

This deliverable reports on the first prototypes of the media content metrics and visual analytics dashboard.

Communication and Dissemination Plan

Plans for project communication incl. design and setup of the website, social media channels and the creation of the project’s first promotional materials (presentation and communication kit; publicly available via the website).

Interim Dissemination and Engagement Report

Quantitative and qualitative report on planned and completed D.E.C. dissemination and stakeholder engagement activities, success measures against the stated goals and recommended refinements of the original plans.

UCD methodology and planning

Description of the UCD methodology. Provides details on: planning of iterative user research phases, piloting activities. success factors, risks and mitigation strategies.

Publicaciones

Conference proceedings (42)

LMM-Regularized CLIP Embeddings for Image Classification

Autores: Tzelepi, M., & Mezaris, V.
Editor: Zenodo
DOI: 10.48550/ARXIV.2412.11663

A Platform for Collecting User Behaviour Data during Social VR Experiments Using Mozilla Hubs

Autores: Thomas Röggla, David A. Shamma, Julie R. Williamson, Irene Viola, Silvia Rossi, Pablo Cesar
Publicado en: Proceedings of the 16th International Workshop on Immersive Mixed and Virtual Environment Systems, 2025
Editor: ACM
DOI: 10.1145/3652212.3652225

Integrating Head Mounted Displays into Live Broadcasting Workflows: Implications and Possibilities from an Industry Perspective

Autores: Bryan Dunphy, Gareth W. Young, Grace Dinan, Niall Murray
Publicado en: IMXw '24: Proceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops
Editor: ACM

Exploiting LMM-based knowledge for image classification tasks

Autores: M. Tzelepi, V. Mezaris
Publicado en: Proc. 25th Int. Conf. on Engineering Applications of Neural Networks (EANN/EAAAI 2024)
Editor: Springer
DOI: 10.48550/ARXIV.2406.03071

Online Anchor-based Training for Image Classification Tasks

Autores: M. Tzelepi, V. Mezaris
Editor: IEEE
DOI: 10.1109/ICIP51287.2024.10648148

Ethical Considerations in the Production and Consumption of Music in the Metaverse

Autores: Gareth W. Young
Publicado en: 2024 IEEE 5th International Symposium on the Internet of Sounds (IS2), 2024
Editor: IEEE
DOI: 10.1109/IS262782.2024.10704197

TSalV360: A Method and Dataset for Text-driven Saliency Detection in 360-Degrees Videos

Autores: Kontostathis, I., Apostolidis, E., & Mezaris, V.
Editor: Zenodo
DOI: 10.5281/ZENODO.17649129

Video Shot Discovery Through Text2Video Embeddings in a News Analytics Dashboard

Autores: Lyndon Nixon, Damianos Galanopoulos, Vasileios Mezaris, Alexander Hubmann-Haidvogel, Daniel Fischl, Arno Scharl
Publicado en: 2024 International Conference on Content-Based Multimedia Indexing (CBMI), 2025
Editor: IEEE
DOI: 10.1109/CBMI62980.2024.10859251

Emerging Telepresence Technologies for Hybrid Meetings: Experiences and Lessons Learned from an Interactive Workshop

Autores: Marta Orduna, Ester Gonzalez-Sosa, Andriana Boudouraki, Houda Elmimouni, Pablo Perez, Jesus Gutierrez, Veronica Ahumada-Newhart, Pablo Cesar
Publicado en: Proceedings of the 17th International Workshop on IMmersive Mixed and Virtual Environment Systems, 2025
Editor: ACM
DOI: 10.1145/3712677.3720464

Open-Sourcing VR2Gather: A Collaborative Social VR System for Adaptive Multi-Party Real Time Communication

Autores: Jack Jansen, Thomas Röggla, Silvia Rossi, Irene Viola, Pablo Cesar
Publicado en: Proceedings of the 32nd ACM International Conference on Multimedia, 2025
Editor: ACM
DOI: 10.1145/3664647.3685515

Gaussian Splatting vs. Classical Photogrammetry: A Comparison for Virtual Backdrops

Autores: Philipp Haslbauer, Mike Pullen, Carolin Reichherzer, Aljosa Smolic
Publicado en: 2025 17th International Conference on Quality of Multimedia Experience (QoMEX), 2025
Editor: IEEE
DOI: 10.1109/QOMEX65720.2025.11219987

Prototype Anchoring for Image Classification Tasks

Autores: Maria Tzelepi, Vasileios Mezaris
Publicado en: 2024 32nd European Signal Processing Conference (EUSIPCO), 2024
Editor: IEEE
DOI: 10.23919/EUSIPCO63174.2024.10715272

VERGE in VBS 2026

Autores: Pantelidis, N., Kosmidou, E., Galanopoulos, D., Georgalis, D., Stefanos, P., Apostolidis, K., Goulas, A., Pegia, M., Tsionkis, G., Gkountakos, K., Kouvrakis, G., Moumtzidou, A., Gialampoukidis, I., Vrochidis, S., Mezaris, V., & Kompatsiaris, I.
Editor: Zenodo
DOI: 10.5281/ZENODO.18268841

Directed Views in Virtual Reality: A Semantic Approach to Volumetric Video Storytelling

Autores: Colm O Fearghail, Nivesh Gadipudi, Gareth W. Young, John Dingliana
Publicado en: ACM Symposium on Applied Perception 2024, 2025
Editor: ACM
DOI: 10.1145/3675231.3678872

Spatial Media Controller: Exploring the Potential of Augmented Reality, Virtual Reality, Volumetric Capture and 360 Videos for News Broadcasting

Autores: Charles Bailly, Lucas Pometti, Joseph Fadel, Juliette Vauchez, Julien Castet
Publicado en: Proceedings of the 2025 ACM International Conference on Interactive Media Experiences, 2025
Editor: ACM
DOI: 10.1145/3706370.3727868

Communication Challenges between Clients and Producers of Immersive Media Applications: can Social XR help?

Autores: Sueyoon Lee, Irene Viola, Ashutosh Singla, Pablo Cesar
Publicado en: ACM International Conference on Interactive Media Experiences, 2025
Editor: ACM
DOI: 10.1145/3639701.3656307

IXR '25: 3rd International Workshop on Interactive eXtended Reality

Autores: Viola, I., Rossi, S., Orduna, M., & Torres Vega, M
Publicado en: ACM International Conference on Multimedia
Editor: ACM
DOI: 10.1145/3746027.3762385

From Individual QoE to Shared Mental Models: A Novel Evaluation Paradigm for Collaborative XR

Autores: Sam Van Damme, Jack Jansen, Silvia Rossi, Pablo Cesar
Publicado en: 2025 17th International Conference on Quality of Multimedia Experience (QoMEX), 2025
Editor: IEEE
DOI: 10.1109/QOMEX65720.2025.11219992

Visual-Saliency Guided Multi-modal Learning for No Reference Point Cloud Quality Assessment

Autores: Xuemei Zhou, Irene Viola, Ruihong Yin, Pablo Cesar
Publicado en: Proceedings of the 3rd Workshop on Quality of Experience in Visual Multimedia Applications, 2025
Editor: ACM
DOI: 10.1145/3689093.3689183

Exploring entropy-based solutions for trajectory prediction in virtual reality

Autores: Pradhan, V., Rossi, S., & Cesar, P.
Publicado en: E
Editor: Zenodo
DOI: 10.1145/3712677.3720460

Finding Video Shots for Immersive Journalism Through Text-to-Video Search

Autores: Lyndon Nixon, Damianos Galanopoulos, Vasileios Mezaris
Publicado en: 2024 International Conference on Content-Based Multimedia Indexing (CBMI), 2025
Editor: IEEE
DOI: 10.1109/CBMI62980.2024.10859220

An Experimental Study on Generating Plausible Textual Explanations for Video Summarization

Autores: Eleftheriadis, T., Apostolidis, E., & Mezaris, V.
Editor: IEEE
DOI: 10.5281/ZENODO.17650009

Back to the Virtual Future: Presence in Cinematic Virtual Reality

Autores: Colm O Fearghail, Nivesh Gadipudi, Gareth William Young
Publicado en: Proceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops, 2025
Editor: ACM
DOI: 10.1145/3672406.3672418

Voices Unveiled: Quality of Experience in Collaborative VR via AssemblyAI and NASA-TLX Analysis

Autores: Moharana, B., Keighrey, C., & Murray, N.
Editor: Zenodo
DOI: 10.5281/ZENODO.13343703

Exploring engagement dynamics between journalists and news consumers in Social XR

Autores: Arno Verhofstadt, Iris Jennes, Wendy Van den Broeck, Natasja Van Buggenhout, Marie Hospital, Delphine Ramond, Alexandre Grosbois, Matej Praprotnik, Sabrina Povsic Stimec, Kaella Kolle
Publicado en: Proceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops, 2025
Editor: ACM
DOI: 10.1145/3672406.3672420

Enhancing User Control in AI-Based Video Summarization for Social Media

Autores: Ioannis Kontostathis, Evlampios Apostolidis, Konstantinos Apostolidis, Vasileios Mezaris
Publicado en: Lecture Notes in Computer Science, MultiMedia Modeling, 2024
Editor: Springer Nature Singapore
DOI: 10.1007/978-981-96-2074-6_12

MLLM Frame Subset Ensembling for Audio-Visual Video QA and MLLM-based Reranking for Ad-hoc Video Search in TRECVID 2025

Autores: Goulas, A., Galanopoulos, D., Patras, I., & Mezaris, V.
Editor: Zenodo
DOI: 10.5281/ZENODO.18346563

A Human-Annotated Video Dataset for Training and Evaluation of 360-Degree Video Summarization Methods

Autores: Ioannis Kontostathis, Evlampios Apostolidis, Vasileios Mezaris
Publicado en: Proceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops, 2025
Editor: ACM
DOI: 10.1145/3672406.3672417

VR Planica: Gaussian Splatting Workflows for Immersive Storytelling

Autores: Philipp Haslbauer, Mike Pullen, Matej Praprotnik, Sabrina Povsic Stimec, Marie Hospital, Alexandre Grosbois, Carolin Reichherzer, Aljosa Smolic
Publicado en: Proceedings of the ACM International Conference on Interactive Media Experiences Workshops (ACM IMXw 2025), 2025
Editor: Sociedade Brasileira de Computação
DOI: 10.5753/IMXW.2025.8141

Exploring user feedback in VR: the added value of qualitative evaluation methods

Autores: Arno, V., Hallström, L., Van den Broeck, W., Reichherzer, C., & Smolic, A.
Editor: Zenodo
DOI: 10.5753/IMXW.2025.4030

VidCtx: Context-aware Video Question Answering with Image Models

Autores: Goulas, A., Mezaris, V., & Patras, I.
Editor: IEEE
DOI: 10.5281/ZENODO.17198741

Social Density and its Impact on Behaviour in Virtual Environments

Autores: Julie Williamson, Silvia Rossi, Ross Johnstone, Irene Viola, John Williamson, Thomas Röggla, David A. Shamma, Pablo Cesar
Publicado en: Proceedings of the 3rd International Workshop on Interactive eXtended Reality, 2025
Editor: ACM
DOI: 10.1145/3746269.3760421

An LLM Framework for Long-Form Video Retrieval and Audio-Visual Question Answering Using Qwen2/2.5

Autores: Damianos Galanopoulos, Andreas Goulas, Antonios Leventakis, Ioannis Patras, Vasileios Mezaris
Publicado en: 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2025
Editor: IEEE
DOI: 10.1109/CVPRW67362.2025.00358

Exploring the impact of volumetric graphics on the engagement of broadcast media professionals

Autores: Dinan, Grace; Young, Gareth William; Smolic, Aljosa; Jan, Ondřej; Pagés, Rafael
Publicado en: Multimedia Systems, 2024
Editor: Zenodo
DOI: 10.21203/RS.3.RS-3994643/V1

Tangible Authoring of Embedded-Object Visualizations in Mixed Reality

Autores: Xuyu Li, John Dingliana
Publicado en: Proceedings of the 17th International Symposium on Visual Information Communication and Interaction, 2025
Editor: ACM
DOI: 10.1145/3678698.3687187

Disturbing Image Detection Using LMM-Elicited Emotion Embeddings

Autores: M. Tzelepi, V. Mezaris
Editor: Arxiv
DOI: 10.48550/ARXIV.2406.12668

VVGLTF: Efficient Streaming of Volumetric Video with GLTF

Autores: Lam, K. Y., Croci, S., Haslbauer, P., & Smolic, A.
Editor: IBC
DOI: 10.5281/ZENODO.17651190

Auto-summarization of Human Volumetric Videos

Autores: Nivesh Gadipudi, Colm O. Fearghail, John Dingliana
Publicado en: Proceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops, 2025
Editor: ACM
DOI: 10.1145/3672406.3672416

A Volumetric Video Application to Enhance Museum Experiences

Autores: Nguyen, T. A. N., Lässig, J., Kälin, A. F., Huwiler, A., Haslbauer, P., Young, G. W., Lam, K. Y., & Smolic, A.
Editor: Zenodo
DOI: 10.1145/3641825.3689695

UVG-CWI-DQPC: Dual-Quality Point Cloud Dataset for Volumetric Video Applications

Autores: Guillaume Gautier, Xuemei Zhou, Thong Nguyen, Jack Jansen, Louis Fréneau, Marko Viitanen, Uyen Phan, Jani Käpylä, Irene Viola, Alexandre Mercat, Pablo Cesar, Jarno Vanne
Publicado en: Proceedings of the 33rd ACM International Conference on Multimedia, 2025
Editor: ACM
DOI: 10.1145/3746027.3758263

QoE Evaluation of Remote Physiotherapy in Volumetric Video and Video-Based Real-Time Communication

Autores: Ashutosh Singla, Irene Viola, Jack Jansen, Pablo Cesar
Publicado en: 2025 IEEE International Conference on Multimedia and Expo (ICME), 2025
Editor: IEEE
DOI: 10.1109/ICME59968.2025.11209852

Enhancing Immersive Experiences through 3D Point Cloud Analysis: A Novel Framework for Applying 2D Visual Saliency Models to 3D Point Clouds

Autores: Marouane Tliba, Xuemei Zhou, Irene Viola, Pablo Cesar, Aladine Chetouani, Giuseppe Valenzise, Frederic Dufaux
Publicado en: 2024 16th International Conference on Quality of Multimedia Experience (QoMEX), 2024
Editor: IEEE
DOI: 10.1109/QOMEX61742.2024.10598254

Peer reviewed articles (11)

Designing the Space Archivists: A Metadata-Driven VR Game Concept for Children to Engage with Cultural Heritage

Autores: Alina Goldman; Rasa Bocyte; Elana B. Blinder; Arno Verhofstadt; Elizabeth Bonsignore; Pablo Cesar
Publicado en: Heritage, 2025, ISSN 2571-9408
Editor: MDPI
DOI: 10.3390/HERITAGE8070238

Subjective and Objective Quality Assessment for Dynamic Point Cloud with Visual Attention in 6 DoF

Autores: Zhou, X., Viola, I., Alexiou, E., Jansen, J., & Cesar, P. (
Publicado en: ACM Transactions on Multimedia Computing, Communications, and Applications, ISSN 2168-4081
Editor: ACM
DOI: 10.1145/3731759

Cognitive Representations and Personal Experiences of COVID-19 Using Social Virtual Reality

Autores: Gareth W. Young, Néill O'Dwyer, Aljosa Smolic
Publicado en: PRESENCE: Virtual and Augmented Reality, Edición 33, 2024, ISSN 1531-3263
Editor: MIT Press
DOI: 10.1162/PRES_A_00429

PointPCA+: A full-reference Point Cloud Quality Assessment metric with PCA-based features

Autores: Xuemei Zhou, Evangelos Alexiou, Irene Viola, Pablo Cesar
Publicado en: Signal Processing: Image Communication, Edición 135, 2025, ISSN 0923-5965
Editor: Elsevier BV
DOI: 10.1016/J.IMAGE.2025.117262

Comparison of Visual Saliency for Dynamic Point Clouds: Task-free vs. Task-dependent

Autores: Xuemei Zhou, Irene Viola, Silvia Rossi, Pablo Cesar
Publicado en: IEEE Transactions on Visualization and Computer Graphics, Edición 31, 2025, ISSN 1077-2626
Editor: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/TVCG.2025.3549863

ACM Transactions on Multimedia Computing, Communications and Applications

Autores: Amit, H., Yuansong, Q., & Murray, N.
Publicado en: ACM Transactions on Multimedia Computing, Communications and Applications, ISSN 1551-6857
Editor: Association for Computing Machinary, Inc.
DOI: 10.5281/ZENODO.13343545

UVG-CWI-DQPC: Dual-Quality Point Cloud Dataset for Volumetric Video Applications

Autores: Guillaume Gautier; Xuemei Zhou; Thong Nguyen; Jack Jansen; Louis Fréneau; Marko Viitanen; Uyen Phan; Jani Käpylä; Irene Viola; Alexandre Mercat; Pablo Cesar; Jarno Vanne
Publicado en: Proceedings of the 33rd ACM International Conference on Multimedia, 2025, ISSN 2168-4081
Editor: ACM Digital
DOI: 10.1145/3746027.3758263

PointPCA: Point Cloud Objective Quality Assessment Using PCA-Based Descriptors

Autores: Evangelos Alexiou; Xuemei Zhou; Irene Viola; Pablo Cesar
Publicado en: EURASIP Journal on Image and Video Processing, 2024, ISSN 1687-5281
Editor: EURASIP Journal on Image and Video Processing
DOI: 10.1186/S13640-024-00626-3

VVGLTF: Efficient Streaming of Volumetric Video with GLTF

Autores: Kit Yung Lam, Simone Croci, Philipp Haslbauer, Aljosa Smolic
Publicado en: SMPTE Motion Imaging Journal, Edición 134, 2025, ISSN 1545-0279
Editor: Society of Motion Picture and Television Engineers (SMPTE)
DOI: 10.5594/JMI.2025/GLNG7938

Designing the Space Archivists: A Metadata-Driven VR Game Concept for Children to Engage with Cultural Heritage

Autores: Alina Goldman, Rasa Bocyte, Elana B. Blinder, Arno Verhofstadt, Elizabeth Bonsignore, Pablo Cesar
Publicado en: Heritage, Edición 8, 2025, ISSN 2571-9408
Editor: MDPI AG
DOI: 10.3390/HERITAGE8070238

Predicting Quality of Multimedia Experience Using Electrocardiogram and Respiration Signals

Autores: Sowmya Vijayakumar, Ronan Flynn, Peter Corcoran, Niall Murray
Publicado en: IEEE Access, Edición 13, 2025, ISSN 2169-3536
Editor: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/ACCESS.2024.3420103

Other (12)

RCQoEA-360VR: Real-time Continuous QoE Scores for HMD-based 360° VR Dataset

Autores: Sowmya Vijayakumar, Tong Xue, Abdallah El Ali, Irene Viola, Ronan Flynn, Peter Corcoran, Pablo Cesar, Niall Murray
Publicado en: Proceedings of the 33rd ACM International Conference on Multimedia, 2025
Editor: ACM
DOI: 10.1145/3746027.3758259

Avatar Customization, Personality, and the Perception of Work Group Inclusion in Immersive Virtual Reality

Autores: Lauren Buck; Gareth W. Young; Rachel McDonnell
Publicado en: Crossref, 2023
DOI: 10.1145/3584931.3606992

Gaussian Splatting vs. Classical Photogrammetry: 3D Models

Autores: Haslbauer, P., Pullen, M., Reichherzer, C., & Smolic, A
Editor: Zenodo
DOI: 10.5281/ZENODO.17143763

Feel the Music!—Audience Experiences of Audio–Tactile Feedback in a Novel Virtual Reality Volumetric Music Video

Autores: Gareth W. Young; Néill O’Dwyer; Mauricio Flores Vargas; Rachel Mc Donnell; Aljosa Smolic
Publicado en: Arts; Volume 12; Edición 4; Pages: 156, 2023
DOI: 10.3390/arts12040156

Gaussian Splatting vs. Classical Photogrammetry: Input Data

Autores: Haslbauer, P., Pullen, M., Reichherzer, C., & Smolic, A.
Editor: Zenodo
DOI: 10.5281/ZENODO.17185795

An Integrated System for Spatio-temporal Summarization of 360-Degrees Videos

Autores: Ioannis Kontostathis; Evlampios Apostolidis; Vasileios Mezaris
Publicado en: MultiMedia Modeling ISBN: 9783031533013, 2024

VR2Gather: A collaborative social VR system for adaptive multi-party real-time communication

Autores: Viola, Irene; Jansen, Jack; Subramanyam, Shishir; Reimat, Ignacio; César Garcia, Pablo Santiago
Publicado en: urn:issn:1070-986X, 2023

Physiological Synchrony: A Novel Approach to Evaluating User Quality of Experience in Collaborative Distributed Virtual Reality Environments

Autores: Moharana, Bhagyabati; Keighrey, Dr. Conor; Murray, Dr. Niall
Publicado en: 2023
DOI: 10.5281/zenodo.8224881

TSV360: A dataset for training and objective evaluation of text-driven 360-degrees video saliency detection methods

Autores: Kontostathis, I., Apostolidis, E., & Mezaris, V.
Editor: Zenodo
DOI: 10.5281/ZENODO.16991178

TangibleMRCreate: Intuitive Authoring of Mixed Reality Content

Autores: Dingliana, J., & Li, X.
Editor: Zenodo
DOI: 10.2312/EGVE.20231339

PointPCA+: Extending PointPCA Objective Quality Assessment Metric

Autores: Zhou, Xuemei; Alexiou, Evangelos; Viola, Irene; Cesar, Pablo
Publicado en: Crossref, 2023

A Case Study on Student Experiences of Social VR in a Remote STEM Classroom

Autores: Gareth W. Young; Néill C. O'Dwyer; Aljosa Smolic
Publicado en: Crossref, 2023