Voice driven interaction in XR spaces

Información del proyecto

VOXReality

Identificador del acuerdo de subvención: 101070521

DOI

10.3030/101070521

Proyecto cerrado

Fecha de la firma de la CE 11 Junio 2022

Fecha de inicio 1 Octubre 2022

Fecha de finalización 31 Diciembre 2025

Financiado con arreglo a

• Digital, Industry and Space

Coste total

€ 4 786 875,00

Aportación de la UE

€ 4 786 875,00

Coordinado por

MAGGIOLI SPA
Italy

CORDIS proporciona enlaces a los documentos públicos y las publicaciones de los proyectos de los programas marco HORIZONTE.

Los enlaces a los documentos y las publicaciones de los proyectos del Séptimo Programa Marco, así como los enlaces a algunos tipos de resultados específicos, como conjuntos de datos y «software», se obtienen dinámicamente de OpenAIRE .

Resultado final

Documents, reports (6)

Dissemination and communication plan

This report will outline communication and dissemination channels to be used and identify relevant events and publications.

Development infrastructure and integration guidelines

Analysis of the integration and validation requirements

Model deployment analysis V1

This deliverable will analyse the progress and results on VOXReality models deployment, training and XR applications.

Definition and Analysis of VOXReality Use Cases V1

Detailed analysis of use cases, technical and user requirements for each case of the project.

Advanced AI multi-modal for XR analysis V1

This deliverable will analyse the progress and results on VOXReality Audio processing, VOXReality Multilingual translation, Vision and language based XR models and Context aware generative dialogue system.

Open call documents collection V1

This deliverable will contain all the needed information and necessary documents for the applicants to submit applications to the Open Call.

Publicaciones

Peer reviewed articles (2)

Intent-calibrated Self-training for Answer Selection in Open-domain Dialogues

Autores: Wentao Deng, Jiahuan Pei, Zhaochun Ren, Zhumin Chen, Pengjie Ren
Publicado en: Transactions of the Association for Computational Linguistics, Edición 11, 2023, ISSN 2307-387X
Editor: MIT Press
DOI: 10.1162/TACL_A_00599

SADAMB: Advancing Spatially-Aware Vision-Language Modeling Through Datasets, Metrics, and Benchmarks

Autores: Giorgos Papadopoulos, Petros Drakoulis, Athanasios Ntovas, Alexandros Doumanoglou, Dimitris Zarpalas
Publicado en: Computers, Edición 14, 2025, ISSN 2073-431X
Editor: MDPI AG
DOI: 10.3390/COMPUTERS14100413

Conference proceedings (10)

VOXReality: Immersive XR experiences

Autores: Maniatis, A., Bourou, S., Anastasakis, Z., Psychogios, K.
Publicado en: IHIET-AI 2023, Edición 70, 2023
Editor: AHFE (2023) International Conference. AHFE Open Access

Analyzing the Attention Heads for Pronoun Disambiguation in Context-aware Machine Translation Models

Autores: Paweł Mąka, Yusuf Can Semerci, Jan Scholtes, Gerasimos Spanakis
Publicado en: Proceedings of the 31st International Conference on Computational Linguistics, 2025
Editor: Association for Computational Linguistics

Enhancing the Audience Experience for VR and AR Theatre with AI-generated Subtitles

Autores: Irene Viola, Moonisa Ahsan, Olga Chatzifoti, Atanas Yonkov, Eleni Oikonomou, Ioannis Radin, Paweł Mąka, Abderrahmane Issam, Pablo Cesar
Publicado en: Proceedings of the 2025 31st ACM Symposium on Virtual Reality Software and Technology, 2025
Editor: ACM
DOI: 10.1145/3756884.3766057

You Are What You Train: Effects of Data Composition on Training Context-aware Machine Translation Models

Autores: Pawel Maka, Yusuf Can Semerci, Jan Scholtes, Gerasimos Spanakis
Publicado en: Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, 2025
Editor: Association for Computational Linguistics
DOI: 10.18653/V1/2025.EMNLP-MAIN.1394

Sequence Shortening for Context-Aware Machine Translation

Autores: Mąka, P., Semerci, Y. C., Scholtes, J., & Spanakis, G.
Publicado en: Findings of the Association for Computational Linguistics: EACL 2024, 2024
Editor: Association for Computational Linguistics
DOI: 10.48550/ARXIV.2402.01416

VRD: A multi-lingual translation and Ai-Assisted Navigation experience for VR Conference Application

Autores: Moonisa Ahsan, Irene Viola, Manuel Toledo, Dimitris Kontopoulos, Pablo Cesar
Publicado en: Proceedings of the 2025 31st ACM Symposium on Virtual Reality Software and Technology, 2025
Editor: ACM
DOI: 10.1145/3756884.3768418

Autonomous Workflow for Multimodal Fine-Grained Training Assistants Towards Mixed Reality

Autores: Jiahuan Pei, Irene Viola, Haochen Huang, Junxiao Wang, Moonisa Ahsan, Fanghua Ye, Jiang Yiming, Yao Sai, Di Wang, Zhumin Chen, Pengjie Ren, Pablo Cesar
Publicado en: 62nd Annual Meeting of the Association for Computational Linguistics, 2024
Editor: ACL 2024
DOI: 10.48550/ARXIV.2405.13034

Fixed and Adaptive Simultaneous Machine Translation Strategies Using Adapters

Autores: Abderrahmane Issam, Yusuf Can Semerci, Jan Scholtes, Gerasimos Spanakis
Publicado en: Proceedings of the 21st International Conference on Spoken Language Translation (IWSLT 2024), 2024
Editor: Association for Computational Linguistics
DOI: 10.18653/V1/2024.IWSLT-1.36

DTW-Align: Bridging the Modality Gap in End-to-End Speech Translation with Dynamic Time Warping Alignment

Autores: Abderrahmane Issam, Yusuf Can Semerci, Jan Scholtes, Gerasimos Spanakis
Publicado en: Proceedings of the Tenth Conference on Machine Translation, 2025
Editor: Association for Computational Linguistics
DOI: 10.18653/V1/2025.WMT-1.11

A Representation Level Analysis of NMT Model Robustness to Grammatical Errors

Autores: Abderrahmane Issam, Yusuf Can Semerci, Jan Scholtes, Gerasimos Spanakis
Publicado en: Findings of the Association for Computational Linguistics: ACL 2025, 2025
Editor: Association for Computational Linguistics
DOI: 10.18653/V1/2025.FINDINGS-ACL.451

Book chapters (1)

Using Augmented Reality and Machine Learning for Captioning in Theatrical Experiences

Autores: Olga Chatzifoti, Nick Achilleopoulos, Spiros Borotis, Moonisa Ahsan, and Eleni Oikonomou
Publicado en: EuroXR 2024: Proceedings of the 21st EuroXR International Conference, Edición 322, 2024, ISSN 2242-1211
Editor: VTT Technical Research Centre of Finland
DOI: 10.32040/2242-122X.2024.T432