DIgital DYnaMic and respOnsible twinS for XR

Project Information

DIDYMOS-XR

Grant agreement ID: 101092875

DOI

10.3030/101092875

Project closed

EC signature date 19 November 2022

Start date 1 January 2023

End date 31 December 2025

Funded under

• Digital, Industry and Space

Total cost

€ 5 500 207,50

EU contribution

€ 5 500 207,50

Coordinated by

JOANNEUM RESEARCH FORSCHUNGSGESELLSCHAFT MBH
Austria

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Deliverables

Documents, reports (3)

D4.1: Localisation, mapping and rendering methods v1

Initial release of the algorithms for localisation & mapping and content adaptation and rendering. A subset of the components will be ready for initial integration, for the others independent assessment results will be provided.

D3.1: Capture, reconstruction, synchronisation and scene understanding methods v1

Initial release of the algorithms for capturing, reconstructing and analysing the scene and keeping it in sync from heterogeneous inputs. A subset of the components will be ready for initial integration, for the others independent assessment results will be provided.

D2.1: Requirements and validation methods v1

Initial release of the algorithms for capturing, reconstructing and analysing the scene and keeping it in sync from heterogeneous inputs. A subset of the components will be ready for initial integration, for the others independent assessment results will be provided.

Data Management Plan (1)

D1.2 Data management plan

The data management plan will define how the various kinds of data collected and generated in the project will be handled and stored. It sets the requirements for the data store in terms of data security and privacy protection. It will be maintained as a living document.

Publications

Peer reviewed articles (11)

MaskUno: Switch-Split Block For Enhancing Instance Segmentation

Author(s): Jawad Haidar; Marc Mouawad; Imad H. Elhajj; Daniel C. Asmar
Published in: CoRR, 2024, ISSN 2331-8422
Publisher: CoRR
DOI: 10.48550/ARXIV.2407.21498

ExpPoint-MAE: Better Interpretability and Performance for Self-Supervised Point Cloud Transformers

Author(s): Ioannis Romanelis, Vlassis Fotis, Konstantinos Moustakas, Adrian Munteanu
Published in: IEEE Access, 2024, ISSN 2169-3536
Publisher: IEEE Access
DOI: 10.1109/ACCESS.2024.3388155

Interactive digital twins enabling responsible extended reality applications

Author(s): Maya Antoun, Imad H. Elhajj, Malak Sayour, Panos K. Papadopoulos, Dimitrios Zarpalas, Anthony Rizk, ABM Tariqul Islam, Ivan Huerta, Leonel Toledo, Gerasimos Arvanitis, Konstantinos Moustakas, Aleksandar Jevtić, Isaac Agustí, Francesco Vona, Jan-Niklas Voigt-Antons, Maximilian Warsinke, Werner Bailer, Georg Thallinger, Ben Howkins, Irma Poder, Maj Ruess, Daniel Asmar
Published in: Scientific Reports, Issue 15, 2025, ISSN 2045-2322
Publisher: Springer Science and Business Media LLC
DOI: 10.1038/S41598-025-17855-9

Reimagining Historical Exploration: Multi-User Mixed Reality Systems for Cultural Heritage Sites

Author(s): Agapi Chrysanthakopoulou; Theofilos Chrysikopoulos; Gerasimos Arvanitis; Konstantinos Moustakas
Published in: Applied Sciences, 2025, ISSN 2076-3417
Publisher: MPDI
DOI: 10.3390/APP15052854

ExpPoint-MAE: Better Interpretability and Performance for Self-Supervised Point Cloud Transformers

Author(s): Ioannis Romanelis, Vlassis Fotis, Konstantinos Moustakas, Adrian Munteanu
Published in: IEEE Access, Issue 12, 2024, ISSN 2169-3536
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/ACCESS.2024.3388155

Cooperative Saliency-Based Pothole Detection and AR Rendering for Increased Situational Awareness

Author(s): Gerasimos Arvanitis, Nikolaos Stagakis, Evangelia I. Zacharaki, Konstantinos Moustakas
Published in: IEEE Transactions on Intelligent Transportation Systems, 2023, ISSN 1524-9050
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TITS.2023.3327494

SHREC 2023: Point cloud change detection for city scenes

Author(s): Yang Gao, Honglin Yuan, Tao Ku, Remco C. Veltkamp, Georgios Zamanakos, Lazaros Tsochatzidis, Angelos Amanatiadis, Ioannis Pratikakis, Aliki Panou, Ioannis Romanelis, Vlassis Fotis, Gerasimos Arvanitis, Konstantinos Moustakas
Published in: Computers & Graphics, 2023, ISSN 0097-8493
Publisher: Pergamon Press Ltd.
DOI: 10.1016/j.cag.2023.06.025

Computers and Graphics

Author(s): Yang Gao; Honglin Yuan 0001; Tao Ku; Remco C. Veltkamp; Georgios Zamanakos; Lazaros T. Tsochatzidis; Angelos Amanatiadis; Ioannis Pratikakis; Aliki Panou; Ioannis Romanelis; Vlassis Fotis; Gerasimos Arvanitis; Konstantinos Moustakas
Published in: Computers & Graphics, 2023, ISSN 0097-8493
Publisher: Pergamon Press Ltd.
DOI: 10.1016/J.CAG.2023.06.025

IEEE Access

Author(s): Ioannis Romanelis; Vlassis Fotis; Konstantinos Moustakas; Adrian Munteanu 0001
Published in: IEEE Access, 2024, ISSN 2169-3536
Publisher: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.48550/ARXIV.2306.10798

H-SLAM: Hybrid direct–indirect visual SLAM

Author(s): Georges Younes, Douaa Khalil, John Zelek, Daniel Asmar
Published in: Robotics and Automonous Systems, 2024, ISSN 0921-8890
Publisher: Elsevier
DOI: 10.1016/j.robot.2024.104729

OSPC: Online Sequential Photometric Calibration

Author(s): Jawad Haidar, Douaa Khalil,, and Daniel C. Asmar
Published in: Pattern Recognition Letters, 2024, ISSN 0167-8655
Publisher: Elsevier BV
DOI: 10.1016/j.patrec.2024.03.005

Conference proceedings (23)

Deep 3D Geometric Saliency Estimation from Light Field Images

Author(s): Konstantinos Ntogkas; Gerasimos Arvanitis; Konstantinos Moustakas
Published in: 2023 24th International Conference on Digital Signal Processing (DSP), 2023, ISBN 979-8-3503-3959-8
Publisher: IEEE
DOI: 10.1109/dsp58604.2023.10167953

Data-efficient Domain Transfer for Instance Segmentations for AR Scenes

Author(s): Stefanie Onsori-Wechtitsch, Hermann Fürntratt, Hannes Fassold and Werner Bailer
Published in: Conference on Content-based Multimedia Indexing (CBMI), 2024
Publisher: IEEE

Leveraging Anisotropic Error for Robust Point Cloud Registration

Author(s): Efthymios Koukoulis, Gerasimos Arvanitis, Konstantinos Moustakas
Published in: 2025 25th International Conference on Digital Signal Processing (DSP), 2025
Publisher: IEEE
DOI: 10.1109/DSP65409.2025.11074865

Exploring users' sense of safety in public using an Augmented Reality application

Author(s): Vergari, Maurizio; Kojic, Tanja; Bertges, Nicole Stefanie; Vona, Francesco; Möller, Sebastian; Voigt-Antons, Jan-Niklas
Published in: 15th International Conference on Quality of Multimedia Experience (QoMEX), 2023, ISBN 979-8-3503-1173-0
Publisher: IEEE
DOI: 10.1109/QoMEX58391.2023.10178675

Inline Photometrically Calibrated Hybrid Visual SLAM

Author(s): Nicolas Abboud, Malak Sayour, Imad Elhajj, John S. Zelek, Daniel Asmar
Published in: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024
Publisher: IEEE

Aggressive saliency-aware point cloud compression

Author(s): Eleftheria Psatha, Dimitrios Laskos, Gerasimos Arvanitis, Konstantinos Moustakas
Published in: Proceedings of the 20th EuroXR International Conference, 2023, ISSN 2242-1211
Publisher: VTT
DOI: 10.32040/2242-122X.2023.T422

MGSO: Monocular Real-Time Photometric SLAM with Efficient 3D Gaussian Splatting

Author(s): Yan Song Hu; Nicolas Abboud; Muhammad Qasim Ali; Adam Srebrnjak Yang; Imad H. Elhajj; Daniel C. Asmar; Yuhao Chen 0001; John S. Zelek
Published in: 2025 IEEE International Conference on Robotics and Automation (ICRA), 2025
Publisher: IEEE
DOI: 10.48550/ARXIV.2409.13055

Digital Twins for Extended Reality Tourism: User Experience Evaluation Across User Groups

Author(s): Maximilian Warsinke, Francesco Vona, Tanja Kojić, Jan-Niklas Voigt-Antons, Sebastian Möller
Published in: Lecture Notes in Computer Science, Extended Reality, 2025
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-031-97769-5_3

Learning Scene Semantics from Vehicle-centric Data for City-scale Digital Twins

Author(s): Hermann Fürntratt, Stefanie Onsori-Wechtitsch, Werner Bailer, Isaac Agustí Ventura, Carles Sala Navarro, Aleksandar Jevtić and Jawad Haidar
Published in: Conference on Content-based Multimedia Indexing (CBMI), 2024
Publisher: IEEE

HAC-SLAM: Human Assisted Collaborative 3D-SLAM Through Augmented Reality

Author(s): Malak Sayour, Mohamad Karim Yassine, Nadim Dib, Imad H. Elhajj, Boulos Asmar, Elie Khoury, Daniel Asmar
Published in: IEEE International Conference on Robotics and Automation, 2024
Publisher: IEEE
DOI: 10.1109/ICRA57147.2024.10610377

Real-time shader-based shadow and occlusion rendering in AR

Author(s): Agapi Chrysanthakopoulou, Konstantinos Moustakas
Published in: 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2024, ISSN 2642-5254
Publisher: IEEE
DOI: 10.1109/VRW62533.2024.00281

HAL-NeRF: High Accuracy Localization Leveraging Neural Radiance Fields

Author(s): Asterios Reppas, Grigorios-Aris Cheimariotis, Panos K. Papadopoulos, Panagiotis Frasiolas, Dimitrios Zarpalas
Published in: 2025 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR), 2025
Publisher: IEEE
DOI: 10.1109/AIXVR63409.2025.00024

Training a Segmentation-Based Visual Anonymization Service for Street Scenes

Author(s): Martin Korb, Werner Bailer
Published in: Lecture Notes in Computer Science, MultiMedia Modeling, 2024
Publisher: Springer Nature Singapore
DOI: 10.1007/978-981-96-2074-6_26

Effect of External Characteristics of a Virtual Human Being During the Use of a Computer-Assisted Therapy Tool

Author(s): Ashrafi, Navid; Neuhaus, Vanessa; Vona, Francesco; Peperkorn, Nicolina Laura; Shiban, Youssef; Voigt-Antons, Jan-Niklas
Published in: International Conference on Human-Computer Interaction, 2024, ISBN 978-3-031-60428-7
Publisher: Springer Nature
DOI: 10.1007/978-3-031-60428-7_1

Investigating the impact of virtual element misalignment in collaborative Augmented Reality experiences

Author(s): Vona, Francesco; Hinzmann, Sina; Stern, Michael; Kojić, Tanja; Ashrafi, Navid; Grieshammer, David; Voigt-Antons, Jan-Niklas
Published in: 2024 16th International Conference on Quality of Multimedia Experience (QoMEX), 2024, ISBN 979-8-3503-6158-2
Publisher: IEEE
DOI: 10.1109/QoMEX61742.2024.10598298

Federated Learning for Lidar Super Resolution on Automotive Scenes

Author(s): Gkillas, Alexandros; Gerasimos, Arvanitis; Lalos, Aris; Moustakas, Konstantinos
Published in: 2023 24th International Conference on Digital Signal Processing (DSP), 2023
Publisher: IEEE
DOI: 10.1109/dsp58604.2023.10167942

The Impact of Social Environment and Interaction Focus on User Experience and Social Acceptability of an Augmented Reality Game

Author(s): Cocchia, Lorenzo; Vergari, Maurizio; Kojic, Tanja; Vona, Francesco; Moller, Sebastian; Garzotto, Franca; Voigt-Antons, Jan-Niklas
Published in: 16th International Conference on Quality of Multimedia Experience (QoMEX), 2024, ISBN 979-8-3503-6158-2
Publisher: IEEE
DOI: 10.1109/QoMEX61742.2024.10598279

GDNeRF: Generalizable Depth-based NeRF for sparse view synthesis

Author(s): Sergio Montoya de Paco, Ivan Huerta, Josep Escrig
Published in: 2025 IEEE International Conference on Multimedia and Expo (ICME), 2025
Publisher: IEEE
DOI: 10.1109/ICME59968.2025.11209482

An Investigation of the Influence of Ambient Noise on User Experience in Virtual Reality

Author(s): Kojić, Tanja; Vergari, Maurizio; Vona, Francesco; Möller, Sebastian; Voigt-Antons, Jan-Niklas
Published in: 15th International Conference on Quality of Multimedia Experience (QoMEX), 2023, ISBN 979-8-3503-1173-0
Publisher: IEEE
DOI: 10.1109/QoMEX58391.2023.10178532

Volumetric Video Reconstruction and Communications: Toward a New Era of Interactive and Immersive Social Virtual Reality (VR) Experiences

Author(s): Ivan Huerta, Leonel Toledo, Sergio Montoya, Marc Martos, Sergi Fernandez, Mario Montagud
Published in: IMXw '24: Proceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops, 2024
Publisher: ACM
DOI: 10.1145/3672406.3672421

Impact of spatial auditory navigation on user experience during augmented outdoor navigation tasks

Author(s): Voigt-Antons, Jan-Niklas; Sun, Zhirou; Vergari, Maurizio; Ashrafi, Navid; Vona, Francesco; Kojic, Tanja; 
Published in: DAGA 2023 - 49. JAHRESTAGUNG FÜR AKUSTIK, 2023
Publisher: Deutsche Gesellschaft für Akustik e.V.

Volumetric Video Reconstruction and Communications: Toward a New Era of Interactive and Immersive Social Virtual Reality (VR) Experiences

Author(s): Ivan Huerta, Leonel Toledo, Sergio Montoya, Marc Martos, Sergi Fernandez, Mario Montagud
Published in: Proceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops, 2025
Publisher: ACM
DOI: 10.1145/3672406.3672421

User-Centric Evaluation Methods for Digital Twin Applications in Extended Reality

Author(s): Francesco Vona, Maximilian Warsinke, Tanja Kojić, Jan-Niklas Voigt-Antons, Sebastian Möller
Published in: 2025 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR), 2025
Publisher: IEEE
DOI: 10.1109/AIXVR63409.2025.00028