DIgital DYnaMic and respOnsible twinS for XR

Livrables

D4.1: Localisation, mapping and rendering methods v1

Initial release of the algorithms for localisation & mapping and content adaptation and rendering. A subset of the components will be ready for initial integration, for the others independent assessment results will be provided.

D3.1: Capture, reconstruction, synchronisation and scene understanding methods v1

Initial release of the algorithms for capturing, reconstructing and analysing the scene and keeping it in sync from heterogeneous inputs. A subset of the components will be ready for initial integration, for the others independent assessment results will be provided.

D2.1: Requirements and validation methods v1

Initial release of the algorithms for capturing, reconstructing and analysing the scene and keeping it in sync from heterogeneous inputs. A subset of the components will be ready for initial integration, for the others independent assessment results will be provided.

D1.2 Data management plan

The data management plan will define how the various kinds of data collected and generated in the project will be handled and stored. It sets the requirements for the data store in terms of data security and privacy protection. It will be maintained as a living document.

Publications

MaskUno: Switch-Split Block For Enhancing Instance Segmentation

Auteurs: Jawad Haidar; Marc Mouawad; Imad H. Elhajj; Daniel C. Asmar
Publié dans: CoRR, 2024, ISSN 2331-8422
Éditeur: CoRR
DOI: 10.48550/ARXIV.2407.21498

Interactive digital twins enabling responsible extended reality applications

Auteurs: Maya Antoun, Imad H. Elhajj, Malak Sayour, Panos K. Papadopoulos, Dimitrios Zarpalas, Anthony Rizk, ABM Tariqul Islam, Ivan Huerta, Leonel Toledo, Gerasimos Arvanitis, Konstantinos Moustakas, Aleksandar Jevtić, Isaac Agustí, Francesco Vona, Jan-Niklas Voigt-Antons, Maximilian Warsinke, Werner Bailer, Georg Thallinger, Ben Howkins, Irma Poder, Maj Ruess, Daniel Asmar
Publié dans: Scientific Reports, Numéro 15, 2025, ISSN 2045-2322
Éditeur: Springer Science and Business Media LLC
DOI: 10.1038/S41598-025-17855-9

Urban scene removal and completion

Auteurs: Ignasi Mas, Josep Brugues, SErgi Mercade, Leonel Toledo, Mario Montagud, Jesus Alonso-Zarate, Josep Escrig, Ivan Huerta
Publié dans: Frontiers in Artificial Intelligence and Applications, ISSN 1879-8314
Éditeur: IOS Press
DOI: 10.3233/FAIA250603

Reimagining Historical Exploration: Multi-User Mixed Reality Systems for Cultural Heritage Sites

Auteurs: Agapi Chrysanthakopoulou; Theofilos Chrysikopoulos; Gerasimos Arvanitis; Konstantinos Moustakas
Publié dans: Applied Sciences, 2025, ISSN 2076-3417
Éditeur: MPDI
DOI: 10.3390/APP15052854

Visual localization using implicit representations and particle filtering-based pose refinement

Auteurs: Aris Griorios Cheimariotis, Dimitrios Zarpalas
Publié dans: IEEE Access, ISSN 2169-3536
Éditeur: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.5281/ZENODO.18468790

ExpPoint-MAE: Better Interpretability and Performance for Self-Supervised Point Cloud Transformers

Auteurs: Ioannis Romanelis, Vlassis Fotis, Konstantinos Moustakas, Adrian Munteanu
Publié dans: IEEE Access, Numéro 12, 2024, ISSN 2169-3536
Éditeur: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/ACCESS.2024.3388155

Cooperative Saliency-Based Pothole Detection and AR Rendering for Increased Situational Awareness

Auteurs: Gerasimos Arvanitis, Nikolaos Stagakis, Evangelia I. Zacharaki, Konstantinos Moustakas
Publié dans: IEEE Transactions on Intelligent Transportation Systems, 2023, ISSN 1524-9050
Éditeur: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TITS.2023.3327494

SHREC 2023: Point cloud change detection for city scenes

Auteurs: Yang Gao, Honglin Yuan, Tao Ku, Remco C. Veltkamp, Georgios Zamanakos, Lazaros Tsochatzidis, Angelos Amanatiadis, Ioannis Pratikakis, Aliki Panou, Ioannis Romanelis, Vlassis Fotis, Gerasimos Arvanitis, Konstantinos Moustakas
Publié dans: Computers & Graphics, 2023, ISSN 0097-8493
Éditeur: Pergamon Press Ltd.
DOI: 10.1016/j.cag.2023.06.025

H-SLAM: Hybrid direct–indirect visual SLAM

Auteurs: Georges Younes, Douaa Khalil, John Zelek, Daniel Asmar
Publié dans: Robotics and Automonous Systems, 2024, ISSN 0921-8890
Éditeur: Elsevier
DOI: 10.1016/j.robot.2024.104729

OSPC: Online Sequential Photometric Calibration

Auteurs: Jawad Haidar, Douaa Khalil,, and Daniel C. Asmar
Publié dans: Pattern Recognition Letters, 2024, ISSN 0167-8655
Éditeur: Elsevier BV
DOI: 10.1016/j.patrec.2024.03.005

Cooperative Perception for Digital Twin Reconstruction*

Auteurs: Leonel Toledo, Ivan Huerta, Eric Casadella, Ignasi Mas, Maya Antoun, Wissam Tedros, Daniel Asmar, Gerasimos Arvanitis, Konstantinos Moustakas, Efthymios Koukoulis, Aleksandar Jevtic, Romain Guesdon, Alberto Lara, Sergi Fernandez
Publié dans: 2025 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR), 2025
Éditeur: IEEE
DOI: 10.1109/AIXVR63409.2025.00023

Data-efficient Domain Transfer for Instance Segmentations for AR Scenes

Auteurs: Stefanie Onsori-Wechtitsch, Hermann Fürntratt, Hannes Fassold and Werner Bailer
Publié dans: Conference on Content-based Multimedia Indexing (CBMI), 2024
Éditeur: IEEE

Leveraging Anisotropic Error for Robust Point Cloud Registration

Auteurs: Efthymios Koukoulis, Gerasimos Arvanitis, Konstantinos Moustakas
Publié dans: 2025 25th International Conference on Digital Signal Processing (DSP), 2025
Éditeur: IEEE
DOI: 10.1109/DSP65409.2025.11074865

Exploring users' sense of safety in public using an Augmented Reality application

Auteurs: Vergari, Maurizio; Kojic, Tanja; Bertges, Nicole Stefanie; Vona, Francesco; Möller, Sebastian; Voigt-Antons, Jan-Niklas
Publié dans: 15th International Conference on Quality of Multimedia Experience (QoMEX), 2023, ISBN 979-8-3503-1173-0
Éditeur: IEEE
DOI: 10.1109/QoMEX58391.2023.10178675

Deep 3D Geometric Saliency Estimation from Light Field Images

Auteurs: Konstantinos Ntogkas, Gerasimos Arvanitis, Konstantinos Moustakas
Publié dans: 2023 24th International Conference on Digital Signal Processing (DSP), 2023
Éditeur: IEEE
DOI: 10.1109/DSP58604.2023.10167953

Inline Photometrically Calibrated Hybrid Visual SLAM

Auteurs: Nicolas Abboud, Malak Sayour, Imad Elhajj, John S. Zelek, Daniel Asmar
Publié dans: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024
Éditeur: IEEE

Aggressive saliency-aware point cloud compression

Auteurs: Eleftheria Psatha, Dimitrios Laskos, Gerasimos Arvanitis, Konstantinos Moustakas
Publié dans: Proceedings of the 20th EuroXR International Conference, 2023, ISSN 2242-1211
Éditeur: VTT
DOI: 10.32040/2242-122X.2023.T422

Visual Localization in Complex Environments: Merging Traditional Geometry with Learning-Based Techniques

Auteurs: Manfred Klopschitz, Gerald Lodron, Romain Guesdon, Aleksandar Jevtić, Werner Bailer
Publié dans: 2025 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR), 2025
Éditeur: IEEE
DOI: 10.1109/AIXVR63409.2025.00022

MGSO: Monocular Real-Time Photometric SLAM with Efficient 3D Gaussian Splatting

Auteurs: Yan Song Hu; Nicolas Abboud; Muhammad Qasim Ali; Adam Srebrnjak Yang; Imad H. Elhajj; Daniel C. Asmar; Yuhao Chen 0001; John S. Zelek
Publié dans: 2025 IEEE International Conference on Robotics and Automation (ICRA), 2025
Éditeur: IEEE
DOI: 10.48550/ARXIV.2409.13055

Digital Twins for Extended Reality Tourism: User Experience Evaluation Across User Groups

Auteurs: Maximilian Warsinke, Francesco Vona, Tanja Kojić, Jan-Niklas Voigt-Antons, Sebastian Möller
Publié dans: Lecture Notes in Computer Science, Extended Reality, 2025
Éditeur: Springer Nature Switzerland
DOI: 10.1007/978-3-031-97769-5_3

Perception for Connected Autonomous Vehicles under Adverse Weather Conditions

Auteurs: Dimitra Tsakmakopoulou, Konstantinos Moustakas
Publié dans: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Éditeur: IEEE
DOI: 10.1109/IROS58592.2024.10801295

Learning Scene Semantics from Vehicle-centric Data for City-scale Digital Twins

Auteurs: Hermann Fürntratt, Stefanie Onsori-Wechtitsch, Werner Bailer, Isaac Agustí Ventura, Carles Sala Navarro, Aleksandar Jevtić and Jawad Haidar
Publié dans: Conference on Content-based Multimedia Indexing (CBMI), 2024
Éditeur: IEEE

HINT-3D: Human-in-the-Loop Interactive Test-Time Adaptation for 3D Segmentation

Auteurs: Oday Jamaleddine, Daniel Asmar, and Imad H. Elhajj
Publié dans: International Conference on Robotics and Automation
Éditeur: IEEE
DOI: 10.5281/ZENODO.18491843

HAC-SLAM: Human Assisted Collaborative 3D-SLAM Through Augmented Reality

Auteurs: Malak Sayour, Mohamad Karim Yassine, Nadim Dib, Imad H. Elhajj, Boulos Asmar, Elie Khoury, Daniel Asmar
Publié dans: IEEE International Conference on Robotics and Automation, 2024
Éditeur: IEEE
DOI: 10.1109/ICRA57147.2024.10610377

Real-time shader-based shadow and occlusion rendering in AR

Auteurs: Agapi Chrysanthakopoulou, Konstantinos Moustakas
Publié dans: 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2024, ISSN 2642-5254
Éditeur: IEEE
DOI: 10.1109/VRW62533.2024.00281

HAL-NeRF: High Accuracy Localization Leveraging Neural Radiance Fields

Auteurs: Asterios Reppas, Grigorios-Aris Cheimariotis, Panos K. Papadopoulos, Panagiotis Frasiolas, Dimitrios Zarpalas
Publié dans: 2025 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR), 2025
Éditeur: IEEE
DOI: 10.1109/AIXVR63409.2025.00024

Training a Segmentation-Based Visual Anonymization Service for Street Scenes

Auteurs: Martin Korb, Werner Bailer
Publié dans: Lecture Notes in Computer Science, MultiMedia Modeling, 2024
Éditeur: Springer Nature Singapore
DOI: 10.1007/978-981-96-2074-6_26

Effect of External Characteristics of a Virtual Human Being During the Use of a Computer-Assisted Therapy Tool

Auteurs: Ashrafi, Navid; Neuhaus, Vanessa; Vona, Francesco; Peperkorn, Nicolina Laura; Shiban, Youssef; Voigt-Antons, Jan-Niklas
Publié dans: International Conference on Human-Computer Interaction, 2024, ISBN 978-3-031-60428-7
Éditeur: Springer Nature
DOI: 10.1007/978-3-031-60428-7_1

Investigating the impact of virtual element misalignment in collaborative Augmented Reality experiences

Auteurs: Vona, Francesco; Hinzmann, Sina; Stern, Michael; Kojić, Tanja; Ashrafi, Navid; Grieshammer, David; Voigt-Antons, Jan-Niklas
Publié dans: 2024 16th International Conference on Quality of Multimedia Experience (QoMEX), 2024, ISBN 979-8-3503-6158-2
Éditeur: IEEE
DOI: 10.1109/QoMEX61742.2024.10598298

Federated Learning for Lidar Super Resolution on Automotive Scenes

Auteurs: Gkillas, Alexandros; Gerasimos, Arvanitis; Lalos, Aris; Moustakas, Konstantinos
Publié dans: 2023 24th International Conference on Digital Signal Processing (DSP), 2023
Éditeur: IEEE
DOI: 10.1109/dsp58604.2023.10167942

The Impact of Social Environment and Interaction Focus on User Experience and Social Acceptability of an Augmented Reality Game

Auteurs: Cocchia, Lorenzo; Vergari, Maurizio; Kojic, Tanja; Vona, Francesco; Moller, Sebastian; Garzotto, Franca; Voigt-Antons, Jan-Niklas
Publié dans: 16th International Conference on Quality of Multimedia Experience (QoMEX), 2024, ISBN 979-8-3503-6158-2
Éditeur: IEEE
DOI: 10.1109/QoMEX61742.2024.10598279

GDNeRF: Generalizable Depth-based NeRF for sparse view synthesis

Auteurs: Sergio Montoya de Paco, Ivan Huerta, Josep Escrig
Publié dans: 2025 IEEE International Conference on Multimedia and Expo (ICME), 2025
Éditeur: IEEE
DOI: 10.1109/ICME59968.2025.11209482

HAME-NeRF: High Accuracy Mesh Extraction Leveraging Neural Radiance Fields

Auteurs: Panagiotis Frasiolas, Grigorios-Aris Cheimariotis, Panos K. Papadopoulos, Dimitrios Zarpalas
Publié dans: Lecture Notes in Computer Science, Computer Analysis of Images and Patterns, 2025
Éditeur: Springer Nature Switzerland
DOI: 10.1007/978-3-032-04968-1_28

An Investigation of the Influence of Ambient Noise on User Experience in Virtual Reality

Auteurs: Kojić, Tanja; Vergari, Maurizio; Vona, Francesco; Möller, Sebastian; Voigt-Antons, Jan-Niklas
Publié dans: 15th International Conference on Quality of Multimedia Experience (QoMEX), 2023, ISBN 979-8-3503-1173-0
Éditeur: IEEE
DOI: 10.1109/QoMEX58391.2023.10178532

Impact of spatial auditory navigation on user experience during augmented outdoor navigation tasks

Auteurs: Voigt-Antons, Jan-Niklas; Sun, Zhirou; Vergari, Maurizio; Ashrafi, Navid; Vona, Francesco; Kojic, Tanja;
Publié dans: DAGA 2023 - 49. JAHRESTAGUNG FÜR AKUSTIK, 2023
Éditeur: Deutsche Gesellschaft für Akustik e.V.

Volumetric Video Reconstruction and Communications: Toward a New Era of Interactive and Immersive Social Virtual Reality (VR) Experiences

Auteurs: Ivan Huerta, Leonel Toledo, Sergio Montoya, Marc Martos, Sergi Fernandez, Mario Montagud
Publié dans: Proceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops, 2025
Éditeur: ACM
DOI: 10.1145/3672406.3672421

User-Centric Evaluation Methods for Digital Twin Applications in Extended Reality

Auteurs: Francesco Vona, Maximilian Warsinke, Tanja Kojić, Jan-Niklas Voigt-Antons, Sebastian Möller
Publié dans: 2025 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR), 2025
Éditeur: IEEE
DOI: 10.1109/AIXVR63409.2025.00028

Livrables

Publications

Partager cette page Partager cette page sur les réseaux sociaux

Télécharger Télécharger le contenu de la page