Extended Reality For DisasteR management And Media plAnning

Información del proyecto

xR4DRAMA

Identificador del acuerdo de subvención: 952133

DOI

10.3030/952133

Proyecto cerrado

Fecha de la firma de la CE 8 Mayo 2020

Fecha de inicio 1 Noviembre 2020

Fecha de finalización 30 Abril 2023

Financiado con arreglo a

• INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Coste total

€ 2 318 500,00

Aportación de la UE

€ 1 999 450,00

Coordinado por

ETHNIKO KENTRO EREVNAS KAI TECHNOLOGIKIS ANAPTYXIS
Greece

CORDIS proporciona enlaces a los documentos públicos y las publicaciones de los proyectos de los programas marco HORIZONTE.

Los enlaces a los documentos y las publicaciones de los proyectos del Séptimo Programa Marco, así como los enlaces a algunos tipos de resultados específicos, como conjuntos de datos y «software», se obtienen dinámicamente de OpenAIRE .

Resultado final

Demonstrators, pilots, prototypes (23)

Stress level detection techniques v1

Initial version of the body sensordriven and acoustic signaldriven techniques for the detection of the stress level of a given subject as well as the presentation of the ensemble model formed by both types of techniques

Multi-sourced 3D reconstruction of outdoors spaces

Tools for 3D reconstruction of exterior spaces based on multiple input sources

Semantic representation, fusion and reasoning-based decision support system for situation awareness v2

Updated deliverable for the design and implementation of the semantic representation framework and models to encode the knowledge and deploy mechanisms for semantic integration of information from heterogeneous sources into the ontologies. Implementation of the DSS.

VR authoring tool v2

Final authoring tool for interactive VR environments of the use cases.

Sensor data analysis for situation awareness v2

This is the updated version of the deliverable that will describe the smart wearables sensors analysis techniques for activity recognition.

Spoken and written language analysis techniques v1

Initial version of the automatic speech recognition and written language analysis techniques accompanied by an outline of their design and functionality

Outdoors localization algorithms & tools v1

Initial version of exterior localization algorithms tools

Semantic representation, fusion and reasoning-based decision support system for situation awareness v1

Deliverable for the initial design and implementation of the semantic representation framework and models to encode the knowledge and deploy mechanisms for semantic integration of information from heterogeneous sources into the ontologies Implementation of the DSS

Prototypes and mobile development v1

This iterative deliverable will document the different development phases of xR4DRAMA platform and its architecture GIS system xR environment and awareness apps

Sensor data analysis for situation awareness v1

This deliverable will describe the smart wearables sensors analysis techniques for activity recognition

Multilingual information generation techniques v2

Final version of the multilingual information generation techniques that will cover all three xR4DRAMA languages English German and Italian

Evaluation of the 1st prototype and updated user requirements

This deliverable will describe the methodology, process and results of the evaluation of the first prototype and the use cases implementation. It will also include a refined set of user requirements where needed, based on the outcome of the evaluation of the first prototype.

Prototypes and mobile development v2

This is the updated version of the iterative deliverable that will document the different development phases of xR4DRAMA platform and its architecture, GIS system, xR environment and awareness apps.

VR authoring tool v1

Initial authoring tool for interactive VR environments of the use cases

Spoken and written language analysis techniques v2

Updated version of the automatic speech recognition and written language analysis techniques, accompanied by an outline of their design and functionality.

AR interactive environment and applications v2

Updated version of the AR visualizations, uninterrupted navigation and scene understanding techniques.

Stress level detection techniques v2

Updated version of the body sensor-driven and acoustic signal-driven techniques for the detection of the stress level of a given subject as well as the presentation of the ensemble model, formed by both types of techniques.

AR interactive environment and applications

Initial version of the AR visualizations uninterrupted navigation and scene understanding techniques

Multilingual information generation techniques

Initial version of the multilingual information generation techniques that will cover all three xR4DRAMA languages English German and Italian

Final system evaluation

This deliverable will describe the methodology, process and results of the final prototype evaluation.

Outdoors localization algorithms & tools v2

Updated version of exterior localization algorithms & tools

VR environment and collaborative tools v2

Final VR application enabling collaborative presence of multiple actors.

VR environment and collaborative tools v1

Initial VR application enabling collaborative presence of multiple actors

Documents, reports (7)

Pilot use cases and initial user requirements

This deliverable will describe the initial pilot use cases as well as the user requirements with regard to the two pilot use cases It will also include a short outline of the requirements evaluationpriorisation methodology

Roadmap towards the implementation of the xR4DRAMA platform

D51 will provide the time plan for the development of the xR4DRAMA platform It will specify the functionality of the modules that will be developed within xR4DRAMA and of the platform as a whole In addition it will provide the specifications for the technical infrastructure and a detailed description of the resources needed to achieve the aforementioned functionality

Technical requirements and architecture

This deliverable contains the technical requirements that will be taken into account during the implementation of the xR4DRAMA platform In addition it describes the functionalities that will be supported by the platform The deliverable will also present the UI and UX prototypes that are going to be deployed for xR4DRAMA purposes Finally it outlines the system architecture that will be used for the implementation of the platform prototypes

Report on dissemination, collaboration and standardization activities

This deliverable will present the initial and updated version of the projects report on the undertaken dissemination collaboration and standardization activities The updated version will also include the public showcase of the project results T75

Final user requirements

This deliverable will describe the prioritized and refined user requirements with regard to the two pilot use cases

Dissemination and communication strategy

This deliverable presents the initial dissemination plan of the project and the creation of the projects communication material eg project identity website flyers presence in social media presentations etc Participation in conferences and workshops are being planned KPIs for all activities will be developed

xR4DRAMA Ethics Guide

This report will act as a guidance for the xR4DRAMA consortium towards compliance with the EU data protection rules and ethical principles

Open Research Data Pilot (1)

Public final activity report and final self-assessment

This deliverable will contain i the consortium presentation and the objectives of xR4DRAMA ii a summary of the project results iii the management of the data generated in xR4DRAMA iv the assessment against the performance indicators defined in D12 and v the impact achieved by the project

Publicaciones

Conference proceedings (12)

How much pretraining data do language models need to learn syntax?

Autores: P��rez-Mayos, Laura; Ballesteros, Miguel; Wanner, Leo
Publicado en: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Edición 1, 2021
Editor: Association for Computational Linguistics
DOI: 10.48550/arxiv.2109.03160

Another PASS: A reproduction study of the human evaluation of a football report generation system.

Autores: Simon Mille, Thiago Castro Ferreira, Anya Belz, Brian Davis
Publicado en: In Proceedings of the 14th International Conference on Natural Language Generation, 2021, Página(s) 286-292
Editor: Association for Computational Linguistics

xR4DRAMA: Enhancing situation awareness using immersive (XR) technologies.

Autores: S. Symeonidis, S. Diplaris, N. Heise, T. Pistola, A. Tsanousa, G. Tzanetis, E. Batziou, C. Stentoumis, I. Kalisperakis, S. Freitag, Y. Shekhawat, R. Paradiso, M. Pacelli, J. Codina, S. Mille, M. Marimon, M. Ferri, D. Norbiato, M. Monego, A. Karakostas, S. Vrochidis
Publicado en: In 2021 IEEE International Conference on Intelligent Reality (ICIR), 2021, Página(s) pp. 1-8, ISBN 978-1-6654-0347-4
Editor: IEEE
DOI: 10.1109/icir51845.2021.00010

Human Activity Recognition with IMU and Vital Signs Feature Fusion.

Autores: Vasileios-Rafail Xefteris, Athina Tsanousa, Thanassis Mavropoulos, Georgios Meditskos, Stefanos Vrochidis, and Ioannis Kompatsiaris
Publicado en: In MultiMedia Modeling: 28th International Conference, MMM 2022, Edición Lecture Notes in Computer Science, vol 13141, 2022, Página(s) 287-298, ISBN 978-3-030-98358-1
Editor: Cham: Springer International Publishing
DOI: 10.1007/978-3-030-98358-1_23

Low-Light Image Enhancement Based on U-Net and Haar Wavelet Pooling.

Autores: Batziou, E., Ioannidis, K., Patras, I., Vrochidis, S., & Kompatsiaris, I.
Publicado en: In MultiMedia Modeling: 29th International Conference, MMM 2023, Edición Proceedings, Part II, 2023, Página(s) 510-522
Editor: Cham: Springer Nature

Sentiment analysis on 2D images of urban and indoor spaces using deep learning architectures.

Autores: Chatzistavros, K., Pistola, T., Diplaris, S., Ioannidis, K., Vrochidis, S., & Kompatsiaris, I.
Publicado en: In Proceedings of the 19th International Conference on Content-based Multimedia Indexing, 2022, Página(s) 43-49, ISBN 978-1-4503-9720-9
Editor: Association for Computing Machinery
DOI: 10.1145/3549555.3549575

Stress detection based on wearable physiological sensors: Laboratory and real-life pilot scenario application.

Autores: Xefteris, V. R., Tsanousa, A., Symeonidis, S., Diplaris, S., Zaffanela, F., Monego, M., ... & Kompatsiaris, I. (2023)
Publicado en: SIGNAL 2023 : The Eighth International Conference on Advances in Signal, Image and Video Processing, 2023, ISBN 978-1-68558-057-5
Editor: IARIA

XR4DRAMA Knowledge Graph: A Knowledge Graph for Disaster Management.

Autores: Vassiliades, A., Symeonidis, S., Diplaris, S., Tzanetis, G., Vrochidis, S., Bassiliades, N., & Kompatsiaris, I.
Publicado en: In 2023 IEEE 17th International Conference on Semantic Computing (ICSC), 2023
Editor: IEEE
DOI: 10.5281/zenodo.7456917

Machine learning techniques and Big Data analysis for flood risk management, assessment of droughts and other extreme climate events: different approaches.

Autores: Ferri, M., Lombardo, F., Norbiato, D., Fiorin, R., Monego, M., & Napolitano, L.
Publicado en: In Workshop on Statistical Hydrology, Edición Vol. 17, 2022, Página(s) p. 20
Editor: STAHY2022

Text-in-context: Token-level error detection for table-to-text generation.

Autores: Kasner, Z., Mille, S., & Dušek, O.
Publicado en: In Proceedings of the 14th International Conference on Natural Language Generation, 2021, Página(s) 259-265
Editor: Association for Computational Linguistics

Assessing the Syntactic Capabilities of Transformer-based Multilingual Language Models.

Autores: Laura Pérez-Mayos, Alba Táboas García, Simon Mille, Leo Wanner
Publicado en: In: Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, 2021
Editor: Association for Computational Linguistics
DOI: 10.18653/v1/2021.findings-acl.333

XR4DRAMA Knowledge Graph: A Knowledge Graph for Media Planning.

Autores: Vassiliades, A., Symeonidis, S., Diplaris, S., Tzanetis, G., Vrochidis, S. & Kompatsiaris, I. (2023).
Publicado en: In Proceedings of the 15th International Conference on Agents and Artificial Intelligence, Edición Volume 3, 2022
Editor: ICAART
DOI: 10.5281/zenodo.7437308

Peer reviewed articles (4)

An Extended Reality system for situation awareness in flood management and media production planning.

Autores: Symeonidis, S., Samaras, S., Stentoumis, C., Plaum, A., … & Vrochidis, S.
Publicado en: Electronics, 2023, ISSN 2079-9292
Editor: MDPI
DOI: 10.3390/electronics12122569

Assessing Virtual Reality Spaces for Elders Using Image-Based Sentiment Analysis and Stress Level Detection.

Autores: Kosti, M. V., Georgakopoulou, N., Diplaris, S., Pistola, T., Chatzistavros, K., Xefteris, V. R., ... & Kompatsiaris, I.
Publicado en: Sensors, Edición 23(8), 2023, ISSN 1424-8220
Editor: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/s23084130

Stress detection based on physiological sensor and audio signals, and a late fusion framework: An experimental study and public dataset

Autores: Xefteris V , Dominguez M , Grivolla J , Tsanousa A , Zaffanela F , Monego M , Symeonidis S , Diplaris S , Wanner L , Vrochidis S , Kompatsiaris I
Publicado en: Scientific Reports, 2023, ISSN 2045-2322
Editor: Nature Publishing Group
DOI: 10.21203/rs.3.rs-2877621/v1

XR4DRAMA a knowledge-based system for disaster management and media planning

Autores: Vassiliades, A., Stathopoulos-Kampilis, G., Antzoulatos, G. , Symeonidis, S., Diplaris, S., Tzanetis, G., Vrochidis, S., Bassiliades, N., & Kompatsiaris, I.
Publicado en: The Knowledge Engineering Review, 2023, ISSN 1469-8005
Editor: Cambridge University Press