Socially-acceptable Extended Reality Models and Systems

Projektinformationen

SERMAS

ID Finanzhilfevereinbarung: 101070351

DOI

10.3030/101070351

Projekt abgeschlossen

EK-Unterschriftsdatum 20 Juni 2022

Startdatum 1 Oktober 2022

Enddatum 31 Oktober 2025

Finanziert unter

• Digital, Industry and Space

Gesamtkosten

€ 4 444 228,75

EU-Beitrag

€ 4 444 228,75

Koordiniert durch

UNIVERSITA DEGLI STUDI DI MODENA E REGGIO EMILIA
Italy

CORDIS bietet Links zu öffentlichen Ergebnissen und Veröffentlichungen von HORIZONT-Projekten.

Links zu Ergebnissen und Veröffentlichungen von RP7-Projekten sowie Links zu einigen Typen spezifischer Ergebnisse wie Datensätzen und Software werden dynamisch von OpenAIRE abgerufen.

Leistungen

Documents, reports (5)

Periodic progress report for Year 1

Periodic progress report for Year 1.This deliverable will include a section detailing the ethical and legal framework and current compliance of project activities.

Characterization of human mechanisms in interaction processes
Project presentation

Project presentation (includes logo and website, which will be updated regularly)

Specification of nonverbal communication software interface
Results of environment digitalization

Data Management Plan (1)

Data management plan

Data management plan (updated regularly)

Other (2)

Dialogue system capable of handling natural language inputs and outputs
First interim release of the nonverbal communication software module

Data sets, microdata, etc (1)

Datasets suitable for training, validation, and testing of modules, along with infrastructure to support data collection/processing

Websites, patent fillings, videos etc. (1)

SERMAS website

The SERMAS website will be updated regularly, until the end of the project (M36)

Veröffentlichungen

Conference proceedings (22)

Dior-CVAE: Pre-trained Language Models and Diffusion Priors for Variational Dialog Generation

Autoren: Tianyu Yang, Thy Tran, Iryna Gurevych
Veröffentlicht in: Findings of the Association for Computational Linguistics: EMNLP 2023, 2023
Herausgeber: Association for Computational Linguistics
DOI: 10.18653/V1/2023.FINDINGS-EMNLP.313

The KCL-SAIR team's entry to the GENEA Challenge 2023 Exploring Role-based Gesture Generation in Dyadic Interactions: Listener vs. Speaker

Autoren: Viktor Schmuck, Nguyen Tan Viet Tuyen, Oya Celiktutan
Veröffentlicht in: International Cconference on Multimodal Interaction, 2025
Herausgeber: ACM
DOI: 10.1145/3610661.3616555

A Mixed Reality System for Interaction with Heterogeneous Robotic Systems

Autoren: Valeria Villani, Beatrice Capelli, Lorenzo Sabattini
Veröffentlicht in: 2023 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 2024
Herausgeber: IEEE
DOI: 10.1109/SMC53992.2023.10394172

The KCL-SAIR team's entry to the GENEA Challenge 2023 / Exploring Role-based Gesture Generation in Dyadic Interactions: Listener vs. Speaker

Autoren: Viktor Schmuck, Nguyen Tan Viet Tuyen, Oya Celiktutan
Veröffentlicht in: ICMI2023, 2023
Herausgeber: n/a
DOI: 10.1145/3610661.3616555

User Identification Procedures with Human Mutations: Formal Analysis and Pilot Study

Autoren: Quamara, Megha; Viganò, Luca
Veröffentlicht in: 2025 IEEE 22nd International Conference on Software Architecture Companion (ICSA-C), 2025
Herausgeber: IEEE
DOI: 10.5281/ZENODO.15168197

MASSXR 2025: The 3^rd Workshop on Multi-modal Affective and Social Behavior Analysis and Synthesis in Extended Reality (Affiliated with IEEE VR 2025)

Autoren: Megha Quamara, Oya Celiktutan, Luca Viganò, Aniket Bera, Pablo Cesar, Funda Durupinar, Aline Normoyle, Chirag Raman, Zerrin Yumak
Veröffentlicht in: 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2025
Herausgeber: IEEE
DOI: 10.1109/VRW66409.2025.00066

Exploring the most significant features for EEG ErrP detection through statistical analysis

Autoren: Alessandra Fava, Valeria Villani, Lorenzo Sabattini
Veröffentlicht in: 2024 33rd IEEE International Conference on Robot and Human Interactive Communication (ROMAN), 2024
Herausgeber: IEEE
DOI: 10.1109/RO-MAN60168.2024.10731260

Predicting the Intention to Interact with a Service Robot: the Role of Gaze Cues

Autoren: Simone Arreghini, Gabriele Abbate, Alessandro Giusti, Antonio Paolillo
Veröffentlicht in: 2024 IEEE International Conference on Robotics and Automation (ICRA), 2024
Herausgeber: IEEE
DOI: 10.1109/ICRA57147.2024.10610289

The Devil is in the Details: On Models and Training Regimes for Few-Shot Intent Classification

Autoren: Mohsen Mesgar, Thy Thy Tran, Goran Glavaš, Iryna Gurevych
Veröffentlicht in: Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, 2023
Herausgeber: n/a
DOI: 10.18653/V1/2023.EACL-MAIN.135

CBF-Based Motion Planning for Socially Responsible Robot Navigation Guaranteeing STL Specification^*

Autoren: Andrea Ruo, Lorenzo Sabattini, Valeria Villani
Veröffentlicht in: 2024 European Control Conference (ECC), 2024
Herausgeber: IEEE
DOI: 10.23919/ECC64448.2024.10591282

Challenges in Detecting and Analyzing EEG Error-Related Potentials: Lessons from a Case Study in HRI

Autoren: Alessandra Fava, Adriana Lucchese, Roberto Meattini, Gianluca Palli, Valeria Villani, Lorenzo Sabattini
Veröffentlicht in: 2024 33rd IEEE International Conference on Robot and Human Interactive Communication (ROMAN), 2024
Herausgeber: IEEE
DOI: 10.1109/RO-MAN60168.2024.10731468

The Devil is in the Details: On Models and Training Regimes for Few-Shot Intent Classification

Autoren: Mohsen Mesgar, Thy Thy Tran, Goran Glavaš, Iryna Gurevych
Veröffentlicht in: Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, 2023
Herausgeber: Association for Computational Linguistics
DOI: 10.18653/V1/2023.EACL-MAIN.135

Learning from Implicit User Feedback, Emotions and Demographic Information in Task-Oriented and Document-Grounded Dialogues

Autoren: Dominic Petrak, Thy Thy Tran, Iryna Gurevych
Veröffentlicht in: Findings of the Association for Computational Linguistics: EMNLP 2024, 2024
Herausgeber: Association for Computational Linguistics
DOI: 10.18653/V1/2024.FINDINGS-EMNLP.264

Learning From Free-Text Human Feedback – Collect New Datasets Or Extend Existing Ones?

Autoren: Dominic Petrak, Nafise Moosavi, Ye Tian, Nikolai Rozanov, Iryna Gurevych
Veröffentlicht in: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023
Herausgeber: Association for Computational Linguistics
DOI: 10.18653/V1/2023.EMNLP-MAIN.1011

Con Instruction: Universal Jailbreaking of Multimodal Large Language Models via Non-Textual Modalities

Autoren: Jiahui Geng, Thy Thy Tran, Preslav Nakov, Iryna Gurevych
Veröffentlicht in: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025
Herausgeber: Association for Computational Linguistics
DOI: 10.18653/V1/2025.ACL-LONG.146

AGV Traffic Management in Automated Industrial Plants: An Enhanced Lifelong Multi-Agent Path Finding Approach

Autoren: Alessandro Bonetti, Silvia Proia, Simone Guidetti, Lorenzo Sabattini
Veröffentlicht in: 2024 IEEE 20th International Conference on Automation Science and Engineering (CASE), 2024
Herausgeber: IEEE
DOI: 10.1109/CASE59546.2024.10711842

Hearing the Robot’s Mind: Sonification for Explicit Feedback in Human-Robot Interaction

Autoren: Simone Arreghini, Antonio Paolillo, Gabriele Abbate, Alessandro Giusti
Veröffentlicht in: Springer Proceedings in Advanced Robotics, Human-Friendly Robotics 2024, 2025
Herausgeber: Springer
DOI: 10.1007/978-3-031-81688-8_4

Gesticulating with NAO: Real-time Context-Aware Co-Speech Gesture Generation for Human-Robot Interaction

Autoren: Nguyen Tan Viet Tuyen, Viktor Schmuck, Oya Celiktutan
Veröffentlicht in: ICMI2023, 2023
Herausgeber: Association for Computing MachineryNew YorkNYUnited States
DOI: 10.1145/3610661.3620664

A Mixed Reality System for Interaction with Heterogeneous Robotic Systems

Autoren: Valeria Villani, Beatrice Capelli, Lorenzo Sabattini
Veröffentlicht in: SMC2023, 2023
Herausgeber: IEEE

Self-supervised prediction of the intention to interact with a service robot

Autoren: Gabriele Abbate, Alessandro Giusti, Viktor Schmuck, Oya Celiktutan, Antonio Paolillo
Veröffentlicht in: Robotics and Autonomous Systems, 2023
Herausgeber: Elsevier B.V.
DOI: 10.1016/j.robot.2023.104568

A Wearable Stereo Vision-Based Obstacle Detection System for Visually Impaired Individuals

Autoren: Andrea Ruo, Dario Napolitano, Valeria Villani
Veröffentlicht in: Communications in Computer and Information Science, Agents and Robots for reliable Engineered Autonomy, 2025
Herausgeber: Springer Nature Switzerland
DOI: 10.1007/978-3-032-08049-3_3

A Long-Range Mutual Gaze Detector for HRI

Autoren: Simone Arreghini, Gabriele Abbate, Alessandro Giusti, Antonio Paolillo
Veröffentlicht in: Proceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction, 2025
Herausgeber: ACM
DOI: 10.1145/3610977.3637470

Peer reviewed articles (3)

TAG2G: A Diffusion-Based Approach to Interlocutor-Aware Co-Speech Gesture Generation

Autoren: Filippo Favali, Viktor Schmuck, Valeria Villani, Oya Celiktutan
Veröffentlicht in: Electronics, Ausgabe 13, 2025, ISSN 2079-9292
Herausgeber: MDPI AG
DOI: 10.3390/ELECTRONICS13173364

Self-supervised prediction of the intention to interact with a service robot

Autoren: Gabriele Abbate, Alessandro Giusti, Viktor Schmuck, Oya Celiktutan, Antonio Paolillo
Veröffentlicht in: Robotics and Autonomous Systems, Ausgabe 171, 2025, ISSN 0921-8890
Herausgeber: Elsevier BV
DOI: 10.1016/J.ROBOT.2023.104568

Imitation learning-based Direct Visual Servoing using the large projection formulation

Autoren: Sayantan Auddy, Antonio Paolillo, Justus Piater, Matteo Saveriano
Veröffentlicht in: Robotics and Autonomous Systems, Ausgabe 190, 2025, ISSN 0921-8890
Herausgeber: Elsevier BV
DOI: 10.1016/J.ROBOT.2025.104971