ReSilence developed AI-based technologies for real-time interaction with soundscapes. This includes multimodal algorithms for activity and emotion recognition based on non-verbal behaviour, privacy-aware eco-acoustic soundscape sensing and processing systems, modular AI systems for urban and vehicular soundscapes, and AI-based sound–image correlation and synthesis models. These results go beyond the state of the art by enabling real-time, embodied, and spatial interaction with sound, integrating movement, sound, and visual modalities while respecting GDPR and privacy-by-design principles.
ReSilence delivered technologies for soundscape experience assessment and emotional/cognitive sensing. These include bio-signal-based emotion detection and physiological analysis , multilingual and entity-based sentiment analysis of audience feedback , multimodal behavioural analysis platforms for audience participation, and AI-based multilingual report generation for self-assessment and redesign cycles. Together, these results exceed current soundscape evaluation practices by combining physiological, behavioural, linguistic, and self-reported data into integrated assessment pipelines applicable in real-world artistic and urban environments.
The results of ReSilence include immersive XR installations, EM-based sensing instruments, gesture-based and hands-free interaction devices, soundscape design and algorithmic composition tools, and the integrated ReSilence Toolkit. This goes beyond the state of the art by providing a reusable, artist-centred technological ecosystem that bridges AI, XR, sound, and embodied interaction.
The project produced results, including the definition of requirements and challenges for bridging art, science, and technology, and the ReSilence Art-Driven Methodology. These results formalise artistic practice as a core driver of technology development, ethical reflection, and social trust, going beyond conventional R&D models where art plays only a demonstrative role.
ReSilence validated its results through 15 real-world use case scenarios tested and exhibited in museums, festivals, research institutions, urban environments, and XR settings. This level of public, real-context validation exceeds the state of the art in soundscape research and AI-based interaction, which is typically limited to controlled experimental settings.
