The main results of the SONORA project are summarized here, along the three overall objectives: modeling, sensing, processing.
Modeling: we have worked to develop novel room acoustics models that are capable of capturing the spatiotemporal behavior of complex sound scenes. These models possess desirable properties for signal processing purposes by being scalable to varying room types and sizes, robust to physical uncertainties and variations, physically interpretable, perceptually relevant, invertible and cheaply auralizable.
- A novel equivalent source model for room acoustics, which associates a directional impulse responses rather than a free-field Green's function to each equivalent source:
https://doi.org/10.1109/TASLP.2017.2730284(si apre in una nuova finestra)- A novel data-driven room acoustics model based on low-rank matrix/tensor decompositions, which comes with a solid physical justification that is rooted in the modal theory of room acoustics:
https://eurasip.org/Proceedings/Eusipco/Eusipco2021/pdfs/0000111.pdf(si apre in una nuova finestra)- A novel convergence theorem for modeling acoustic wave propagation with the multipole expansion method (MEM), that allows to optimally select the MEM truncation order:
https://doi.org/10.1137/20M1370914(si apre in una nuova finestra)- A novel relation between geometric and wave-based models for acoustic wave propagation, based on the observation that the solution to the boundary integration equation can be asymptotically represented by only considering specular reflection points on the boundary of the domain:
https://appfa2023.silsystem.solutions/atti/001143.pdf(si apre in una nuova finestra)Sensing: we have aimed to develop a novel framework for sensing room acoustics, embracing novel sampling theories and practical measurement protocols for spatiotemporal sound fields.
- A classical Nyquist-Shannon sampling and interpolation theory for a number of spatiotemporal sound field sensing problems in which a rigorous foundation was previously lacking:
https://arxiv.org/abs/2012.09499(si apre in una nuova finestra)https://doi.org/10.1109/I3DA48870.2021.9610902(si apre in una nuova finestra)https://eurasip.org/Proceedings/Eusipco/Eusipco2022/pdfs/0002256.pdf(si apre in una nuova finestra)- A compressed sensing framework for acoustic source localization and power-spectral-density (PSD) estimation, both in single-sensor and multi-sensor contexts:
https://doi.org/10.1186/s13636-023-00304-8(si apre in una nuova finestra)https://arxiv.org/abs/2306.08514(si apre in una nuova finestra)https://doi.org/10.1109/WASPAA58266.2023.10248095(si apre in una nuova finestra)- Optimal microphone selection/positioning algorithms for sensing spatiotemporal sound fields in various problem settings:
https://doi.org/10.1109/IWAENC53105.2022.9914798(si apre in una nuova finestra)https://tinyurl.com/3xa5fz68(si apre in una nuova finestra)- An extensive open-source database of source/receiver signals, RIR measurements, and noise field measurements with diverse microphone arrays and room types:
https://doi.org/10.1186/s13636-023-00284-9(si apre in una nuova finestra)Processing: we have designed novel signal processing algorithms addressing basic estimation, prediction, and simulation problems related to audio acquisition and reproduction in complex sound scenes, leveraging the desirable properties of the newly developed room acoustics models.
- A collection of numerical optimization algorithms that are particularly suited for estimating equivalent source models for room acoustics:
https://arxiv.org/abs/1803.01621(si apre in una nuova finestra)- A low-rank-promoting algorithm for estimating low-rank data-driven models for room acoustics directly from source/receiver data:
https://doi.org/10.1109/TASLP.2023.3240650(si apre in una nuova finestra)- Novel single- and multi-channel convolution algorithms that can operate directly on low-rank room acoustics models, resulting in fast convolution at low latency:
https://ftp.esat.kuleuven.be/stadius/mjalmby/23-149.pdf(si apre in una nuova finestra)https://ftp.esat.kuleuven.be/stadius/mjalmby/23-150.pdf(si apre in una nuova finestra)- New algorithms targeted at solving the fundamental problem of sorting and clustering TDOA estimates corresponding to first-order and second-order room reflections:
https://eurasip.org/Proceedings/Eusipco/Eusipco2021/pdfs/0001730.pdf(si apre in una nuova finestra)https://doi.org/10.1109/ICASSP49357.2023.10096005(si apre in una nuova finestra)