CORDIS
EU research results

CORDIS

English EN
CAPTURING AND REPRODUCTION OF CROWDED ACOUSTIC ENVIRONMENTS FOR IMMERSIVE APPLICATIONS

CAPTURING AND REPRODUCTION OF CROWDED ACOUSTIC ENVIRONMENTS FOR IMMERSIVE APPLICATIONS

Objective

CROWDMERSE enables real-time capture, processing, and reproduction of an immersive audio experience to the user of any event of interest, focusing on “crowded” acoustic events. Acoustic scenes with large audiences, such as sports events or music concerts, present significant challenges for immersive reproduction which have not been so far adequately considered in the signal processing community. Technological breakthrough in sports events broadcasting has a strong potential impact on media providers, and consequently on the European and global economy. The challenges of capturing and reproducing crowded acoustic events include the need to spatially capture and reproduce numerous sound sources, such as the applause and yells of the spectators, in addition to the “main” sounds of the event. Concerns regarding the privacy of the spectators must not be overlooked: the conversations of the audience members sitting near the microphone sensors must be eliminated. In order to spatially sample large venues, the acoustic sensors should be low-cost, small-sized, and support wireless operation. The developed algorithms should respect the limited sensor resources, while operating in real-time to enable commercial applications. Our final objective is to enable real-time delivery of crowded acoustic events so that the designed platform can be integrated with today’s High-Definition TV programs. CROWDMERSE focuses on sound capturing using multiple closely placed microphones forming a microphone array. The audio content is rendered through a home entertainment system equipped with multiple loudspeakers, accompanying the content of a typical HDTV broadcast. Addressing the scientific challenges and proposing a solution which can be integrated with current broadcasting principles is guaranteed given the previous involvement of the experienced researcher in sports broadcasting projects. The proposed methods are expected to have impact in the general area of immersive sound environments.
Leaflet | Map data © OpenStreetMap contributors, Credit: EC-GISCO, © EuroGeographics for the administrative boundaries

Coordinator

FOUNDATION FOR RESEARCH AND TECHNOLOGY HELLAS

Address

N Plastira Str 100
70013 Heraklion

Greece

Activity type

Higher or Secondary Education Establishments

EU Contribution

€ 254 457

Partners (2)

Sort alphabetically

Expand all

AUDYSSEY LABORATORIES INC

CIDANA CORPORATION

Project information

Grant agreement ID: 745677

  • Start date

    1 October 2017

  • End date

    28 February 2021

Funded under:

H2020-EU.1.3.2.

  • Overall budget:

    € 254 457

  • EU contribution

    € 254 457

Coordinated by:

FOUNDATION FOR RESEARCH AND TECHNOLOGY HELLAS

Greece