Skip to main content

Physically Based Simulation and Rendering of Thin Shell Sound

Objective

Sound is as important as visuals in modern media (lms, video-games). Yet, little effort has been devoted to the rendering of sound from digital environments, compared to the phenomenal advances of visual rendering. Virtual scenes are sonied through the ad-hoc edition of recorded sounds and their manual synchronization with the visuals, yielding limited and repetitive sounds. This proposal addresses this problem by generating sounds from virtual environments through physically based simulation, and focuses on a challenging family of objects: thin shells. Characteristic thin shell sounds include tearing cloth and paper, crushing cans and plastic bottles, and crumpling a piece of paper and a plastic bag. Sound synthesis of thin-shell sound will be addressed through a set of modeling techniques (model reduction, high frequency bandwidth extension and precomputed sound databases), while real-time constrains will be addressed using data-driven approaches. This project will considerably widen the number of real life object sounds that can be digitally generated, and will contribute to the young research eld of physically based sound rendering, which has the potential of becoming the next key technology of the media industry. The expertise of Columbia University in thin shells and sound rendering, complemented by the expertise of Inria in real-time sound rendering provide the optimal setting for the success of this fellowship. In addition, the researcher will receive training through research and on complementary skills, including student tutoring, teaching, dissemination, and project management. Industry-related skills, such as technology transfer, research-to-product techniques and standardization will be trained through a secondment in the industrial sector at AudioGaming. This Action will allow the researcher to become a mature and independent, and to obtain a long term research position in Europe as a world leader in physically based sound rendering.

Coordinator

INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET AUTOMATIQUE
Net EU contribution
€ 221 635,80
Address
Domaine De Voluceau Rocquencourt
78153 Le Chesnay Cedex
France

See on map

Region
Ile-de-France Ile-de-France Yvelines
Activity type
Research Organisations
Other funding
€ 0,00

Partners (1)

Partner

Partner organisations contribute to the implementation of the action, but do not sign the Grant Agreement.

TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK
United States
Net EU contribution
€ 0,00
Address
Amsterdam Avenue 1210 Room
10027 7003 New York

See on map

Activity type
Higher or Secondary Education Establishments
Other funding
€ 129 097,80