Skip to main content
françaisFR
European Commission logo print header

the Sounding Object

Objectif

In the Disappearing Computer scenario, non-speech sounds will be important to exchange information between artefacts and humans. This project aims at developing versatile and efficient sound models that are based on the physics of sound-generating phenomena, thus being easily integrated within artefacts and appliances that interact physically with humans. The parameters of the sound models are controlled by means of control models, which are developed according to the dynamics of human gestures and expressions. The design of sound and control models is driven by the results of an experimental psychology research agenda, which is aimed at establishing a consistent phenomenology and psychophysics of sound events. Psychological and modelling research are focused on a restricted class of phenomena that are relevant in everyday human-object interaction. In the Disappearing Computer scenario, non-speech sounds will be important to exchange information between artefacts and humans. This project aims at developing versatile and efficient sound models that are based on the physics of sound-generating phenomena, thus being easily integrated within artefacts and appliances that interact physically with humans. The parameters of the sound models are controlled by means of control models, which are developed according to the dynamics of human gestures and expressions. The design of sound and control models is driven by the results of an experimental psychology research agenda, which is aimed at establishing a consistent phenomenology and psychophysics of sound events. Psychological and modelling research are focused on a restricted class of phenomena that are relevant in everyday human-object interaction.

OBJECTIVES
The Sob project aims at developing sound models that are responsive to physical interactions and are easily matched to physical objects. The sound models, being specified by physical descriptions and actions, are ready to be integrated into artefacts that interact with each other and that are accessed by direct manipulation. Control models are developed in order to reproduce parametric variations that are natural according to the dynamics of human gestures and expressive intentions. Sound and control models are developed after the phenomenological and psychophysical characterisation of a restricted class of sound events. The results of research are demonstrated by means of a dynamic sound library and applications/demonstrators that allow users to interact with objects using only gestures and auditory display.

DESCRIPTION OF WORK
The project proceeds along a few inter-related lines:
1. Design of sound models that satisfy constraints of compactness, versatility, and efficiency;
2. Psychological experiments that provide a phenomenology of a restricted set of sound events, as well as psychophysical scales to be used in the sound models;
3. Construction of an auditory information space (using the achievements above) that is directly linked to the physical sound generation processes;
4. Design of control models that link user gestures and body dynamics to the parameters of sound models, according to the intended emotional content of the action. After having established a corpus of psychophysical and modelling results, all the units of the consortium collaborate to refine the models so that they satisfy the constraints imposed by the Disappearing Computer scenario. To this end, a further set of psychological tests is finally performed using synthetic signals generated by the models and controlled by users with different emotional content.
Models have been implemented and are available in the form of a dynamic sound library, whose elements, organised in sound information spaces, are sound generation procedures and parameter settings.
Several demonstrators have been prepared using sensors and gestural controllers to allow interaction with virtual 3-D objects by means of gesture interpretation and using only auditory display. In these applications, the predominant visual feedback for the user comes from his/her own gestures.

Champ scientifique

Programme(s)

Thème(s)

Appel à propositions

Data not available

Régime de financement

CSC - Cost-sharing contracts

Coordinateur

UNIVERSITA DEGLI STUDI DI VERONA
Contribution de l’UE
Aucune donnée
Adresse
VIA DELL' ARTIGLIERE 8
37192 VERONA
Italie

Voir sur la carte
Coût total
Aucune donnée

Participants (3)

Partager cette page

Télécharger

Dernière mise à jour: 13 Juin 2005

Mon livret

Permalink: https://cordis.europa.eu/project/id/IST-2000-25287/fr

European Union, 2024