Objetivo
In the Disappearing Computer scenario, non-speech sounds will be important to exchange information between artefacts and humans. This project aims at developing versatile and efficient sound models that are based on the physics of sound-generating phenomena, thus being easily integrated within artefacts and appliances that interact physically with humans. The parameters of the sound models are controlled by means of control models, which are developed according to the dynamics of human gestures and expressions. The design of sound and control models is driven by the results of an experimental psychology research agenda, which is aimed at establishing a consistent phenomenology and psychophysics of sound events. Psychological and modelling research are focused on a restricted class of phenomena that are relevant in everyday human-object interaction. In the Disappearing Computer scenario, non-speech sounds will be important to exchange information between artefacts and humans. This project aims at developing versatile and efficient sound models that are based on the physics of sound-generating phenomena, thus being easily integrated within artefacts and appliances that interact physically with humans. The parameters of the sound models are controlled by means of control models, which are developed according to the dynamics of human gestures and expressions. The design of sound and control models is driven by the results of an experimental psychology research agenda, which is aimed at establishing a consistent phenomenology and psychophysics of sound events. Psychological and modelling research are focused on a restricted class of phenomena that are relevant in everyday human-object interaction.
OBJECTIVES
The Sob project aims at developing sound models that are responsive to physical interactions and are easily matched to physical objects. The sound models, being specified by physical descriptions and actions, are ready to be integrated into artefacts that interact with each other and that are accessed by direct manipulation. Control models are developed in order to reproduce parametric variations that are natural according to the dynamics of human gestures and expressive intentions. Sound and control models are developed after the phenomenological and psychophysical characterisation of a restricted class of sound events. The results of research are demonstrated by means of a dynamic sound library and applications/demonstrators that allow users to interact with objects using only gestures and auditory display.
DESCRIPTION OF WORK
The project proceeds along a few inter-related lines:
1. Design of sound models that satisfy constraints of compactness, versatility, and efficiency;
2. Psychological experiments that provide a phenomenology of a restricted set of sound events, as well as psychophysical scales to be used in the sound models;
3. Construction of an auditory information space (using the achievements above) that is directly linked to the physical sound generation processes;
4. Design of control models that link user gestures and body dynamics to the parameters of sound models, according to the intended emotional content of the action. After having established a corpus of psychophysical and modelling results, all the units of the consortium collaborate to refine the models so that they satisfy the constraints imposed by the Disappearing Computer scenario. To this end, a further set of psychological tests is finally performed using synthetic signals generated by the models and controlled by users with different emotional content.
Models have been implemented and are available in the form of a dynamic sound library, whose elements, organised in sound information spaces, are sound generation procedures and parameter settings.
Several demonstrators have been prepared using sensors and gestural controllers to allow interaction with virtual 3-D objects by means of gesture interpretation and using only auditory display. In these applications, the predominant visual feedback for the user comes from his/her own gestures.
Ámbito científico (EuroSciVoc)
CORDIS clasifica los proyectos con EuroSciVoc, una taxonomía plurilingüe de ámbitos científicos, mediante un proceso semiautomático basado en técnicas de procesamiento del lenguaje natural. Véas: El vocabulario científico europeo..
CORDIS clasifica los proyectos con EuroSciVoc, una taxonomía plurilingüe de ámbitos científicos, mediante un proceso semiautomático basado en técnicas de procesamiento del lenguaje natural. Véas: El vocabulario científico europeo..
- ciencias sociales psicología
- ingeniería y tecnología ingeniería eléctrica, ingeniería electrónica, ingeniería de la información ingeniería electrónica sensores
Para utilizar esta función, debe iniciar sesión o registrarse
Programa(s)
Programas de financiación plurianuales que definen las prioridades de la UE en materia de investigación e innovación.
Programas de financiación plurianuales que definen las prioridades de la UE en materia de investigación e innovación.
Tema(s)
Las convocatorias de propuestas se dividen en temas. Un tema define una materia o área específica para la que los solicitantes pueden presentar propuestas. La descripción de un tema comprende su alcance específico y la repercusión prevista del proyecto financiado.
Las convocatorias de propuestas se dividen en temas. Un tema define una materia o área específica para la que los solicitantes pueden presentar propuestas. La descripción de un tema comprende su alcance específico y la repercusión prevista del proyecto financiado.
Convocatoria de propuestas
Procedimiento para invitar a los solicitantes a presentar propuestas de proyectos con el objetivo de obtener financiación de la UE.
Datos no disponibles
Procedimiento para invitar a los solicitantes a presentar propuestas de proyectos con el objetivo de obtener financiación de la UE.
Régimen de financiación
Régimen de financiación (o «Tipo de acción») dentro de un programa con características comunes. Especifica: el alcance de lo que se financia; el porcentaje de reembolso; los criterios específicos de evaluación para optar a la financiación; y el uso de formas simplificadas de costes como los importes a tanto alzado.
Régimen de financiación (o «Tipo de acción») dentro de un programa con características comunes. Especifica: el alcance de lo que se financia; el porcentaje de reembolso; los criterios específicos de evaluación para optar a la financiación; y el uso de formas simplificadas de costes como los importes a tanto alzado.
Coordinador
37192 VERONA
Italia
Los costes totales en que ha incurrido esta organización para participar en el proyecto, incluidos los costes directos e indirectos. Este importe es un subconjunto del presupuesto total del proyecto.