Skip to main content
European Commission logo print header

Sketching Audio Technologies using Vocalizations and Gestures

Descrizione del progetto


Challenging current Thinking

Sketching is at the root of any design activity. In visual design, hand and pencil are still the primary tools used to produce a large variety of initial concepts in a very short time. However, in product and media design the sonic behavior of objects is also of primary importance, as sounds may afford seamless and aesthetically pleasing interactions. But how might one sketch the auditory aspects and sonic behavior of objects, in the early stages of the design process? Non-verbal sounds, more than speech, are naturally and spontaneously used in everyday life to describe and imitate sonic events, often accompanied by manual expressive gestures that complement, qualify, or emphasize them. The SkAT-VG project aims at enabling designers to use their voice and hands, directly, to sketch the auditory aspects of an object, thereby making it easier to exploit the functional and aesthetic possibilities of sound. The core of this framework is a system able to interpret users' intentions trough gestures and vocalizations, to select appropriate sound synthesis modules, and to enable iterative refinement and sharing, as it is commonly done with drawn sketches in the early stages of the design process. To reach its goal, the SkAT-VG project is based on an original mixture of complementary expertise: voice production, gesture analysis, cognitive psychology, machine learning, interaction design, and audio application development. The project tasks include case studies of how people naturally use vocalizations and gestures to communicate sounds, evaluation of current practices of sound designers, basic studies of sound identification trough vocalizations and gestural production, gesture analysis and machine learning, and development of the sketching tools.

Invito a presentare proposte

FP7-ICT-2013-C
Vedi altri progetti per questo bando

Meccanismo di finanziamento

CP - Collaborative project (generic)

Coordinatore

UNIVERSITA IUAV DI VENEZIA
Contributo UE
€ 637 720,00
Indirizzo
SANTA CROCE TOLENTINI 191
30135 Venezia
Italia

Mostra sulla mappa

Regione
Nord-Est Veneto Venezia
Tipo di attività
Higher or Secondary Education Establishments
Contatto amministrativo
Davide Rocchesso (Prof.)
Collegamenti
Costo totale
Nessun dato

Partecipanti (3)