Project description Challenging current Thinking Show the project objective Hide the project objective Sketching is at the root of any design activity. In visual design, hand and pencil are still the primary tools used to produce a large variety of initial concepts in a very short time. However, in product and media design the sonic behavior of objects is also of primary importance, as sounds may afford seamless and aesthetically pleasing interactions. But how might one sketch the auditory aspects and sonic behavior of objects, in the early stages of the design process? Non-verbal sounds, more than speech, are naturally and spontaneously used in everyday life to describe and imitate sonic events, often accompanied by manual expressive gestures that complement, qualify, or emphasize them. The SkAT-VG project aims at enabling designers to use their voice and hands, directly, to sketch the auditory aspects of an object, thereby making it easier to exploit the functional and aesthetic possibilities of sound. The core of this framework is a system able to interpret users' intentions trough gestures and vocalizations, to select appropriate sound synthesis modules, and to enable iterative refinement and sharing, as it is commonly done with drawn sketches in the early stages of the design process. To reach its goal, the SkAT-VG project is based on an original mixture of complementary expertise: voice production, gesture analysis, cognitive psychology, machine learning, interaction design, and audio application development. The project tasks include case studies of how people naturally use vocalizations and gestures to communicate sounds, evaluation of current practices of sound designers, basic studies of sound identification trough vocalizations and gestural production, gesture analysis and machine learning, and development of the sketching tools. Fields of science natural sciencescomputer and information sciencesartificial intelligencemachine learningsocial sciencespsychologycognitive psychology Programme(s) FP7-ICT - Specific Programme "Cooperation": Information and communication technologies Topic(s) ICT-2011.9.1 - Challenging current Thinking Call for proposal FP7-ICT-2013-C See other projects for this call Funding Scheme CP - Collaborative project (generic) Coordinator UNIVERSITA IUAV DI VENEZIA EU contribution € 637 720,00 Address SANTA CROCE TOLENTINI 191 30135 Venezia Italy See on map Region Nord-Est Veneto Venezia Activity type Higher or Secondary Education Establishments Administrative Contact Davide Rocchesso (Prof.) Links Contact the organisation Opens in new window Website Opens in new window Total cost No data Participants (3) Sort alphabetically Sort by EU Contribution Expand all Collapse all GENESIS S. A. France EU contribution € 367 077,00 Address Domaine du Petit Arbois 13545 AIX EN PROVENCE See on map Activity type Private for-profit entities (excluding Higher or Secondary Education Establishments) Administrative Contact Patrick Boussard (Mr.) Links Contact the organisation Opens in new window Website Opens in new window Total cost No data INSTITUT DE RECHERCHE ET DE COORDINATION ACOUSTIQUE MUSIQUE - IRCAM France EU contribution € 789 214,00 Address RUE SAINT MERRI 31 75004 Paris See on map Region Ile-de-France Ile-de-France Paris Activity type Research Organisations Administrative Contact Patrick Susini (Dr.) Links Contact the organisation Opens in new window Website Opens in new window Total cost No data KUNGLIGA TEKNISKA HOEGSKOLAN Sweden EU contribution € 641 480,00 Address BRINELLVAGEN 8 100 44 Stockholm See on map Region Östra Sverige Stockholm Stockholms län Activity type Higher or Secondary Education Establishments Administrative Contact Carina Lingonbacke (Mrs.) Links Contact the organisation Opens in new window Website Opens in new window Total cost No data