Skip to main content
Go to the home page of the European Commission (opens in new window)
English English
CORDIS - EU research results
CORDIS
Content archived on 2024-06-18

Enabling Audiovisual User Interfaces for Multisensorial Interaction

Objective

The research proposes the notion of AVUI (AudioVisual User Interface), a multisensorial interface combining user interaction with interrelated sound and image. In AVUI, a user interaction brings upon interrelated sonic and visual feedback. AVUI combines Human-Computer Interaction (HCI), sonification, and audio visualisation techniques, aiming to create a cognitive totality or “gestalt” in the user, where different sensorial elements reinforce the interaction. Multitouch, gestural and multimodal interaction are identified as important application fields. AVUI is not exclusively utilitarian, having an aesthetic purpose and user experience concern. The research aims to answer the following question: how can interconnected sound and image be used to create more usable, accessible, playful and engaging user interfaces for multitouch and gestural interaction?
The main objectives of the research are to: increase our knowledge on how interaction can be represented by sonic and visual means; identify the successful approaches to sound visualisation that generate greater engagement; improve our understanding of how sound visualisation can allow for greater usability, and accessibility with impaired users; and identify use cases where AVUI can be preferable to the traditional GUI (Graphical User Interface).
Following a practice-based and design-oriented approach, and in order to achieve knowledge regarding AVUI, a succession of artifacts will be developed: an initial prototype, two case-study applications implementing AVUI, and a software library for generic deployment of AVUI. These will be subject to user tests, evaluated based on qualitative and quantitative methods, using interviews, cognitive walkthrough, video observation, and questionnaires.
The main outcomes will be: functioning systems, code base, and software library for implementing AVUI; interaction theorization of audiovisual elements in the user interface; best-practice guidelines; and outreach activities.

Fields of science (EuroSciVoc)

CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: https://op.europa.eu/en/web/eu-vocabularies/euroscivoc.

You need to log in or register to use this function

Topic(s)

Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.

Call for proposal

Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.

FP7-PEOPLE-2013-IEF
See other projects for this call

Funding Scheme

Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.

MC-IEF - Intra-European Fellowships (IEF)

Coordinator

GOLDSMITHS' COLLEGE
EU contribution
€ 299 558,40
Address
LEWISHAM WAY
SE14 6NW London
United Kingdom

See on map

Region
London Inner London — East Lewisham and Southwark
Activity type
Higher or Secondary Education Establishments
Links
Total cost

The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.

No data
My booklet 0 0