Skip to main content

Artificial Retrieval of Information Assistants - Virtual Agents with Linguistic Understanding, Social skills, and Personalised Aspects

Objective

The ARIA-VALUSPA project will create a ground-breaking new framework that will allow easy creation of Artificial Retrieval of Information Assistants (ARIAs) that are capable of holding multi-modal social interactions in challenging and unexpected situations. The system can generate search queries and return the information requested by interacting with humans through virtual characters. These virtual humans will be able to sustain an interaction with a user for some time, and react appropriately to the user's verbal and non-verbal behaviour when presenting the requested information and refining search results. Using audio and video signals as input, both verbal and non-verbal components of human communication are captured. Together with a rich and realistic emotive personality model, a sophisticated dialogue management system decides how to respond to a user's input, be it a spoken sentence, a head nod, or a smile. The ARIA uses special speech synthesisers to create emotionally coloured speech and a fully expressive 3D face to create the chosen response. Back-channelling, indicating that the ARIA understood what the user meant, or returning a smile are but a few of the many ways in which it can employ emotionally coloured social signals to improve communication.
As part of the project, the consortium will develop two specific implementations of ARIAs for two different industrial applications. A ‘speaking book’ application will create an ARIA with a rich personality capturing the essence of a novel, whom users can ask novel-related questions. An ‘artificial travel agent’ web-based ARIA will be developed to help users find their perfect holiday – something that is difficult to do with existing web interfaces such as those created by booking.com or tripadvisor.

Field of science

  • /humanities/languages and literature/linguistics/phonetics

Call for proposal

H2020-ICT-2014-1
See other projects for this call

Funding Scheme

RIA - Research and Innovation action
Leaflet | Map data © OpenStreetMap contributors, Credit: EC-GISCO, © EuroGeographics for the administrative boundaries

Coordinator

THE UNIVERSITY OF NOTTINGHAM
Address
University Park
NG7 2RD Nottingham
United Kingdom
Activity type
Higher or Secondary Education Establishments
EU contribution
€ 528 895

Participants (6)

IMPERIAL COLLEGE OF SCIENCE TECHNOLOGY AND MEDICINE
United Kingdom
EU contribution
€ 440 715
Address
South Kensington Campus Exhibition Road
SW7 2AZ London
Activity type
Higher or Secondary Education Establishments
CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE CNRS
France
EU contribution
€ 472 042,78
Address
Rue Michel Ange 3
75794 Paris
Activity type
Research Organisations
UNIVERSITAET AUGSBURG
Germany
EU contribution
€ 472 482,50
Address
Universitaetsstrasse 2
86159 Augsburg
Activity type
Higher or Secondary Education Establishments
UNIVERSITEIT TWENTE
Netherlands
EU contribution
€ 414 045
Address
Drienerlolaan 5
7522 NB Enschede
Activity type
Higher or Secondary Education Establishments
CEREPROC LTD
United Kingdom
EU contribution
€ 322 651,25
Address
Codebase Argyle House 3 Lady Lawson Street
EH3 9DR Edinburgh
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
LA CANTOCHE PRODUCTION SA
France
EU contribution
€ 298 486,25
Address
Rue D'hauteville 68
75010 Paris
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)