Project description Cognitive Systems, Interaction, Robotics Show the project objective Hide the project objective The EMIME project will help to overcome the language barrier by developing a mobile device that performs personalized speech-to-speech translation, such that the a user's spoken input in one language is used to produce spoken output in another language, while continuing to sound like the user's voice. Personalisation of systems for cross-lingual spoken communication is an important, but little explored, topic. It is essential for providing more natural interaction and making the computing device a less obtrusive element when assisting human-human interactions. We will build on recent developments in speech synthesis using hidden Markov models, which is the same technology used for automatic speech recognition. Using a common statistical modelling framework for automatic speech recognition and speech synthesis will enable the use of common techniques for adaptation and multilinguality. Significant progress will be made towards a unified approach for speech recognition and speech synthesis: this is a very powerful concept, and will open up many new areas of research. In this project, we will explore the use of speaker adaptation across languages so that, by performing automatic speech recognition, we can learn the characteristics of an individual speaker, and then use those characteristics when producing output speech in another language.Our objectives are to: Personalise speech processing systems by learning individual characteristics of a user's speech and reproducing them in synthesised speech; Introduce a cross-lingual capability such that personal characteristics can be reproduced in a second language not spoken by the user; Develop and better understand the mathematical and theoretical relationship between speech recognition and synthesis; Eliminate the need for human intervention in the process of cross-lingual personalisation; Evaluate our research against state-of-the art techniques and in a practical mobile application. Programme(s) FP7-ICT - Specific Programme "Cooperation": Information and communication technologies Topic(s) ICT-2007.2.1 - Cognitive systems, interaction, robotics Call for proposal FP7-ICT-2007-1 See other projects for this call Funding Scheme CP - Collaborative project (generic) Coordinator THE UNIVERSITY OF EDINBURGH Address Old college, south bridge EH8 9YL Edinburgh United Kingdom See on map Region Scotland Eastern Scotland Edinburgh Activity type Higher or Secondary Education Establishments Administrative Contact Angela Noble (Miss) Links Contact the organisation Opens in new window Website Opens in new window EU contribution € 700 544,00 Participants (6) Sort alphabetically Sort by EU Contribution Expand all Collapse all FONDATION DE L'INSTITUT DE RECHERCHE IDIAP Switzerland EU contribution € 474 744,00 Address Rue marconi 19 1920 Martigny See on map Region Schweiz/Suisse/Svizzera Région lémanique Valais / Wallis Activity type Research Organisations Administrative Contact Sandra Micheloud (-) Links Contact the organisation Opens in new window NOKIA OYJ Finland EU contribution € 484 479,00 Address Karaportti 3 02610 Espoo See on map Region Manner-Suomi Helsinki-Uusimaa Helsinki-Uusimaa Activity type Private for-profit entities (excluding Higher or Secondary Education Establishments) Administrative Contact Marjo Hiltunen (Ms.) Links Contact the organisation Opens in new window Website Opens in new window AALTO KORKEAKOULUSAATIO SR Finland EU contribution € 0,00 Address Otakaari 1 02150 Espoo See on map Region Manner-Suomi Helsinki-Uusimaa Helsinki-Uusimaa Activity type Higher or Secondary Education Establishments Administrative Contact Mikko Kurimo (Dr) Links Contact the organisation Opens in new window Website Opens in new window Teknillinen korkeakoulu Participation ended Finland EU contribution € 476 766,00 Address Otakaari 1 02015 Espoo See on map Activity type Higher or Secondary Education Establishments Administrative Contact Mikko Kurimo (Dr) Links Contact the organisation Opens in new window Website Opens in new window NAGOYA INSTITUTE OF TECHNOLOGY Japan EU contribution € 460 200,00 Address 29 aza kiichi, gokiso-cho, showa-ku 466-8555 Nagoya See on map Activity type Higher or Secondary Education Establishments Administrative Contact Naoki Toda (Mr) Links Contact the organisation Opens in new window THE CHANCELLOR MASTERS AND SCHOLARS OF THE UNIVERSITY OF CAMBRIDGE United Kingdom EU contribution € 453 267,00 Address Trinity lane the old schools CB2 1TN Cambridge See on map Region East of England East Anglia Cambridgeshire CC Activity type Higher or Secondary Education Establishments Administrative Contact Dawn Barker (Mrs) Links Contact the organisation Opens in new window Website Opens in new window
