Enriched communication across the lifespan

Project Information

ENRICH

Grant agreement ID: 675324

DOI

10.3030/675324

Project closed

EC signature date 11 August 2016

Start date 1 October 2016

End date 30 September 2020

Funded under

• EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions

Total cost

€ 3 593 601,36

EU contribution

€ 3 593 601,36

Coordinated by

UNIVERSIDAD DEL PAIS VASCO/ EUSKAL HERRIKO UNIBERTSITATEA
Spain

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Deliverables

Documents, reports (7)

Reseach report 3

Reports on group/individual benefits of enrichment.

Final report

Report

Research report 1

Scientific deliverable Please provide a summary of the research reports themes 1,2,3 Full reports to be attached for the scientific evaluation

Mid-term evaluation

Scientific deliverable

Report on recruitment

Report

Research report 2

Research reports on enrichment techniques.

Pre-final evaluation

Scientific deliverable

Other (3)

Industry event

conference

Public understanding event

conference

Workshop on speech modifications

training

Publications

Conference proceedings (44)

Talker intelligibility and listening effort: The role of speaking rate

Author(s): Maximillian Paulus, Valerie Hazan, Anita Wagner, Patti Adank
Published in: Proceedings of the 23rd International Congress on Acoustics : integrating 4th EAA Euroregio 2019, 2019
Publisher: DEGA
DOI: 10.18154/rwth-conv-239169

Parallel vs. Non-Parallel Voice Conversion for Esophageal Speech

Author(s): Luis Serrano, Sneha Raman, David Tavarez, Eva Navas, Inma Hernaez
Published in: Interspeech 2019, 2019, Page(s) 4549-4553
Publisher: ISCA
DOI: 10.21437/interspeech.2019-2194

Talker Intelligibility and Listening Effort with Temporally Modified Speech

Author(s): Maximillian Paulus, Valerie Hazan, Patti Adank
Published in: Interspeech 2019, 2019, Page(s) 3128-3132
Publisher: ISCA
DOI: 10.21437/interspeech.2019-1402

Articulatory Control in Speech Production.

Author(s): Chen Shen, Esther Janse
Published in: Proceedings of the 19th International Congress of Phonetic Sciences, 2019, Page(s) 2533-2537
Publisher: Australasian Speech Science and Technology Association Inc.

Differences in Processing Speech-on-Speech Between Musicians and Non-musicians: The Role of Prosodic Cues

Author(s): Elif Canseza Kaplan, Deniz Baskent, Anita Wagner
Published in: Proceedings of the 23rd International Congress on Acoustics : integrating 4th EAA Euroregio 2019, 2019
Publisher: DEGA
DOI: 10.18154/rwth-conv-239680

Towards Realistic Immersive Audiovisual Simulations for Hearing Research - Capture, Virtual Scenes and Reproduction

Author(s): Gerard Llorach, Giso Grimm, Maartje M.E. Hendrikse, Volker Hohmann
Published in: Proceedings of the 2018 Workshop on Audio-Visual Scene Understanding for Immersive Multimedia - AVSU'18, 2018, Page(s) 33-40, ISBN 9781450359771
Publisher: ACM Press
DOI: 10.1145/3264869.3264874

Vehicle Noise: Loudness Ratings, Loudness Models and Future Experiments with Audiovisual Immersive Simulations

Author(s): Llorach, G., Oetting, D., Krüger M., Vormann, M., Fitschen, C., Schulte, M., Hohmann, V., Meis, M.
Published in: Proceedings of Internoise 2019, 2019
Publisher: Spanish Acoustical Society
DOI: 10.5281/zenodo.4276091

Audio-visual stimuli for the evaluation of speech-enhancing algorithms

Author(s): Giso Grimm, Gerard Llorach, Maartje Hendrikse, Volker Hohmann
Published in: Proceedings of the 23rd International Congress on Acoustics : integrating 4th EAA Euroregio 2019, 2019
Publisher: DEGA
DOI: 10.18154/rwth-conv-238907

Exploring Listeners’ Speech Rate Preferences

Author(s): Olympia Simantiraki, Martin Cooke
Published in: Interspeech 2020, 2020, Page(s) 1346-1350
Publisher: ISCA
DOI: 10.21437/interspeech.2020-1832

Speaker Conditional WaveRNN: Towards Universal Neural Vocoder for Unseen Speaker and Recording Conditions

Author(s): Dipjyoti Paul, Yannis Pantazis, Yannis Stylianou
Published in: Interspeech 2020, 2020, Page(s) 235-239
Publisher: ISCA
DOI: 10.21437/interspeech.2020-2786

Speech enrichment: Listening effort and intelligibility

Author(s): Anna Exenberger, Paul Iverson
Published in: Proceedings of the 23rd International Congress on Acoustics : integrating 4th EAA Euroregio 2019, 2019
Publisher: DEGA
DOI: 10.18154/rwth-conv-238874

Effects of Spectral Tilt on Listeners’ Preferences And Intelligibility

Author(s): Olympia Simantiraki, Martin Cooke, Yannis Pantazis
Published in: ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2020, Page(s) 6254-6258, ISBN 978-1-5090-6631-5
Publisher: IEEE
DOI: 10.1109/icassp40776.2020.9054117

Training Generative Adversarial Networks With Weights

Author(s): Yannis Pantazis, Dipjyoti Paul, Michail Fasoulakis, Yannis Stylianou
Published in: 2019 27th European Signal Processing Conference (EUSIPCO), 2019, Page(s) 1-5, ISBN 978-9-0827-9703-9
Publisher: IEEE
DOI: 10.23919/eusipco.2019.8902934

Listeners' Speech Rate Preferences in Stationary and Modulated Maskers

Author(s): Olympia Simantiraki, Martin Cooke
Published in: Proceedings of the 23rd International Congress on Acoustics : integrating 4th EAA Euroregio 2019, 2019
Publisher: DEGA
DOI: 10.18154/rwth-conv-239387

Benefits of the WaveNet-Based Speech Intelligibility Enhancement for Normal and Hearing Impaired Listeners

Author(s): Muhammed Shifas Padinjaru Veettil, Carol Chermaz, Theognosia Chimona, Vassilis Tsiaras, Yannis Stylianou,
Published in: Proceedings of the 23rd International Congress on Acoustics : integrating 4th EAA Euroregio 2019, 2019
Publisher: DEGA
DOI: 10.18154/rwth-conv-239258

Measuring the contribution to cognitive load of each predicted vocoder speech parameter in DNN-based speech synthesis

Author(s): Avashna Govender, Cassia Valentini-Botinhao, Simon King
Published in: 10th ISCA Speech Synthesis Workshop, 2019, Page(s) 121-126
Publisher: ISCA
DOI: 10.21437/ssw.2019-22

A Sound Engineering Approach to Near End Listening Enhancement

Author(s): Carol Chermaz, Simon King
Published in: Interspeech 2020, 2020, Page(s) 1356-1360
Publisher: ISCA
DOI: 10.21437/interspeech.2020-2748

Word error and confusion patterns in an audiovisual German matrix sentence test (OLSA)

Author(s): Gerard Llorach, Volker Hohmann
Published in: Proceedings of the 23rd International Congress on Acoustics : integrating 4th EAA Euroregio 2019, 2019
Publisher: DEGA
DOI: 10.18154/rwth-conv-239621

Individual Articulatory Control in Speech Enrichment

Author(s): Chen Shen, Martin Cooke, Esther Janse
Published in: Proceedings of the 23rd International Congress on Acoustics : integrating 4th EAA Euroregio 2019, 2019
Publisher: DEGA
DOI: 10.18154/rwth-conv-239282

Differences between Native and Non-Native Lombard Speech in terms of pitch range

Author(s): Katherine Pearl Marcoux, Mirjam Ernestus
Published in: Proceedings of the 23rd International Congress on Acoustics : integrating 4th EAA Euroregio 2019, 2019
Publisher: DEGA
DOI: 10.18154/rwth-conv-239240

Designing a Modern Greek sentence corpus for audiological and speech technology research

Author(s): Anna Sfakianaki
Published in: Proceedings of the 14th International Conference on Greek Linguistics (ICGL14), 2019
Publisher: ICGL

A Multifaceted Enrichment of Oesophageal Speech

Author(s): Raman, Sneha; Hernaez, Inma; Navas, Eva; Serrano, Luis
Published in: Proceedings of the 23rd International Congress on Acoustics : integrating 4th EAA Euroregio 2019, Issue 22, 2019
Publisher: DEGA
DOI: 10.18154/rwth-conv-239415

Unsupervised Acoustic Unit Discovery for Speech Synthesis Using Discrete Latent-Variable Neural Networks

Author(s): Ryan Eloff, André Nortje, Benjamin van Niekerk, Avashna Govender, Leanne Nortje, Arnu Pretorius, Elan van Biljon, Ewald van der Westhuizen, Lisa van Staden, Herman Kamper
Published in: Interspeech 2019, 2019, Page(s) 1103-1107
Publisher: ISCA
DOI: 10.21437/interspeech.2019-1518

Evaluating Near End Listening Enhancement Algorithms in Realistic Environments

Author(s): Carol Chermaz, Cassia Valentini-Botinhao, Henning Schepker, Simon King
Published in: Interspeech 2019, 2019, Page(s) 1373-1377
Publisher: ISCA
DOI: 10.21437/interspeech.2019-1800

The CSTR entry to the 2018 Blizzard Challenge

Author(s): Espic calderón, F., Govender, A., Ribeiro, M. S., Valentini Botinhao, C., & Watts, O.
Published in: 2018 Blizzard Challenge, 2018
Publisher: ISCA

Towards a Neural-Based Single Channel Speech Enhancement Model for Hearing-Aids

Author(s): Muhammed Shifas Padinjaru Veettil, Claudio Santelli, Yannis Stylianou
Published in: Proceedings of the 23rd International Congress on Acoustics : integrating 4th EAA Euroregio 2019, 2019
Publisher: DEGA
DOI: 10.18154/rwth-conv-239594

Enhancing Speech Intelligibility in Text-To-Speech Synthesis Using Speaking Style Conversion

Author(s): Dipjyoti Paul, Muhammed P.V. Shifas, Yannis Pantazis, Yannis Stylianou
Published in: Interspeech 2020, 2020, Page(s) 1361-1365
Publisher: ISCA
DOI: 10.21437/interspeech.2020-2793

Weighted Generative Adversarial Network for many-to-many Voice Conversion

Author(s): Dipjyoti Paul, Yannis Pantazis, Yannis Stylianou
Published in: Proceedings of the 23rd International Congress on Acoustics : integrating 4th EAA Euroregio 2019, 2019
Publisher: DEGA
DOI: 10.18154/rwth-conv-239420

Realistic Audiovisual Listening Environments in the Lab: Analysis of Movement Behavior and Consequences for Hearing Aids

Author(s): Maartje Hendrikse, Gerard Llorach, Giso Grimm, Giso, Volker Hohmann
Published in: Proceedings of the 23rd International Congress on Acoustics : integrating 4th EAA Euroregio 2019, 2019
Publisher: DEGA
DOI: 10.18154/rwth-conv-239167

Impact of Different Speech Types on Listening Effort

Author(s): Olympia Simantiraki, Martin Cooke, Simon King
Published in: Interspeech 2018, 2018, Page(s) 2267-2271
Publisher: ISCA
DOI: 10.21437/Interspeech.2018-1358

Glottal Source Features for Automatic Speech-Based Depression Assessment

Author(s): Olympia Simantiraki, Paulos Charonyktakis, Anastasia Pampouchidou, Manolis Tsiknakis, Martin Cooke
Published in: Interspeech 2017, 2017, Page(s) 2700-2704
Publisher: ISCA
DOI: 10.21437/Interspeech.2017-1251

Speech Intelligibility Enhancement Based on a Non-causal Wavenet-like Model

Author(s): Muhammed Shifas PV, Vassilis Tsiaras, Yannis Stylianou
Published in: Interspeech 2018, 2018, Page(s) 1868-1872
Publisher: ISCA
DOI: 10.21437/Interspeech.2018-2119

Measuring the Cognitive Load of Synthetic Speech Using a Dual Task Paradigm

Author(s): Avashna Govender, Simon King
Published in: Interspeech 2018, 2018, Page(s) 2843-2847
Publisher: ISCA
DOI: 10.21437/Interspeech.2018-1199

Using Pupillometry to Measure the Cognitive Load of Synthetic Speech

Author(s): Avashna Govender, Simon King
Published in: Interspeech 2018, 2018, Page(s) 2838-2842
Publisher: ISCA
DOI: 10.21437/Interspeech.2018-1174

LSTM based voice conversion for laryngectomees

Author(s): Luis Serrano, David Tavarez, Xabier Sarasola, Sneha Raman, Ibon Saratxaga, Eva Navas, Inma Hernaez
Published in: IberSPEECH 2018, 2018, Page(s) 122-126
Publisher: ISCA
DOI: 10.21437/iberspeech.2018-26

Listening to Laryngectomees: A study of Intelligibility and Self-reported Listening Effort of Spanish Oesophageal Speech

Author(s): Sneha Raman, Inma Hernaez, Eva Navas, Luis Serrano
Published in: IberSPEECH 2018, 2018, Page(s) 107-111
Publisher: ISCA
DOI: 10.21437/iberspeech.2018-23

Using Pupil Dilation to Measure Cognitive Load When Listening to Text-to-Speech in Quiet and in Noise

Author(s): Avashna Govender, Anita E. Wagner, Simon King
Published in: Interspeech 2019, 2019, Page(s) 1551-1555
Publisher: ISCA
DOI: 10.21437/interspeech.2019-1783

Non-Parallel Voice Conversion Using Weighted Generative Adversarial Networks

Author(s): Dipjyoti Paul, Yannis Pantazis, Yannis Stylianou
Published in: Interspeech 2019, 2019, Page(s) 659-663
Publisher: ISCA
DOI: 10.21437/interspeech.2019-2869

Evaluating Cognitive Load of Text-To-Speech (TTS) synthesis

Author(s): Avahna Govender, Simon King, Cassia Valentini-Botinhao
Published in: Proceedings of the 23rd International Congress on Acoustics : integrating 4th EAA Euroregio 2019, 2019
Publisher: DEGA
DOI: 10.18154/rwth-conv-239695

A Non-Causal FFTNet Architecture for Speech Enhancement

Author(s): Muhammed Shifas P.V., Nagaraj Adiga, Vassilis Tsiaras, Yannis Stylianou
Published in: Interspeech 2019, 2019, Page(s) 1826-1830
Publisher: ISCA
DOI: 10.21437/interspeech.2019-2622

Near End Listening Enhancement in Realistic Environments

Author(s): Carol Chermaz, Cassia Valentini-Botinhao, Henning Schepker, Simon King
Published in: Proceedings of the 23rd International Congress on Acoustics : integrating 4th EAA Euroregio 2019, 2019
Publisher: DEGA
DOI: 10.18154/rwth-conv-239327

EEG alpha power as a measure of listening effort reduction in adverse conditions

Author(s): Amy Jane Hall, Axel Winneke, Jan Rennies-Hochmuth
Published in: Proceedings of the 23rd International Congress on Acoustics : integrating 4th EAA Euroregio 2019, 2019
Publisher: DEGA
DOI: 10.18154/rwth-conv-239632

Intelligibility-Enhancing Speech Modifications — The Hurricane Challenge 2.0

Author(s): Jan Rennies, Henning Schepker, Cassia Valentini-Botinhao, Martin Cooke
Published in: Interspeech 2020, 2020, Page(s) 1341-1345
Publisher: ISCA
DOI: 10.21437/interspeech.2020-1641

Pitch in Native and Non-Native Lombard Speech.

Author(s): Marcoux, K.P, Ernestus, M.T.C
Published in: Proceedings of the 19th International Congress of Phonetic Sciences, 2019, Page(s) 2605-2609
Publisher: Australasian Speech Science and Technology Association Inc.

Peer reviewed articles (7)

The relationship between talker acoustics, intelligibility, and effort in degraded listening conditions

Author(s): Maximillian Paulus, Valerie Hazan, Patti Adank
Published in: The Journal of the Acoustical Society of America, Issue 147/5, 2020, Page(s) 3348-3359, ISSN 0001-4966
Publisher: Acoustical Society of America
DOI: 10.1121/10.0001212

Movement and Gaze Behavior in Virtual Audiovisual Listening Environments Resembling Everyday Life

Author(s): Maartje M. E. Hendrikse, Gerard Llorach, Volker Hohmann, Giso Grimm
Published in: Trends in Hearing, Issue 23, 2019, Page(s) 233121651987236, ISSN 2331-2165
Publisher: SAGE Publications Inc.
DOI: 10.1177/2331216519872362

A Spanish Multispeaker Database of Esophageal Speech

Author(s): Luis Serrano García, Sneha Raman, Inma Hernáez Rioja, Eva Navas Cordón, Jon Sanchez, Ibon Saratxaga
Published in: Computer Speech & Language, 2020, ISSN 0885-2308
Publisher: Academic Press
DOI: 10.1016/j.csl.2020.101168

Comunicación enriquecida a lo largo de la vida

Author(s): Cooke, Martin; King, Simon; Hazan, Valerie; Stylianou, Yannis; Janse, Esther; Baskent, Deniz; Hohmann, Volker; Winneke, Axel; Hernáez Rioja, Inmaculada
Published in: Procesamiento del lenguaje natural, Issue 21, 2019, ISSN 1135-5948
Publisher: Sociedad Espanola para el Procesamiento del Lenguaje Natural
DOI: 10045/96604

Influence of visual cues on head and eye movements during listening tasks in multi-talker audiovisual environments with animated characters

Author(s): Maartje M.E. Hendrikse, Gerard Llorach, Giso Grimm, Volker Hohmann
Published in: Speech Communication, Issue 101, 2018, Page(s) 70-84, ISSN 0167-6393
Publisher: Elsevier BV
DOI: 10.1016/j.specom.2018.05.008

Maximum Speech Performance and Executive Control in Young Adult Speakers

Author(s): Chen Shen, Esther Janse
Published in: Journal of Speech, Language, and Hearing Research, 2020, Page(s) 1-17, ISSN 1092-4388
Publisher: American Speech-Language-Hearing Association
DOI: 10.1044/2020_JSLHR-19-00257

Intelligibility and Listening Effort of Spanish Oesophageal Speech

Author(s): Sneha Raman, Luis Serrano, Axel Winneke, Eva Navas, Inma Hernaez
Published in: Applied Sciences, Issue 9/16, 2019, Page(s) 3233, ISSN 2076-3417
Publisher: MDPI AG
DOI: 10.3390/app9163233

Book chapters (1)

Say Hi to Eliza - An Embodied Conversational Agent on the Web

Author(s): Gerard Llorach, Josep Blat
Published in: Lecture Notes in Computer Science, vol 10498, 2017, Page(s) 255-258, ISBN 978-3-319-67401-8
Publisher: Springer International Publishing
DOI: 10.1007/978-3-319-67401-8_34