Cost-effective, Multilingual, Privacy-driven voice-enabled Services

Leistungen

Open Research Data Pilot (1)

Initial data management plan

Initial data management plan

Documents, reports (4)

Initial scientific evaluation

First combined evaluation of baseline speech, dialog, and translation tools.

Platform hardware and software architecture

Platform specification including main requirements, hardware and software architecture

SDK software architecture

SDK specification including main requirements and software architecture

Data protection and GDPR requirements

Guidelines, procedures and recommendations how to implement personal data protection in the platform.

Websites, patent fillings, videos etc. (2)

Dissemination and communication action plan

Summarises all planned dissemination actions and provides communication material to the partners (logo, graphical chart, public website, short presentation of the project, templates, poster, leaflet)

First dissemination and communication report

Update on the actions conducted and web document defining the COMPRISE knowledge repository on multilingual voice-enabled applications.

Other (5)

Baseline speech and text transformation and model learning library

Design, implementation, and evaluation of baseline transformations focusing on deleting the user’s identity and words carrying critical information, and model learning.

Improved transformation library and initial privacy guarantees

Design, implementation, and evaluation of speech and text transformations addressing more types of private information and initial statistical utility/privacy bounds.

Initial multilingual interaction library

Software components and documentation for speech-to-speech translation and integration of dialog systems in the operating branch.

Initial weakly supervised learning library

Design, implementation, and evaluation of weakly supervised learning for spoken language understanding.

Initial personalised learning library for speech-to-text

Design, implementation, and evaluation of initial model personalisation strategies for speech-to-text.

Veröffentlichungen

Conference proceedings (21)

Transfer Learning and Distant Supervision for Multilingual Transformer Models: A Study on African Languages

Autoren: Michael A. Hedderich; David Ifeoluwa Adelani; Dawei Zhu; Jesujoba O. Alabi; Udia Markus; Dietrich Klakow
Veröffentlicht in: 2020 Conference on Empirical Methods in Natural Language Processing, 16/11/2020, 2020
Herausgeber: ACL
DOI: 10.18653/v1/2020.emnlp-main.204

Distant supervision and noisy label learning for low resource named entity recognition: A study on Hausa and Yorùbá

Autoren: Adelani, David Ifeoluwa; Hedderich, Michael,; Zhu, Dawei; Van Den Berg, Esther; Klakow, Dietrich
Veröffentlicht in: AfricaNLP / PML4DC Workshop 2020 @ICLR 2020, 26/04/2020, 2020
Herausgeber: OpenReview.net

Preventing author profiling through zero-shot multilingual back-translation

Autoren: Adelani, David,; Zhang, Miaoran; Shen, Xiaoyu; Davody, Ali; Kleinbauer, Thomas; Klakow, Dietrich
Veröffentlicht in: 2021 Conference on Empirical Methods in Natural Language Processing, 07/11/2021, 2021
Herausgeber: ACL

The effect of domain and diacritics in Yorùbá-English neural machine translation

Autoren: Adelani, David,; Ruiter, Dana; Alabi, Jesujoba,; Adebonojo, Damilola; Ayeni, Adesina; Adeyemi, Mofetoluwa; Awokoya, Ayodele; Espana-Bonet, Cristina
Veröffentlicht in: 18th Biennial Machine Translation Summit, 16/08/2021, 2021
Herausgeber: AMTA

Benchmarking and challenges in security and privacy for voice biometrics

Autoren: Bonastre, Jean-Francois; Delgado, Hector; Evans, Nicholas; Kinnunen, Tomi; Lee, Kong Aik; Liu, Xuechen; Nautsch, Andreas; Noe, Paul-Gauthier; Patino, Jose; Sahidullah, Md; Srivastava, Brij Mohan Lal; Todisco, Massimiliano; Tomashenko, Natalia; Vincent, Emmanuel; Wang, Xin; Yamagishi, Junichi
Veröffentlicht in: 1st ISCA Symposium on Security and Privacy in Speech Communication, 10/11/2021, 2021
Herausgeber: ISCA

Privacy-Preserving Adversarial Representation Learning in ASR: Reality or Illusion?

Autoren: Srivastava, Brij Mohan Lal; Bellet, Aurélien; Tommasi, Marc; Vincent, Emmanuel
Veröffentlicht in: INTERSPEECH 2019, 15/09/2019, 2019, Page(s) 3700-3704
Herausgeber: ISCA

Introducing the VoicePrivacy initiative

Autoren: Tomashenko, Natalia; Srivastava, Brij Mohan Lal,; Wang, Xin; Vincent, Emmanuel; Nautsch, Andreas; Yamagishi, Junichi; Evans, Nicholas; Patino, Jose; Bonastre, J.-F; Noé, Paul-Gauthier; Todisco, Massimiliano
Veröffentlicht in: INTERSPEECH 2020, 25/10/2020, 2020
Herausgeber: ISCA

Evaluating Voice Conversion-based Privacy Protection against Informed Attackers

Autoren: Srivastava, Brij Mohan Lal; Vauquier, Nathalie; Sahidullah, Md; Bellet, Aurélien; Tommasi, Marc; Vincent, Emmanuel
Veröffentlicht in: 2020 IEEE International Conference on Acoustics, Speech, and Signal Processing, 04/05/2020, 2020, Page(s) 2802-2806
Herausgeber: IEEE

Investigating the Impact of Pre-trained Word Embeddings on Memorization in Neural Networks

Autoren: Thomas, Aleena; Adelani, David; Davody, Ali; Mogadala, Aditya; Klakow, Dietrich
Veröffentlicht in: 23rd International Conference on Text, Speech and Dialogue, 08/09/2020, 2020
Herausgeber: Springer

Design Choices for X-vector Based Speaker Anonymization

Autoren: Srivastava, Brij Mohan Lal; Tomashenko, Natalia; Wang, Xin; Vincent, Emmanuel; Yamagishi, Junichi; Maouche, Mohamed; Bellet, Aurélien; Tommasi, Marc
Veröffentlicht in: INTERSPEECH 2020, 25/10/2020, 2020
Herausgeber: ISCA

The COMPRISE Cloud Platform

Autoren: Skadiņš, Raivis; Salimbajevs, Askars
Veröffentlicht in: 1st International Workshop on Language Technology Platforms, 16/05/2020, 2020, Page(s) 108–111
Herausgeber: European Language Resources Association

Using Privacy-Transformed Speech in the Automatic Speech Recognition Acoustic Model Training

Autoren: Salimbajevs, Askars
Veröffentlicht in: 9th International Conference on Human Language Technologies – the Baltic Perspective, 22/09/2020, 2020
Herausgeber: IOS Press

Assessing Unintended Memorization in Neural Discriminative Sequence Models

Autoren: Helali, Mossad; Kleinbauer, Thomas; Klakow, Dietrich
Veröffentlicht in: 23rd International Conference on Text, Speech and Dialogue, 08/09/2020, 2020
Herausgeber: Springer

Private Protocols for U-Statistics in the Local Model and Beyond

Autoren: Bell, James; Bellet, Aurélien; Gascón, Adrià; Kulkarni, Tejas
Veröffentlicht in: International Conference on Artificial Intelligence and Statistics, 27/08/2020, 2020, Page(s) 1573-1583
Herausgeber: Proceedings of Machine Learning Research

Data Augmentation for Pipeline-Based Speech Translation

Autoren: Alves, Diego; Salimbajevs, Askars; Pinnis, Mārcis
Veröffentlicht in: 9th International Conference on Human Language Technologies – the Baltic Perspective, 22/09/2020, 2020
Herausgeber: IOS Press

A Comparative Study of Speech Anonymization Metrics

Autoren: Maouche, Mohamed; Srivastava, Brij Mohan Lal; Vauquier, Nathalie; Bellet, Aurélien; Tommasi, Marc; Vincent, Emmanuel
Veröffentlicht in: INTERSPEECH 2020, 25/10/2020, 2020
Herausgeber: ISCA

On Semi-Supervised LF-MMI Training of Acoustic Models with Limited Data

Autoren: Sheikh, Imran; Vincent, Emmanuel; Illina, Irina
Veröffentlicht in: INTERSPEECH 2020, 25/10/2020, 2020
Herausgeber: ISCA

Achieving Multi-Accent ASR via Unsupervised Acoustic Model Adaptation

Autoren: Turan, M. A. Tuğtekin; Vincent, Emmanuel; Jouvet, Denis
Veröffentlicht in: INTERSPEECH 2020, 25/10/2020, 2020
Herausgeber: ISCA

Privacy Guarantees for De-identifying Text Transformations

Autoren: Adelani, David Ifeoluwa; Davody, Ali; Kleinbauer, Thomas; Klakow, Dietrich
Veröffentlicht in: INTERSPEECH 2020, 25/10/2020, 2020
Herausgeber: ISCA

Who Started this Rumor? Quantifying the Natural Differential Privacy Guarantees of Gossip Protocols

Autoren: Bellet, Aurélien; Guerraoui, Rachid; Hendrikx, Hadrien
Veröffentlicht in: 34th International Symposium on Distributed Computing, 12/10/2020, 2020
Herausgeber: LIPIcs

Fully Decentralized Joint Learning of Personalized Models and Collaboration Graphs

Autoren: Zantedeschi, Valentina; Bellet, Aurélien; Tommasi, Marc
Veröffentlicht in: 23rd International Conference on Artificial Intelligence and Statistics, 26/08/2020, 2020
Herausgeber: PMLR

Peer reviewed articles (3)

MasakhaNER: Named Entity Recognition for African Languages

Autoren: David Ifeoluwa Adelani; Jade Abbott; Graham Neubig; Daniel D’souza; Julia Kreutzer; Constantine Lignos; Chester Palen-Michel; Happy Buzaaba; Shruti Rijhwani; Sebastian Ruder; Stephen Mayhew; Israel Abebe Azime; Shamsuddeen H. Muhammad; Chris Chinenye Emezue; Joyce Nakatumba-Nabende; Perez Ogayo; Aremu Anuoluwapo; Catherine Gitau; Derguene Mbaye; Jesujoba Alabi; Seid Muhie Yimam; Tajuddeen Rabiu
Veröffentlicht in: Transactions of the ACL, 07/10/2021, 2021, ISSN 2307-387X
Herausgeber: MIT Press
DOI: 10.1162/tacl_a_00416

How can Private Information Recorded by Voice-Enabled Systems be Identified?

Autoren: Moretón Poch, Álvaro; Jaramillo, Ariadna
Veröffentlicht in: European Data Protection Law Review, to appear, 2020, ISSN 2364-2831
Herausgeber: Lexxion

Monolingual and cross-lingual intent detection without training data in target languages

Autoren: Jurgita Kapočiūtė-Dzikienė; Askars Salimbajevs; Raivis Skadiņš
Veröffentlicht in: Electronics, 11/06/2021, 2021, ISSN 2079-9292
Herausgeber: MDPI
DOI: 10.3390/electronics10121412

Datensätze

Datensätze via OpenAIRE (9)

COMPRISE_Data13_Y-BBCTopics_V1.0

Autoren: Adelani, David; Hedderich, Michael
Veröffentlicht in: Zenodo

COMPRISE_Data04_CommonVoice_V1.0

Autoren: SRIVASTAVA, Brij Mohan Lal
Veröffentlicht in: Zenodo

COMPRISE_Data12_Y-GV-NER_V1.0

Autoren: Adelani, David
Veröffentlicht in: Zenodo

COMPRISE_Data03_LibriSpeech_V1.0

Autoren: SRIVASTAVA, Brij Mohan Lal
Veröffentlicht in: Zenodo

COMPRISE_Data10_MENYO-20K_V1.0

Autoren: Adelani, David
Veröffentlicht in: Zenodo

COMPRISE_Data11_M-NER_V1.0

Autoren: Adelani, David
Veröffentlicht in: Zenodo

COMPRISE_Data06_YELP_V1.0

Autoren: Adelani, David
Veröffentlicht in: Zenodo

COMPRISE_Data09_H-VOA-Topics_V1.0

Autoren: Adelani, David; Hedderich, Michael
Veröffentlicht in: Zenodo

COMPRISE_Data08_H-VOA-NER_V1.0

Autoren: Adelani, David; Hedderich, Michael
Veröffentlicht in: Zenodo