Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

From Whisper to Voice: Real-Time on-Device Assistive AI Technology for Human Connection

Objective

Voice disabilities resulting from devastating diseases such as throat cancer as well as severe stuttering affect people’s ability to naturally communicate, seriously impacting the daily lives of millions of people all around the world. In total, worldwide, ~300 million people grapple with such issues. The repercussions are profound, affecting daily life, work, and overall happiness. This challenge is due to a range of conditions from neurological disorders to the aftermath of surgery or trauma. These conditions significantly hinder personal, educational, and professional communication. Studies show that individuals with such impairments often experience social withdrawal, anxiety, and underemployment, particularly in roles where verbal fluency is essential.
Research and clinical observation have shown that whispering can significantly reduce stuttering while allowing for a more relaxed speech for people suffering from voice disabilities. In specific, stuttering reduces up to 85% while whispering.
Whispp is a Dutch startup that has been honoured as one of TIME's Best Inventions of 2024 and received the CES Innovation Award in the Accessibility & Aging Tech category. We have developed a novel technology that converts voiceless speech signals as input into natural, voiced speech. To do so, we leverage our unique and proprietary real-time assistive voice AI technology which utilizes a W2S (Whisper to Speech) algorithm that interprets audio waveforms into acoustic units prior to converting them into voices with satisfactory intelligibility and prosody.
Our AI is optimized to run directly on-device allowing for ultra-low latency (<50ms vs. up to 4 sec of SoA), enhanced privacy, and offline usability—especially critical in mobile, wearable, and safety-critical applications. Besides, our technology is language-agnostic, directly operating on acoustic signal rather than relying on language-specific models, enabling seamless support across different languages/dialects.

Fields of science (EuroSciVoc)

CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.

This project has not yet been classified with EuroSciVoc.
Be the first one to suggest relevant scientific fields and help us improve our classification service

You need to log in or register to use this function

Keywords

Project’s keywords as indicated by the project coordinator. Not to be confused with the EuroSciVoc taxonomy (Fields of science)

Programme(s)

Multi-annual funding programmes that define the EU’s priorities for research and innovation.

Topic(s)

Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.

Funding Scheme

Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.

HORIZON-EIC-ACC - HORIZON EIC Accelerator

See all projects funded under this funding scheme

Call for proposal

Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.

(opens in new window) HORIZON-EIC-2025-ACCELERATOR-02

See all projects funded under this call

Coordinator

WHISPP BV
Net EU contribution

Net EU financial contribution. The sum of money that the participant receives, deducted by the EU contribution to its linked third party. It considers the distribution of the EU financial contribution between direct beneficiaries of the project and other types of participants, like third-party participants.

€ 2 498 319,00
Address
LANGEGRACHT 70
2312 NV Leiden
Netherlands

See on map

SME

The organization defined itself as SME (small and medium-sized enterprise) at the time the Grant Agreement was signed.

Yes
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
Links
Total cost

The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.

No data