Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS
Content archived on 2022-12-23

Speech Generation in Multimodal Information Systems

Objective

The aim of SPEAK is to construct a proof-of-concept prototype of a multimodal information system combining graphical and spoken language output in a variety of languages.

The multi-modal user interface will be able to generate automatically, from a deep representation of information and of speaker and hearer goals, meta-communication concerning the information retrieval process. Particular attention is to be placed on the intonational adequacy of the synthesized speech in the context of the information retrieval dialogue between information seeker and machine. Here, improvements in the speech, and hence in the acceptability of speech synthesis technology, may be gained by relying on an information-rich system that includes formalizations of communicative intent and functional organization.

PROGRESS AND RESULTS

An initial specification for the functional, dialogue-appropriate control of intonation for German has been completed. A model of information retrieval as a dialogic process of negotiation between information seeker and giver has also been extended and incorporated.

INFORMATION DISSEMINATION ACTIVITIES AND EXPLOITATION

A database of prospective users and parties interested in the progress and results of the project, both industrial and research, is being set up.

The results are expected to be incorporated in products marketed by a company which supplies the speech synthesis equipment used in the project.

Fields of science (EuroSciVoc)

CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.

This project has not yet been classified with EuroSciVoc.
Be the first one to suggest relevant scientific fields and help us improve our classification service

You need to log in or register to use this function

Programme(s)

Multi-annual funding programmes that define the EU’s priorities for research and innovation.

Topic(s)

Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.

projects.no_data

Call for proposal

Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.

projects.no_data

Funding Scheme

Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.

CSC - Cost-sharing contracts

Coordinator

Technische Hochschule Darmstadt and GMD/IPSI
EU contribution
No data
Address
Dolivostr. 15
64293 Darmstadt
Germany

See on map

Total cost

The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.

No data

Participants (1)