CORDIS
EU research results

CORDIS

English EN
Multimedia Indexing and Searching Environment

Multimedia Indexing and Searching Environment

Objective

MUMIS will develop base technology, demonstrated within a laboratory prototype, to support automated multimedia indexing and to facilitate search and retrieval from multimedia databases in specific domains. The project will demonstrate that innovative technology components can operate on multilingual, multisource, and multimodal information and create a meaningful and queryable database with video content from the soccer domain.

Objectives:
MUMIS will develop technology for the indexing and retrieval of data from different media sources (textual documents, radio and television programmes) for the selected domain (soccer)

MUMIS will develop technology for automatic indexing of multimedia programme material, including:

Data capture software, to digitise audio and video recordings, standardise text files, extract text from subtitle files
Speech recognition software, to extract text elements from audio files and video soundtracks
Text annotation (information extraction) tools to extract annotations from texts
Fusion software (merging tool) to combine semantically identical annotations taken from different media and in different languages (Dutch, English, German).

Develop a user interface (in Dutch, English, German and Swedish) to enable professional users to query the database, by selecting from menus based on annotations, metadata, and so on, and to view video fragments which satisfy the query.

Work description:
From a technological perspective, MUMIS is one of the first multimedia indexing projects which:

uses multimedia and multilingual information sources;
combines topic triggering by information retrieval (IR) with information extraction (IE) based on more detailed linguistic processing;
carries out multimedia indexing by applying information extraction to a well-delineated domain and using already existing information as constraints;
uses and extends advanced language technology to automatically create formal annotations for multimedia content;
merges information from many sources to improve the quality of the annotation database;
combines database queries with direct access to multimedia fragments over the web, to access distributed servers and using non-proprietary media streaming methods.

In terms of economic benefits, MUMIS will make access to video archives cheaper and more effective for professional users, reducing the cost of programme making. When applied beyond the professional market, MUMIS will make a contribution to improving employment, because it will help to launch a completely new line of electronic business:
- the sale of the contents of the enormously large and ever growing archives of digital multimedia programmes.

Leaflet | Map data © OpenStreetMap contributors, Credit: EC-GISCO, © EuroGeographics for the administrative boundaries

Coordinator

UNIVERSITEIT TWENTE

Address

Drienerlolaan 5
7522 Nb Enschede

Netherlands

Administrative Contact

Franciska DE JONG

Participants (6)

Sort alphabetically

Expand all

DEUTSCHES FORSCHUNGSZENTRUM FUER KUENSTLICHE INTELLIGENZ GMBH

Germany

ESTEAM AB

Sweden

MAX-PLANCK-GESELLSCHAFT ZUR FOERDERUNG DER WISSENSCHAFT VERTRETEN DURCH DAS MAX-PLANCK-INSTITUT FUER PSYCHOLINGUISTIK

Netherlands

STICHTING KATHOLIEKE UNIVERSITEIT

Netherlands

THE UNIVERSITY OF SHEFFIELD

United Kingdom

VDA INFORMATIEBEHEERSING BV

Netherlands

Project information

Grant agreement ID: IST-1999-10651

  • Start date

    1 July 2000

  • End date

    31 December 2002

Funded under:

FP5-IST

  • Overall budget:

    € 3 728 988

  • EU contribution

    € 2 425 000

Coordinated by:

UNIVERSITEIT TWENTE

Netherlands