Skip to main content

Multimedia Indexing and Searching Environment

Objective

MUMIS will develop base technology, demonstrated within a laboratory prototype, to support automated multimedia indexing and to facilitate search and retrieval from multimedia databases in specific domains. The project will demonstrate that innovative technology components can operate on multilingual, multisource, and multimodal information and create a meaningful and queryable database with video content from the soccer domain.

Objectives:
MUMIS will develop technology for the indexing and retrieval of data from different media sources (textual documents, radio and television programmes) for the selected domain (soccer)

MUMIS will develop technology for automatic indexing of multimedia programme material, including:

Data capture software, to digitise audio and video recordings, standardise text files, extract text from subtitle files
Speech recognition software, to extract text elements from audio files and video soundtracks
Text annotation (information extraction) tools to extract annotations from texts
Fusion software (merging tool) to combine semantically identical annotations taken from different media and in different languages (Dutch, English, German).

Develop a user interface (in Dutch, English, German and Swedish) to enable professional users to query the database, by selecting from menus based on annotations, metadata, and so on, and to view video fragments which satisfy the query.

Work description:
From a technological perspective, MUMIS is one of the first multimedia indexing projects which:

uses multimedia and multilingual information sources;
combines topic triggering by information retrieval (IR) with information extraction (IE) based on more detailed linguistic processing;
carries out multimedia indexing by applying information extraction to a well-delineated domain and using already existing information as constraints;
uses and extends advanced language technology to automatically create formal annotations for multimedia content;
merges information from many sources to improve the quality of the annotation database;
combines database queries with direct access to multimedia fragments over the web, to access distributed servers and using non-proprietary media streaming methods.

In terms of economic benefits, MUMIS will make access to video archives cheaper and more effective for professional users, reducing the cost of programme making. When applied beyond the professional market, MUMIS will make a contribution to improving employment, because it will help to launch a completely new line of electronic business:
- the sale of the contents of the enormously large and ever growing archives of digital multimedia programmes.

Coordinator

UNIVERSITEIT TWENTE
Address
Drienerlolaan 5
7522 NB Enschede
Netherlands

Participants (6)

DEUTSCHES FORSCHUNGSZENTRUM FUER KUENSTLICHE INTELLIGENZ GMBH
Germany
Address
Erwin-schroedinger-strasse 57
67663 Kaiserslautern
ESTEAM AB
Sweden
Address
Vastra Gunnesgarde 3
417 43 Goeteborg
MAX-PLANCK-GESELLSCHAFT ZUR FOERDERUNG DER WISSENSCHAFT VERTRETEN DURCH DAS MAX-PLANCK-INSTITUT FUER PSYCHOLINGUISTIK
Netherlands
Address
Wundtlaan 1
6500 AH Nijmegen
STICHTING KATHOLIEKE UNIVERSITEIT
Netherlands
Address
Geert Grooteplein-noord 9
6525 EZ Nijmegen
THE UNIVERSITY OF SHEFFIELD
United Kingdom
Address
Firth Court, Western Bank
S10 2TN Sheffield
VDA INFORMATIEBEHEERSING BV
Netherlands
Address
Seinstraat 32
1200 CG Hilversum