Objetivo The ALERT project aims to associate state-of-the-art speech recognition with audio and video segmentation and automatic topic indexing to develop an automatic media-monitoring demonstrator and evaluate it in the context of real world applications. The targeted languages are Portuguese, French and German. The consortium consists of academic partners well known for their work in speech processing, speech recognition, topic detection and video processing as well as of leading European media monitoring companies that offer Selective Dissemination of Information (SDI) services for clients and of a major European TV station that runs its own SDI department. Furthermore, two of the partners are software-developing companies that will serve as system integrators. They have a remarkable experience in developing software products in the field of speech and video processing.Objectives:Keeping aware of information is of strategic importance for many businesses and government agencies as well as for every citizen. With the rapid expansion of different media sources (newspapers, newswire, radio, television, internet) for information dissemination, there is a large market for monitoring these sources and an increasing need for automatic processing of the data. Therefore media monitoring is a crucial activity. For the most part today's methods are manual, with humans reading, listening and watching, annotating topics and selecting items of interest for the user. The ALERT project aims to demonstrate that by associating state-of-the-art speech recognition with audio and video segmentation and automatic topic detection, an automatic media monitoring demonstration system can be developed, which detects topics in large amounts of multimedia data and alerts appropriate users accordingly.Work description:The demonstration system to be set up within this project will store the users' special interests in lists of topics and whenever detecting one of these topics in a large multimedia database, it will alert the user. The data processed can be video, audio or written text in one of the targeted languages French, German and Portuguese.In order to have a topic detection module of high precision and accuracy, research has to be carried out in terms of robust speech recognition, topic detection on the erroneous speech recogniser output and combined video and audio based segmentation as well as on a unified representation of the different data types in the diverse languages. Video and audio-based segmentation will be used in order to obtain a coarse segmentation of TV data into shots, which carry specific information. The speech recognition module will deliver a transcription of the audio track that is associated with these data segments.Although advanced broadcast speech recognition techniques will be used in this module, incorporating the use of confidence measures and adaptation to varying speech quality, the transcription will still contain a considerable number of errors. By using sophisticated statistical methods for topic detection on this transcribed data, it is, however, possible to achieve a high topic detection rate and thus to build a high performance topic detection system, which will work for three major European languages. A demonstrator will be built that is capable of automatically detecting topics in large multimedia databases and thus is able to reduce the amount of time for media monitoring to a fraction of what is required for manual processing of the multimedia input data. In this way, the industrial partners will be enabled to process the most recent news data on the spot and alert the user instantlyMilestones:EXPECTED OUTCOME AND INNOVATION PERSPECTIVES:The major research goals with respect to the realization of the demonstrator are:- high performance speech recognisers for all the three targeted languages (French, Portuguese and German)- high performance topic detection on the erroneous output of a speech recogniser (using the best hypothesis, confidence measures and word graphs)- unified representation of different document types in multiple languages- combined video and audio based segmentationThe ALERT project demonstrated that by associating state-of-the-art speech recognition with audio and video segmentation and automatic topic detection, an automatic media monitoring demonstration system can be developed that detects topics in large amounts of multimedia data and alerts those users about the detection of this information that it is relevant for. The ALERT demonstrator has been developed for the three languages French, German and Portugues and is capable of processing and indexing multimedia content (radio or TV broadcast or internet audio/video) with a strong focus on news and information programs. Ámbito científico natural sciencescomputer and information sciencessoftwarenatural sciencescomputer and information sciencesinternetnatural sciencescomputer and information sciencesdatabases Programa(s) FP5-IST - Programme for research, technological development and demonstration on a "User-friendly information society, 1998-2002" Tema(s) 1.1.2.-3.4.1 - Multilinguality in digital content and services Convocatoria de propuestas Data not available Régimen de financiación CSC - Cost-sharing contracts Coordinador GERHARD-MERCATOR-UNIVERSITAET GESAMTHOCHSCHULE DUISBURG Aportación de la UE Sin datos Dirección LOTHARSTRASSE 65 47048 DUISBURG Alemania Ver en el mapa Coste total Sin datos Participantes (7) Ordenar alfabéticamente Ordenar por aportación de la UE Ampliar todo Contraer todo 4VDO - SISTEMAS E SERVICOS MULTIMEDIA Portugal Aportación de la UE Sin datos Dirección RUA DR. ALFREDO COSTA 9, 3D 1495-130 ALGES Ver en el mapa Coste total Sin datos CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE Francia Aportación de la UE Sin datos Dirección 3, RUE MICHEL-ANGE 75794 PARIS CEDEX 16 Ver en el mapa Coste total Sin datos INESC ID - INSTITUTO DE ENGENHARIA DE SISTEMAS E COMPUTADORES: INVESTIGACAO E DESENVOLVIMENTO EM LISBOA Portugal Aportación de la UE Sin datos Dirección RUA DE ALVES REDOL 9 1000-029 LISBOA Ver en el mapa Coste total Sin datos OBSERVER-ARGUS MEDIA GMBH Alemania Aportación de la UE Sin datos Dirección HOEHENSTRASSE 16 70736 FELLBACH Ver en el mapa Coste total Sin datos RTP RADIOTELEVISAO PORTUGUESA SA Portugal Aportación de la UE Sin datos Dirección AVENIDA 5 DE OUTUBRO 197 1000 LISBOA Ver en el mapa Coste total Sin datos SOCIETE D'ETUDES DE LA CONSOMMATION DISTRIBUTION ET PUBLICITESOCODIP Francia Aportación de la UE Sin datos Dirección 2 RUE FRANCIS PEDRON 78240 CHAMBOURCY Ver en el mapa Coste total Sin datos VECSYS Francia Aportación de la UE Sin datos Dirección RUE DE LA TERRE DE FEU 3 91940 LES ULIS Ver en el mapa Coste total Sin datos