Skip to main content

Multimedia Information Retrieval


The Group is researching new methods and techniques for information storage and retrieval so that all types of media can be handled in an integrated manner through adaptive interaction with a user.
New methods and techniques are being researched for information storage and retrieval so that all types of media can be handled in an integrated manner through adaptive interaction with a user. Topics include human computer interaction, logical and probabilistic models of information retrieval, run time support for multimedia information retrieval and evaluation of retrieval effectiveness.

The 2 workshops organized concentrated on: the presentation and discussion of the research activities carried out by the single partners; modelling and indexing multimedia information.

On going research work was discussed in formal and informal presentations and round table discussions were organized. External researchers were invited to attend the workshop and participated actively in the discussions. Studies undertaken by the partners on: a logical approach to the modelling of multimedia information retrieval, probabilistic information retrieval, audio retrieval, store models for multimedia data, and multimodal interaction gave encouraging results.
The approach is multi-disciplinary, bringing together ideas from IR, DBMS, AI and HCI. A major aim is to develop example logics in the context of object-oriented approaches to data models, and storage structures within which new retrieval models can be described, implemented, and tested. The investigations of new retrieval models, based on formal logic and a theory of uncertainty, will address the claim that retrieval can be viewed as a form of inference. To produce convincing evidence of the practical viability of the work, the Group will study the scaleability and performance characteristics of models and designs for very large multimedia information bases. A major feature of the approach is that IR systems must be constructed to be adaptive to user interaction from the beginning. Such a process of adaptation will be useable only if thought is given to the design of appropriate user interfaces supporting the multimedia information-seeking and browsing activities of users. Hence the partners in their research will emphasise the relationship between user interfaces and the formal models.


Activities will be focused on four main themes: the modelling of retrieval, run-time support for information retrieval, human computer interaction and evaluation techniques. Meetings will be held on specific topics and a plenary workshop convened on the research activity of all the participants. Representatives from industry will be invited to attend the workshop and to evaluate the lines of research and the results produced. If specific topics are found to be of special interest or relevance, the Group will organise appropriate workshops. An e-m distribution list has been already set up for the fast dissemination of information among Group partners.


The cooperation between the research groups involved in this project will promote or reinforce new research areas related to multimedia information retrieval. At first it will greatly facilitate the integration of the multiple aspects of the problem and the corresponding approaches within a common theoretical framework, so that results will initially have their main impact on existing research projects and prototypes on one hand, and improvement scientific collaboration IR community on the other hand. In the longer term, the potential for exploitation of these results by the IT industry is enormous, as the increasing use of wide-area networks and multimedia technologies is dramatically increasing the need for the new type of IR system that the Group is investigating.


Via G. Moruzzi 1
56124 Pisa

Participants (5)

Leonardstr., 27
8092 Zurich
Gesellschaft für Mathematik und Datenverarbeitung mbH
Schloß Birlinghoven
53754 Sankt Augustin
El. Venizelou, 34, 133
73100 Chania
United Kingdom
Oakfield Avenue, Rankine Building
G12 8LT Glasgow
Université de Grenoble I (Université Joseph Fourier)
385 Avenue De La Bibliothèque
38041 Grenoble