Community Research and Development Information Service - CORDIS

FP6 SHF_logo

SEMANTIC HIFI

Project ID: 507913
Funded under

Browsing, listening, interacting, performing, sharing on future HIFI systems

From 2003-12-01 to 2006-11-30, closed project | SEMANTIC HIFI Website

Project details

Total cost:

EUR 5 255 830

EU contribution:

EUR 2 784 000

Coordinated in:

France

Call for proposal:

FP6-2002-IST-1See other projects for this call

Funding scheme:

STREP - Specific Targeted Research Project

Description

New methods for managing and manipulating music

Most of us like to get immersed in our favourite music, but what we mean by that term may be about to undergo a redefinition when the next generation of hard-disk-based hi-fi systems is rolled out.

In the not too distant future listeners will have the option of diving right into the music to find out everything about a particular track, including how it was composed and mixed. And if there is something they do not like about a particular song, or they simply feel like experimenting, they will be able to change the tune.

Empowering the home user

European researchers in the SemanticHiFi project spent three years looking into ways of drastically changing the home user’s relationship to music. They are developing ways of allowing them to interact with music through a new generation of high-fidelity sound systems, offering ways of browsing, interacting, rendering, personalising and editing musical material.

Largely as a result of the research, consumers will also be able to search and react with large-scale on-line music catalogues in ways not previously possible.

In a project that has blurred the traditional limits between playing, performing, remixing and passively listening to music, the researchers have made three major achievements.

Interacting with the music

The first has been to develop the necessary hardware platform, the hi-fi player itself, equipped with a set of advanced features that allows it to use a variety of different access modes and interfaces.

The hi-fi plays the music and also gives listeners the ability to delve into and interact with music stored in different formats such as those used for CDs, DVDs and on-line.

With the shift to buying and playing music on-line, next-generation hi-fi needs to be integrated with the internet and to have its own unique internet protocol (IP) address. The system must have full access to the internet and the music and catalogues stored there, and can also communicate with other hi-fi players on a network.

Not only will listeners be able to interact with, and change, music they have bought, but they will be able to share the changes with friends and colleagues. In turn, they will be able to do their own editing of the music.

But although the project uses peer-to-peer (P2P) technology, intellectual property rights to the music remain protected. Rather than permitting the illegal sharing of musical data, here P2P is employed for sharing other kinds of relevant data, such as metadata, playlists, performing data and messages between peers.

Adding data about data

The second achievement has been the development of authoring-tools software aimed at more advanced users, such as music industry professionals. Running on a separate dedicated computer, this software allows the user to add a variety of information to music files as well as perform more advanced interactive and editing functions.

The software will enable large amounts of metadata – descriptive search information about data – to be added to music files. This information can be anything from individual consumer’s playlists or personal music categories to the score for the music and details of how it was mixed. Users will have access to all of this information.

Thirdly, the researchers have created a metadata-sharing system. The online file-sharing system allows any user with the new hi-fi software to share both their own metadata and any changes they have made to individual music files.

While many of us will no doubt continue to get immersed in music ‘in the old way’, the new technology will enable many others to participate in it much more actively.

Objective

In the context of large scale digital music, the goal of the project is to develop a new generation of HIFI systems, offering new functionality for browsing, interacting, rendering, personalizing and editing musical material. This next generation of Hard-disk based HIFI systems will change drastically the relation of home users to music and multimedia content. Users will be able to interact with music up to the point of blurring the traditional limits between playing, performing and remixing. These HIFI systems will be listening stations as much as open instruments. Technically, with IPv6, every HIFI system will have an IP address and systematic use of metadata extraction and exploitation techniques will allow semantic or thematic browsing in large content catalogues over Web and file sharing systems. Converging with the TV, DVD, Game Station and 5.1 set-ups, HIFI systems will also bring 3D audio real-time navigation in the sound scene.The main innovations include a deeper access to the audio content and structure, through state-of-the-art semantic musical metadata extraction and exploitation (partially from MPEG-7): temporal segmentation, polyphonic, melodic, and high-level descriptions like genre, etc. Users will be offered innovative possibilities of manipulation, edition, re-composition, organization, sharing and interactivity with the audio material, and true 3D audio rendering and real time remixing of music.Using music from CDs, consumers will be able to freely exchange metadata information enriching their music and allowing them to listen to remix sessions performed by other users. But with appropriate DRM systems sharing music files is also possible and may even support new profitable music business models for the music industry. Bringing together leading European music research and industry partners, Semantic HIFI will deliver next generation tools for HIFI systems and also as modular PC applications, both validated by musicians and expert users.

Related information

Documents and Publications

Multimedia

Coordinator contact

Hugues Vinet, (Project Coordinator)
Tel.: +33 1 44784488
Fax: +33 1 4478150
E-mail

Coordinator

INSTITUT DE RECHERCHE ET DE COORDINATION ACOUSTIQUE MUSIQUE - IRCAM
France

EU contribution: EUR 1 134 941


RUE SAINT MERRI 31
75004 PARIS
France
Activity type: Research Organisations
Administrative contact: HUGUES VINET
Tel.: +33-01-44784488
Fax: +33-01-44781540
E-mail

Participants

NATIVE INSTRUMENTS SOFTWARE SYNTHESIS GMBH
Germany

EU contribution: EUR 295 032


SCHLESISCHE STRASSE 28
10997 BERLIN
Germany
Activity type: Other
Administrative contact: Florian Plenge
Tel.: +49 30 61103572
Fax: +49 30 61103535
E-mail
SONY DEUTSCHLAND GMBH
Germany

EU contribution: EUR 205 790


KEMPERPLATZ 1
10785 BERLIN
Germany
Activity type: Private for-profit entities (excluding Higher or Secondary Education Establishments)
Administrative contact: Markus Zumkeller
Tel.: 497115858293
Fax: 49711585899293
E-mail
FRAUNHOFER GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Germany

EU contribution: EUR 352 455


HANSASTRASSE 27C
80686 MUNCHEN
Germany
Activity type: Research Organisations
Administrative contact: Thomas Sporer
Tel.: 00493677694341
Fax: 004936774399
FUNDACIO BARCELONA MEDIA UNIVERSITAT POMPEU FABRA
Spain

EU contribution: EUR 230 902


PLAZA DE LA MERCE 10-12
08002 BARCELONA
Spain
Activity type: Higher or Secondary Education Establishments
Administrative contact: Xavier SERRA
Tel.: +34935422164
Fax: +34935422202
SONY FRANCE S.A.
France

EU contribution: EUR 412 531


20 RUE MOREL
92110 CLICHY
France
Activity type: Private for-profit entities (excluding Higher or Secondary Education Establishments)
Administrative contact: François Pachet
Tel.: +33-1-44080516
Fax: +33-1-45878750
E-mail
BEN-GURION UNIVERSITY OF THE NEGEV
Israel

EU contribution: EUR 112 349


.
84105 BEER SHEVA
Israel
Activity type: Higher or Secondary Education Establishments
Administrative contact: Mr Hadar
Tel.: +972-8-6477235
Fax: +972-8-6472883
E-mail
Follow us on: RSS Facebook Twitter YouTube Managed by the EU Publications Office Top