Servizio Comunitario di Informazione in materia di Ricerca e Sviluppo - CORDIS

FP7 3DTVS

3DTVS

Project reference: 287674
Funded under

3DTV Content Search

From 2011-11-01 to 2015-01-31

Project details

Total cost:

EUR 3 517 641

EU contribution:

EUR 2 570 650

Coordinated in:

Greece

Call for proposal:

FP7-ICT-2011-7See other projects for this call

Funding scheme:

CP - Collaborative project (generic)

3DTVS deals with algorithms and techniques for the analysis, indexing and browsing of 3D television content so that it can be efficiently annotated, stored, searched and retrieved in 3D audiovisual ar

3D video content is already being accumulated in 3D television (3DTV) broadcasters and 3D video/cinema  production houses. Such content is also being posted in social networks or websites like YouTube. It consists primarily of stereoscopic video and multichannel  sound and must be annotated, archived, searched and retrieved. However, it cannot be properly analyzed using algorithms for “2D video” and stereo audio content, or accommodated well within classical audiovisual media archives, because such algorithms and archives do not take into account or exploit information regarding the third dimension (depth). The goal of the 3DTVS project is to devise  novel 3DTV audiovisual content analysis,  description, indexing, search and browsing methods, and to incorporate such functionalities in 3D audiovisual content archives. The major novelty of the researched approaches is in exploiting 3D (depth) information. Thus, the corresponding archiving system would be able to address user  queries of the form ‘find stereo videos with poor/good stereoscopic quality’ or ‘find stereo videos, where actor X actually approaches actor Y in the 3D space’.

Objective

As 3DTV emerges, 3DTV content started already being accumulated in 3DTV broadcasters and 3D video production houses. Its volume will soon rise tremendously. Such content already started being posted in the web, as already done for 2D audiovisual material. Furthermore, with the advent of 3D mobile devices, such content is expected to be posted soon in social networks or user-fed audiovisual archives (e.g. YouTube). Such 3DTV audiovisual content consists primarily of stereo, video+depth or multiple views video and multichannel 5.1 or 7.1 sound and must be properly archived, searched and retrieved. However, it cannot be accommodated well within classical audiovisual media archives, because such archives do not exploit depth information, when indexing, searching, retrieving and browsing 3DTV content. Certain tasks, e.g. creation of 3D video summaries and browsing are inherently different in 3D than in 2D content. Therefore, new efficient schemes must be devised for content-based 3DTV audiovisual (AV) content description, indexing, fast search and browsing.The goal of the 3DTVS project is to devise scalable 3DTV AV content description, indexing, search and browsing methods across open platforms, by using mobile and desktop user interfaces and to incorporate such functionalities in 3D audiovisual content archives. The major novelty in 3DTV content indexing/retrieval research will be on how to exploit 3D (depth) information for stereo and multiview video indexing, retrieval and browsing that could address semantic queries of the form 'find stereo videos with shallow depth' or 'find stereo videos, where actor X approaches actor Y'. 3D multichannel audio analysis will perform better audio source (e.g. musical instrument) separation and localization that will be used in 3D audio/cross-modal indexing and retrieval. Multimodal 3D audiovisual content analysis will built on the results of 3D video and audio analysis. 3DTV content description and search mechanisms will be developed to enable fast reply to semantic queries. User friendly mobile/desktop search interfaces will be built that could also permit adaptation to the user needs and profile. The novel results that will be generated within 3DTVS will:•\treinforce the position of the European ICT and digital media industry in the 3D television sector, by opening wider market opportunities;•\tprovide greater creativity both to 3DTV professionals and to the average user, stimulated through technologies and tools to search/exchange professional and user generated 3DTV content, possibly also to be used in immersive and interactive applications;•\tprovide innovative offers to 3DTV content aggregators with tools and interfaces audiovisual 3DTV content consumption.

Related information

Documents and Publications

Open Access

Multimedia

Coordinator

ARISTOTELIO PANEPISTIMIO THESSALONIKIS
Greece

EU contribution: EUR 769 378


Administration Building, University Campus
54124 THESSALONIKI
Greece
Administrative contact: Georgia Petridou
Tel.: +30 2310 996741
Fax: +30 2310 853283
E-mail

Participants

FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V
Germany

EU contribution: EUR 523 130


Hansastrasse 27C
80686 MUNCHEN
Germany
Administrative contact: Andrea Zeumann
Tel.: +49 89 1205 2723
Fax: +49 89 1205 7534
E-mail
SKY DEUTSCHLAND FERNSEHEN GMBH & COKG
Germany

EU contribution: EUR 132 000


MEDIENALLEE 26
85774 UNTERFOHRING
Germany
Administrative contact: Stephan Heimbecher
Tel.: +49 89 99586073
Fax: +49 89 9958 6309
E-mail
FLYING EYE MANAGEMENTBERATUNG FUR MEDIENINVESTITIONEN GMBH
Germany

EU contribution: EUR 252 225


ROBERT BOSCH STRASSE 7
64293 DARMSTADT
Germany
Administrative contact: Hans-Peter Richter
Tel.: +49 6151 668509 12
Fax: +49 6151 668509 20
E-mail
INSTITUT DE RECHERCHE ET DE COORDINATION ACOUSTIQUE MUSIQUE - IRCAM
France

EU contribution: EUR 480 157


RUE SAINT MERRI 31
75004 PARIS
France
Administrative contact: Hugues Vinet
Tel.: +33144784888
E-mail
ASSOCIATION RELATIVE A LA TELEVISION EUROPEENNE
France

EU contribution: EUR 94 560


QUAI DU CHANOINE WINTERER 4
67000 STRASBOURG
France
Administrative contact: Thomas Palm
Tel.: +33 3 88 14 23 81
Fax: +33 3 88 14 2015
E-mail
VELTI ANONYMI ETAIREIA PROIONTON LOGISMIKOU & SYNAFON PRIONTON & PIRESION
Greece

EU contribution: EUR 319 200


KIFISSIAS AVE 44 BUILDING B FL1
15235 MAROUSSI ATHINA
Greece
Administrative contact: Giannis Katsaros
Tel.: +302106378905
Fax: +302106378888
E-mail
Record Number: 100975 / Last updated on: 2016-04-05