Immersive Experiences around TV, an integrated toolset for the production and distribution of immersive and interactive content across devices.

Projektinformationen

ImmersiaTV

ID Finanzhilfevereinbarung: 688619

DOI

10.3030/688619

Projekt abgeschlossen

EK-Unterschriftsdatum 13 November 2015

Startdatum 1 Januar 2016

Enddatum 30 Juni 2018

Finanziert unter

• INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Gesamtkosten

€ 3 821 105,94

EU-Beitrag

€ 2 861 600,00

Koordiniert durch

FUNDACIO PRIVADA I2CAT, INTERNET I INNOVACIO DIGITAL A CATALUNYA
Spain

CORDIS bietet Links zu öffentlichen Ergebnissen und Veröffentlichungen von HORIZONT-Projekten.

Links zu Ergebnissen und Veröffentlichungen von RP7-Projekten sowie Links zu einigen Typen spezifischer Ergebnisse wie Datensätzen und Software werden dynamisch von OpenAIRE abgerufen.

Leistungen

Other (7)

Coding and Decoding Modules

This deliverable will consist, in each iteration, of releasing the components needed to encode and decode omnidirectional video.

Transmission, reception and overall delivery strategies of omnidirectional live streams

This deliverable will consist, in each iteration, of releasing the components needed to distribute and deliver omnidirectional video over WAN OTT networks and LAN controlled networks.

Production Tools

This deliverable will consist, in each iteration, of releasing the production tools needed to produce content based on omnidirectional video.

Workflow integration & End-to-end tests

The outcome of the tests integrating the system will be explained in a report containing the result of the tests, current limitations, and suggestions for architecture and implementation improvements.

Content Creation

This deliverable is the dataset of produced content and raw audiovisual material

Capture Components

This deliverable will consist, in each iteration, of releasing the hardware components and release of software interfaces developed needed to capture omnidirectional video.

Interaction & Display

This deliverable will consist, in each iteration, of software solutions for each of the display devices in the living room (traditional TV, second screen, immersive display)

Documents, reports (11)

End-user Requirements

This document will detail the end-user requirements needed for an the content produced. Each iteration will extend the previous one with the additional insights gained, and the novel case scenario to be addressed

Documentation and technical fact sheets

This deliverable provides all the printable support documentation of ImmersiaTV.

Professional Requirements

This document will detail the professional requirements needed for both offline and live produced content, updated with the insight gained in the previous pilots

Pilot Execution Reports

This deliverable will consist in a report of the pilots executed as well as batch demonstrators that will be further used by WP5 and WP2 to define needs in terms of exploitation and technical refinement, respectively.

Technical Evaluation

This report will detail, iteratively, the technical aspects of the outcome of the pilots: what worked and what did not, what should be improved from a technical performance perspective.

Quality of Experience

This deliverable will consist of releasing the components needed to render and interact with content based on omnidirectional video.

Content Ideation, Production scenarios and requirement analysis

This document will describe the scenarios selected, ideas for the audiovisual language to be used for immersive content and across devices, both for offline and live content, and include the technical specification scenarios to be implemented

User Evaluation

This report will detail, iteratively, the perception of the experience by the end-users, as well as the perception of professional content producers using the production tools from performance and service management perspectives. Usability aspects will also be included in this report.

Execution & Evaluation Plan

This report will explain how we plan to execute and evaulate the pilots to be performed

Design Architecture

This deliverable, in each of its iteration will address the design and refinement of the overall architecture, taking into account the outcomes of task 2.3. It feeds the rest of the tasks in the work package

Market analysis report

This deliverable describes the market for audiovisual immersive products and provides a set of recommendations as input for the use cases and the exploitation and innovation transfer activities in T.5.2.

Veröffentlichungen

Conference proceedings (24)

JPEG XS call for proposals subjective evaluations

Autoren: Touradj Ebrahimi, David McNally, Tim Bruylants, Alexandre Willème, Peter Schelkens, Benoît M. Macq
Veröffentlicht in: Applications of Digital Image Processing XL, 2017, Seite(n) 24, ISBN 9781-510612501
Herausgeber: SPIE
DOI: 10.1117/12.2275137

Subjective and objective evaluation of HDR video coding technologies

Autoren: Philippe Hanhart, Martin Rerabek, Touradj Ebrahimi
Veröffentlicht in: 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX), 2016, Seite(n) 1-6, ISBN 978-1-5090-0354-9
Herausgeber: IEEE
DOI: 10.1109/QoMEX.2016.7498943

Towards subjective quality assessment of point cloud imaging in augmented reality

Autoren: Evangelos Alexiou, Evgeniy Upenik, Touradj Ebrahimi
Veröffentlicht in: 2017 IEEE 19th International Workshop on Multimedia Signal Processing (MMSP), 2017, Seite(n) 1-6, ISBN 978-1-5090-3649-3
Herausgeber: IEEE
DOI: 10.1109/MMSP.2017.8122237

Impact of interactivity on the assessment of quality of experience for light field content

Autoren: Irene Viola, Martin Rerabek, Touradj Ebrahimi
Veröffentlicht in: 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX), 2017, Seite(n) 1-6, ISBN 978-1-5386-4024-1
Herausgeber: IEEE
DOI: 10.1109/QoMEX.2017.7965636

On the performance of objective metrics for omnidirectional visual content

Autoren: Evgeniy Upenik, Martin Rerabek, Touradj Ebrahimi
Veröffentlicht in: 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX), 2017, Seite(n) 1-6, ISBN 978-1-5386-4024-1
Herausgeber: IEEE
DOI: 10.1109/QoMEX.2017.7965660

A Just Noticeable Difference Subjective Test for High Dynamic Range Images

Autoren: Ahar, Ayyoub; Mahmoudpour, Saeed; Van Wallendael, Glenn; Paridaens, Tom; Lambert, Peter; Schelkens, Peter
Veröffentlicht in: 10th International Conference on Quality of Multimedia Experience (QoMEX 2018), 2018
Herausgeber: VUB
DOI: 10.5281/zenodo.1311671

Personalized and Immersive Presentation of Video, Audio and Subtitles in 360º Environments: An Opera Use Case

Autoren: Isaac Fraile, David Gómez, Juan A. Núñez, Mario Montagud, Sergi Fernández
Veröffentlicht in: ACM TVX 2018, Seoul (South Korea), June 2018, 2018
Herausgeber: ACM Press
DOI: 10.6084/m9.figshare.6527531.v1

ImmersiaTV: an end-to-end toolset to enable customizable and immersive multi-screen TV experiences

Autoren: Juan A. Núñez, Mario Montagud, Isaac Fraile, David Gómez, Sergi Fernández
Veröffentlicht in: ACM TVX 2018, Seoul (South Korea), June 2018, 2018
Herausgeber: ACM Press
DOI: 10.6084/m9.figshare.6526379.v1

Reduced-reference image quality assessment based on internal generative mechanism utilizing shearlets and Rényi entropy analysis

Autoren: Saeed Mahmoudpour, Peter Schelkens
Veröffentlicht in: 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX), 2017, Seite(n) 1-5, ISBN 978-1-5386-4024-1
Herausgeber: IEEE
DOI: 10.1109/QoMEX.2017.7965628

An end-to-end toolset for the creation and delivery of video-based multi-device content

Autoren: Fraile, I., Nuñez, J.A, Malewski, Artigas, X., Fernandez, S., Llobera
Veröffentlicht in: 6th Iberoamerican Conference on Applications and Usability for Interactive TV (jAuti 2017), 2017, ISBN 978-972-789-521-2
Herausgeber: UA Editora Universidade de Aveiro Serviços de Biblioteca, Informação Documental e Museologia 1ª edição – outubro 2017
DOI: 10.5281/zenodo.1402979

Developing a Multi-Device Immersive TV-Experience - User Expectations and Practices

Autoren: Wendy Van den Broeck, Pau Pamplona, Sergi Fernandez Langa
Veröffentlicht in: Proceedings of the 2nd International Workshop on Multimedia Alternate Realities - AltMM '17, 2017, Seite(n) 25-30, ISBN 9781-450355070
Herausgeber: ACM Press, AltMM '17 Proceedings of the 2nd International Workshop on Multimedia Alternate Realities
DOI: 10.1145/3132361.3132362

A Rendering Solution to Display Light Field in Virtual Reality

Autoren: Evgeniy Upenik, Irene Viola and Touradj Ebrahimi
Veröffentlicht in: 26th European Signal Processing Conference (EUSIPCO), 2018
Herausgeber: Accepted- Not published yet

Point cloud subjective evaluation methodology based on 2D rendering

Autoren: Evangelos Alexiou, Marco Bernardo, Luis A. da Silva Cruz, Lovorka Gotal Dmitrovic,Carlos Duarte, Emil Dumic, Touradj Ebrahimi, Dragan Matkovic, Manuela Pereira, Antonio Pinheiro, Athanasios Skodras
Veröffentlicht in: 10th International Conference on Quality of Multimedia Experience (QoMEX 2018), 2018
Herausgeber: Accepted- Not published yet

Point cloud quality assessment metric based on angular distance

Autoren: Evangelos Alexiou, Touradj Ebrahimi
Veröffentlicht in: International Conference on Multimedia & Expo (ICME 2018), 2018
Herausgeber: Accepted- Not published yet

Benchmarking of objective quality metrics for point cloud quality assessment

Autoren: Evangelos Alexiou, Touradj Ebrahimi
Veröffentlicht in: 33rd Picture Coding Symposium (PCS 2018), 2018
Herausgeber: Accepted- Not published yet

Impact of visualization strategy for subjective quality assessment of point clouds

Autoren: Evangelos Alexiou, Touradj Ebrahimi
Veröffentlicht in: Hot3D - Multimedia & Expo Workshops (ICMEW) - 2018, 2018
Herausgeber: Accepted- Not published yet

Towards an animated JPEG

Autoren: Joël Theytaz, Lin Yuan, David McNally, Touradj Ebrahimi
Veröffentlicht in: Applications of Digital Image Processing XXXIX, 2016, Seite(n) 99711X
Herausgeber: SPIE
DOI: 10.1117/12.2240283

A Testbed for Subjective Evaluation of Omnidirectional Visual Content

Autoren: Upenik, Evgeniy; Rerabek, Martin; Ebrahimi, Touradj
Veröffentlicht in: 32nd Picture Coding Symposium (PCS 2016), Ausgabe 2, 2016
Herausgeber: IEEE
DOI: 10.5281/zenodo.209531

A new approach to subjectively assess quality of plenoptic content

Autoren: Viola, Irene; Rerabek, Martin; Ebrahimi, Touradj
Veröffentlicht in: SPIE Optics + Photonics, San Diego, California, USA - 2016, Ausgabe 2, 2016
Herausgeber: SPIE
DOI: 10.1117/12.2240279

New Light Field Image Dataset

Autoren: Rerabek, Martin; Ebrahimi, Touradj
Veröffentlicht in: 8th International Conference on Quality of Multimedia Experience (QoMEX 2016), Ausgabe 3, 2016
Herausgeber: IEEE
DOI: 10.5281/zenodo.209499

JPEG backward compatible coding of omnidirectional images

Autoren: Martin Řeřábek, Evgeniy Upenik, Touradj Ebrahimi
Veröffentlicht in: Applications of Digital Image Processing XXXIX, 2016, Seite(n) 99711O
Herausgeber: SPIE
DOI: 10.1117/12.2240281

A new content format for immersive experiences

Autoren: Llobera,Joan
Veröffentlicht in: Hot3D 2016, Ausgabe 1, 2016
Herausgeber: IEEE International Workshop
DOI: 10.5281/zenodo.202410

Objective and subjective evaluation of light field image compression algorithms

Autoren: Viola, Irene; Rerabek, Martin; Bruylants, Tim; Schelkens, Peter; Pereira, Fernando; Ebrahimi, Touradj
Veröffentlicht in: 32nd Picture Coding Symposium (PCS 2016), Ausgabe 1, 2016
Herausgeber: IEEE
DOI: 10.5281/zenodo.209467

A Simple Method to Obtain Visual Attention Data in Head Mounted Virtual Reality

Autoren: Upenik, Evgeniy; Ebrahimi, Touradj
Veröffentlicht in: 2017 IEEE International Conference on Multimedia & Expo (ICME), Ausgabe 1, 2017
Herausgeber: ICME
DOI: 10.5281/zenodo.556328

Peer reviewed articles (2)

Comparison and Evaluation of Light Field Image Coding Approaches

Autoren: Irene Viola, Martin Rerabek, Touradj Ebrahimi
Veröffentlicht in: IEEE Journal of Selected Topics in Signal Processing, Ausgabe 11/7, 2017, Seite(n) 1092-1106, ISSN 1932-4553
Herausgeber: Institute of Electrical and Electronics Engineers
DOI: 10.1109/JSTSP.2017.2740167

ICtCp Versus Y'CbCr: Evaluation of ICtCp Color Space and an Adaptive Reshaper for HDR and WCG

Autoren: Anne-Flore Perrin, Martin Rerabek, Walt Husak, Touradj Ebrahimi
Veröffentlicht in: IEEE Consumer Electronics Magazine, Ausgabe 7/3, 2018, Seite(n) 38-47, ISSN 2162-2256
Herausgeber: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/MCE.2017.2714696

Other (5)

“ImmersiaTV: Enabling Customizable and Immersive Multi-Screen TV Experiences”

Autoren: D. Gómez, J.A. Núñez, M. Montagud, S. Fernández
Veröffentlicht in: 2018
Herausgeber: Zenodo
DOI: 10.5281/zenodo.1480550

TiCMP: A lightweight and efficient Tiled Cubemap projection strategy for Immersive Videos in Web-based player

Autoren: D. Gómez, J. A. Núñez, I. Fraile, M. Montagud, S. Fernández
Veröffentlicht in: 2018
Herausgeber: Zenodo preprint
DOI: 10.5281/zenodo.1481596

Production and delivery of video for multi-device synchronized playout

Autoren: Nuñez, J.A,, Malewski, S. Fernández, S., Llobera, J.
Veröffentlicht in: 2018
Herausgeber: Zenodo preprint
DOI: 10.5281/zenodo.1481607

Multi-device content based on video. A practical toolset for creation and delivery

Autoren: Joan Llobera, Isaac Fraile, Juan A. Núñez, Szymon Malewski, Xavier Artigas, Sergi Fernandez
Veröffentlicht in: 2018, Seite(n) 93-104
Herausgeber: Springer International Publishing
DOI: 10.1007/978-3-319-90170-1_7

Creating and broadcasting video-based multi-platform experiences

Autoren: Llobera, Joan; Nuñez, Juan; Fernández, Sergi
Veröffentlicht in: MMTC Communications - Frontiers 12 6, Ausgabe 1, 2017
Herausgeber: IEEE MMTC
DOI: 10.5281/zenodo.556959