Immersive Experiences around TV, an integrated toolset for the production and distribution of immersive and interactive content across devices.

Información del proyecto

ImmersiaTV

Identificador del acuerdo de subvención: 688619

DOI

10.3030/688619

Proyecto cerrado

Fecha de la firma de la CE 13 Noviembre 2015

Fecha de inicio 1 Enero 2016

Fecha de finalización 30 Junio 2018

Financiado con arreglo a

• INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)

Coste total

€ 3 821 105,94

Aportación de la UE

€ 2 861 600,00

Coordinado por

FUNDACIO PRIVADA I2CAT, INTERNET I INNOVACIO DIGITAL A CATALUNYA
Spain

CORDIS proporciona enlaces a los documentos públicos y las publicaciones de los proyectos de los programas marco HORIZONTE.

Los enlaces a los documentos y las publicaciones de los proyectos del Séptimo Programa Marco, así como los enlaces a algunos tipos de resultados específicos, como conjuntos de datos y «software», se obtienen dinámicamente de OpenAIRE .

Resultado final

Other (7)

Coding and Decoding Modules

This deliverable will consist, in each iteration, of releasing the components needed to encode and decode omnidirectional video.

Transmission, reception and overall delivery strategies of omnidirectional live streams

This deliverable will consist, in each iteration, of releasing the components needed to distribute and deliver omnidirectional video over WAN OTT networks and LAN controlled networks.

Production Tools

This deliverable will consist, in each iteration, of releasing the production tools needed to produce content based on omnidirectional video.

Workflow integration & End-to-end tests

The outcome of the tests integrating the system will be explained in a report containing the result of the tests, current limitations, and suggestions for architecture and implementation improvements.

Content Creation

This deliverable is the dataset of produced content and raw audiovisual material

Capture Components

This deliverable will consist, in each iteration, of releasing the hardware components and release of software interfaces developed needed to capture omnidirectional video.

Interaction & Display

This deliverable will consist, in each iteration, of software solutions for each of the display devices in the living room (traditional TV, second screen, immersive display)

Documents, reports (11)

End-user Requirements

This document will detail the end-user requirements needed for an the content produced. Each iteration will extend the previous one with the additional insights gained, and the novel case scenario to be addressed

Documentation and technical fact sheets

This deliverable provides all the printable support documentation of ImmersiaTV.

Professional Requirements

This document will detail the professional requirements needed for both offline and live produced content, updated with the insight gained in the previous pilots

Pilot Execution Reports

This deliverable will consist in a report of the pilots executed as well as batch demonstrators that will be further used by WP5 and WP2 to define needs in terms of exploitation and technical refinement, respectively.

Technical Evaluation

This report will detail, iteratively, the technical aspects of the outcome of the pilots: what worked and what did not, what should be improved from a technical performance perspective.

Quality of Experience

This deliverable will consist of releasing the components needed to render and interact with content based on omnidirectional video.

Content Ideation, Production scenarios and requirement analysis

This document will describe the scenarios selected, ideas for the audiovisual language to be used for immersive content and across devices, both for offline and live content, and include the technical specification scenarios to be implemented

User Evaluation

This report will detail, iteratively, the perception of the experience by the end-users, as well as the perception of professional content producers using the production tools from performance and service management perspectives. Usability aspects will also be included in this report.

Execution & Evaluation Plan

This report will explain how we plan to execute and evaulate the pilots to be performed

Design Architecture

This deliverable, in each of its iteration will address the design and refinement of the overall architecture, taking into account the outcomes of task 2.3. It feeds the rest of the tasks in the work package

Market analysis report

This deliverable describes the market for audiovisual immersive products and provides a set of recommendations as input for the use cases and the exploitation and innovation transfer activities in T.5.2.

Publicaciones

Conference proceedings (24)

JPEG XS call for proposals subjective evaluations

Autores: Touradj Ebrahimi, David McNally, Tim Bruylants, Alexandre Willème, Peter Schelkens, Benoît M. Macq
Publicado en: Applications of Digital Image Processing XL, 2017, Página(s) 24, ISBN 9781-510612501
Editor: SPIE
DOI: 10.1117/12.2275137

Subjective and objective evaluation of HDR video coding technologies

Autores: Philippe Hanhart, Martin Rerabek, Touradj Ebrahimi
Publicado en: 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX), 2016, Página(s) 1-6, ISBN 978-1-5090-0354-9
Editor: IEEE
DOI: 10.1109/QoMEX.2016.7498943

Towards subjective quality assessment of point cloud imaging in augmented reality

Autores: Evangelos Alexiou, Evgeniy Upenik, Touradj Ebrahimi
Publicado en: 2017 IEEE 19th International Workshop on Multimedia Signal Processing (MMSP), 2017, Página(s) 1-6, ISBN 978-1-5090-3649-3
Editor: IEEE
DOI: 10.1109/MMSP.2017.8122237

Impact of interactivity on the assessment of quality of experience for light field content

Autores: Irene Viola, Martin Rerabek, Touradj Ebrahimi
Publicado en: 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX), 2017, Página(s) 1-6, ISBN 978-1-5386-4024-1
Editor: IEEE
DOI: 10.1109/QoMEX.2017.7965636

On the performance of objective metrics for omnidirectional visual content

Autores: Evgeniy Upenik, Martin Rerabek, Touradj Ebrahimi
Publicado en: 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX), 2017, Página(s) 1-6, ISBN 978-1-5386-4024-1
Editor: IEEE
DOI: 10.1109/QoMEX.2017.7965660

A Just Noticeable Difference Subjective Test for High Dynamic Range Images

Autores: Ahar, Ayyoub; Mahmoudpour, Saeed; Van Wallendael, Glenn; Paridaens, Tom; Lambert, Peter; Schelkens, Peter
Publicado en: 10th International Conference on Quality of Multimedia Experience (QoMEX 2018), 2018
Editor: VUB
DOI: 10.5281/zenodo.1311671

Personalized and Immersive Presentation of Video, Audio and Subtitles in 360º Environments: An Opera Use Case

Autores: Isaac Fraile, David Gómez, Juan A. Núñez, Mario Montagud, Sergi Fernández
Publicado en: ACM TVX 2018, Seoul (South Korea), June 2018, 2018
Editor: ACM Press
DOI: 10.6084/m9.figshare.6527531.v1

ImmersiaTV: an end-to-end toolset to enable customizable and immersive multi-screen TV experiences

Autores: Juan A. Núñez, Mario Montagud, Isaac Fraile, David Gómez, Sergi Fernández
Publicado en: ACM TVX 2018, Seoul (South Korea), June 2018, 2018
Editor: ACM Press
DOI: 10.6084/m9.figshare.6526379.v1

Reduced-reference image quality assessment based on internal generative mechanism utilizing shearlets and Rényi entropy analysis

Autores: Saeed Mahmoudpour, Peter Schelkens
Publicado en: 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX), 2017, Página(s) 1-5, ISBN 978-1-5386-4024-1
Editor: IEEE
DOI: 10.1109/QoMEX.2017.7965628

An end-to-end toolset for the creation and delivery of video-based multi-device content

Autores: Fraile, I., Nuñez, J.A, Malewski, Artigas, X., Fernandez, S., Llobera
Publicado en: 6th Iberoamerican Conference on Applications and Usability for Interactive TV (jAuti 2017), 2017, ISBN 978-972-789-521-2
Editor: UA Editora Universidade de Aveiro Serviços de Biblioteca, Informação Documental e Museologia 1ª edição – outubro 2017
DOI: 10.5281/zenodo.1402979

Developing a Multi-Device Immersive TV-Experience - User Expectations and Practices

Autores: Wendy Van den Broeck, Pau Pamplona, Sergi Fernandez Langa
Publicado en: Proceedings of the 2nd International Workshop on Multimedia Alternate Realities - AltMM '17, 2017, Página(s) 25-30, ISBN 9781-450355070
Editor: ACM Press, AltMM '17 Proceedings of the 2nd International Workshop on Multimedia Alternate Realities
DOI: 10.1145/3132361.3132362

A Rendering Solution to Display Light Field in Virtual Reality

Autores: Evgeniy Upenik, Irene Viola and Touradj Ebrahimi
Publicado en: 26th European Signal Processing Conference (EUSIPCO), 2018
Editor: Accepted- Not published yet

Point cloud subjective evaluation methodology based on 2D rendering

Autores: Evangelos Alexiou, Marco Bernardo, Luis A. da Silva Cruz, Lovorka Gotal Dmitrovic,Carlos Duarte, Emil Dumic, Touradj Ebrahimi, Dragan Matkovic, Manuela Pereira, Antonio Pinheiro, Athanasios Skodras
Publicado en: 10th International Conference on Quality of Multimedia Experience (QoMEX 2018), 2018
Editor: Accepted- Not published yet

Point cloud quality assessment metric based on angular distance

Autores: Evangelos Alexiou, Touradj Ebrahimi
Publicado en: International Conference on Multimedia & Expo (ICME 2018), 2018
Editor: Accepted- Not published yet

Benchmarking of objective quality metrics for point cloud quality assessment

Autores: Evangelos Alexiou, Touradj Ebrahimi
Publicado en: 33rd Picture Coding Symposium (PCS 2018), 2018
Editor: Accepted- Not published yet

Impact of visualization strategy for subjective quality assessment of point clouds

Autores: Evangelos Alexiou, Touradj Ebrahimi
Publicado en: Hot3D - Multimedia & Expo Workshops (ICMEW) - 2018, 2018
Editor: Accepted- Not published yet

Towards an animated JPEG

Autores: Joël Theytaz, Lin Yuan, David McNally, Touradj Ebrahimi
Publicado en: Applications of Digital Image Processing XXXIX, 2016, Página(s) 99711X
Editor: SPIE
DOI: 10.1117/12.2240283

A Testbed for Subjective Evaluation of Omnidirectional Visual Content

Autores: Upenik, Evgeniy; Rerabek, Martin; Ebrahimi, Touradj
Publicado en: 32nd Picture Coding Symposium (PCS 2016), Edición 2, 2016
Editor: IEEE
DOI: 10.5281/zenodo.209531

A new approach to subjectively assess quality of plenoptic content

Autores: Viola, Irene; Rerabek, Martin; Ebrahimi, Touradj
Publicado en: SPIE Optics + Photonics, San Diego, California, USA - 2016, Edición 2, 2016
Editor: SPIE
DOI: 10.1117/12.2240279

New Light Field Image Dataset

Autores: Rerabek, Martin; Ebrahimi, Touradj
Publicado en: 8th International Conference on Quality of Multimedia Experience (QoMEX 2016), Edición 3, 2016
Editor: IEEE
DOI: 10.5281/zenodo.209499

JPEG backward compatible coding of omnidirectional images

Autores: Martin Řeřábek, Evgeniy Upenik, Touradj Ebrahimi
Publicado en: Applications of Digital Image Processing XXXIX, 2016, Página(s) 99711O
Editor: SPIE
DOI: 10.1117/12.2240281

A new content format for immersive experiences

Autores: Llobera,Joan
Publicado en: Hot3D 2016, Edición 1, 2016
Editor: IEEE International Workshop
DOI: 10.5281/zenodo.202410

Objective and subjective evaluation of light field image compression algorithms

Autores: Viola, Irene; Rerabek, Martin; Bruylants, Tim; Schelkens, Peter; Pereira, Fernando; Ebrahimi, Touradj
Publicado en: 32nd Picture Coding Symposium (PCS 2016), Edición 1, 2016
Editor: IEEE
DOI: 10.5281/zenodo.209467

A Simple Method to Obtain Visual Attention Data in Head Mounted Virtual Reality

Autores: Upenik, Evgeniy; Ebrahimi, Touradj
Publicado en: 2017 IEEE International Conference on Multimedia & Expo (ICME), Edición 1, 2017
Editor: ICME
DOI: 10.5281/zenodo.556328

Peer reviewed articles (2)

Comparison and Evaluation of Light Field Image Coding Approaches

Autores: Irene Viola, Martin Rerabek, Touradj Ebrahimi
Publicado en: IEEE Journal of Selected Topics in Signal Processing, Edición 11/7, 2017, Página(s) 1092-1106, ISSN 1932-4553
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/JSTSP.2017.2740167

ICtCp Versus Y'CbCr: Evaluation of ICtCp Color Space and an Adaptive Reshaper for HDR and WCG

Autores: Anne-Flore Perrin, Martin Rerabek, Walt Husak, Touradj Ebrahimi
Publicado en: IEEE Consumer Electronics Magazine, Edición 7/3, 2018, Página(s) 38-47, ISSN 2162-2256
Editor: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/MCE.2017.2714696

Other (5)

“ImmersiaTV: Enabling Customizable and Immersive Multi-Screen TV Experiences”

Autores: D. Gómez, J.A. Núñez, M. Montagud, S. Fernández
Publicado en: 2018
Editor: Zenodo
DOI: 10.5281/zenodo.1480550

TiCMP: A lightweight and efficient Tiled Cubemap projection strategy for Immersive Videos in Web-based player

Autores: D. Gómez, J. A. Núñez, I. Fraile, M. Montagud, S. Fernández
Publicado en: 2018
Editor: Zenodo preprint
DOI: 10.5281/zenodo.1481596

Production and delivery of video for multi-device synchronized playout

Autores: Nuñez, J.A,, Malewski, S. Fernández, S., Llobera, J.
Publicado en: 2018
Editor: Zenodo preprint
DOI: 10.5281/zenodo.1481607

Multi-device content based on video. A practical toolset for creation and delivery

Autores: Joan Llobera, Isaac Fraile, Juan A. Núñez, Szymon Malewski, Xavier Artigas, Sergi Fernandez
Publicado en: 2018, Página(s) 93-104
Editor: Springer International Publishing
DOI: 10.1007/978-3-319-90170-1_7

Creating and broadcasting video-based multi-platform experiences

Autores: Llobera, Joan; Nuñez, Juan; Fernández, Sergi
Publicado en: MMTC Communications - Frontiers 12 6, Edición 1, 2017
Editor: IEEE MMTC
DOI: 10.5281/zenodo.556959