Hyperrealistic Imaging Experience

Informazioni relative al progetto

RealVision

ID dell’accordo di sovvenzione: 765911

DOI

10.3030/765911

Progetto chiuso

Data della firma CE 10 Agosto 2017

Data di avvio 1 Gennaio 2018

Data di completamento 30 Giugno 2022

Finanziato da

• EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions

Costo totale

€ 4 076 702,28

Contributo UE

€ 4 076 702,28

Coordinato da

DANMARKS TEKNISKE UNIVERSITET
Denmark

CORDIS fornisce collegamenti ai risultati finali pubblici e alle pubblicazioni dei progetti ORIZZONTE.

I link ai risultati e alle pubblicazioni dei progetti del 7° PQ, così come i link ad alcuni tipi di risultati specifici come dataset e software, sono recuperati dinamicamente da .OpenAIRE .

Risultati finali

Other (2)

Supervisory Board

Supervisory Board of the Network established as specified in Annex 1.

Light field capture for test images in coding and processing

Demonstrators, pilots, prototypes (3)

Organization, plan and attendance of an Industrial Forum

Organization plan and attendance of an Industrial Forum

Perceptual coding of light field data with flexible access for applications
New view extraction demonstrator

Documents, reports (11)

Metric for comparing surface appearance of fabricated objects
A model explaining maximum tolerable latency of interactive displays
Rules for the contribution of focus cues to realistic appearance of scenes
Report on the influence of perceptual cues to realism
Models of differences in color perception with narrow-band light

Models of differences in color perception with narrowband light

Naturalness of hyper-realistic video

Naturalness of hyperrealistic video

Method for objective measurement of hyper-realistic image quality of light fields

Method for objective measurement of hyperrealistic image quality of light fields

A low-level vision metric for comparing displayed hyper-realistic images

A lowlevel vision metric for comparing displayed hyperrealistic images

Report on individual variations in the perception of hyper-realistic images

Report on individual variations in the perception of hyperrealistic images

Method for the subjective assessment of immersive audio-visual contents

Method for the subjective assessment of immersive audiovisual contents

Courses

Websites, patent fillings, videos etc. (4)

Project communication tools established, website online etc
Communicate with standardization bodies about contributing content
Public dissemination of project results, incl. JPEG and MPEG bodies

Public dissemination of project results, incl. JPEG and MPEG bodies. The activity is carried out throughout the project. First larger effort is at M9.

Generate test content suitable for HDR and U-HDTV processing

Pubblicazioni

Peer reviewed articles (13)

Method for Subjective Assessment of Immersion in Audiovisual Experiences

Autori: Sarvesh Agrawal, Søren Bech, Klaus Bærentsen, Katrien De Moor, and Søren Forchhammer
Pubblicato in: Journal of the Audio Engineering Society, Numero 69 (9), 2021, Pagina/e 656-671, ISSN 1549-4950
Editore: Audio Engineering Society
DOI: 10.17743/jaes.2021.0013

Defining Immersion: Literature Review and Implications for Research on Audiovisual Experiences

Autori: Sarvesh Agrawal, Adèle Simon, Søren Bech, Klaus Bærentsen, Søren Forchhammer
Pubblicato in: Journal of the Audio Engineering Society, Numero 68/6, 2020, Pagina/e 404-417, ISSN 1549-4950
Editore: Audio Engineering Society
DOI: 10.17743/jaes.2020.0039

Perceptual model for adaptive local shading and refresh rate

Autori: Akshay Jindal , Krzysztof Wolski , Karol Myszkowski , Rafał K. Mantiuk
Pubblicato in: ACM Transactions on Graphics, Numero Volume 40, Numero 6, December 2021, Article No.: 281, 2021, Pagina/e pp 1–18, ISSN 0730-0301
Editore: Association for Computing Machinary, Inc.
DOI: 10.1145/3478513.3480514

Epipolar Plane Image-Based Lossless and Near-Lossless Light Field Compression

Autori: M. Umair Mukati, Soren Forchhammer
Pubblicato in: IEEE Access, Numero 9, 2021, Pagina/e 1124-1136, ISSN 2169-3536
Editore: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2020.3047073

Improved Deep Distributed Light Field Coding

Autori: M. Umair Mukati, Milan Stepanov, Giuseppe Valenzise, Soren Forchhammer, Frederic Dufaux
Pubblicato in: IEEE Open Journal of Circuits and Systems, Numero 2, 2021, Pagina/e 325-337, ISSN 2644-1225
Editore: IEEE
DOI: 10.1109/ojcas.2021.3073252

Dataset and Metrics for Predicting Local Visible Differences

Autori: Krzysztof Wolski, Daniele Giunchi, Nanyang Ye, Piotr Didyk, Karol Myszkowski, Radosław Mantiuk, Hans-Peter Seidel, Anthony Steed, Rafał K. Mantiuk
Pubblicato in: ACM Transactions on Graphics, Numero 37/5, 2018, Pagina/e 1-14, ISSN 0730-0301
Editore: Association for Computing Machinary, Inc.
DOI: 10.1145/3196493

Selecting texture resolution using a task‐specific visibility metric

Autori: K. Wolski, D. Giunchi, S. Kinuwaki, P. Didyk, K. Myszkowski, A. Steed, R. K. Mantiuk
Pubblicato in: Computer Graphics Forum, Numero 38/7, 2019, Pagina/e 685-696, ISSN 0167-7055
Editore: Blackwell Publishing Inc.
DOI: 10.1111/cgf.13871

DiCE

Autori: Fangcheng Zhong, George Alex Koulieris, George Drettakis, Martin S. Banks, Mathieu Chambe, Frédo Durand, Rafał K. Mantiuk
Pubblicato in: ACM Transactions on Graphics (TOG), Numero 38/6, 2019, Pagina/e 1-13, ISSN 0730-0301
Editore: Association for Computing Machinary, Inc.
DOI: 10.1145/3355089.3356552

Demonstrating a multi-primary high dynamic range display system for vision experiments

Autori: Allie C. Hexley, Ali Özgür Yöntem, Manuel Spitschan, Hannah E. Smithson, Rafal Mantiuk
Pubblicato in: Journal of the Optical Society of America A, Numero 37/4, 2020, Pagina/e A271, ISSN 1084-7529
Editore: Optical Society of America
DOI: 10.1364/josaa.384022

Attention Mechanism-Based Light-Field View Synthesis

Autori: M. Shahzeb Khan Gul, M. Umair Mukati, Michel Baetz, Soren Forchammer, Joachim Keinert
Pubblicato in: IEEE Acess, 2022, ISSN 2169-3536
Editore: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2022.3142949

Reproducing reality with a high-dynamic-range multi-focal stereo display

Autori: Fangcheng Zhong , Akshay Jindal , Ali Özgür Yöntem , Param Hanji , Simon J. Watt , Rafał K. Mantiuk
Pubblicato in: ACM Transactions on Graphics, Numero Volume 40, Numero 6, December 2021, Article No.: 241, 2021, Pagina/e pp 1–14, ISSN 0730-0301
Editore: Association for Computing Machinary, Inc.
DOI: 10.1145/3478513.3480513

Influence of Changes in Audio Spatialization on Immersion in Audiovisual Experiences

Autori: Sarvesh Agrawal, Søren Bech, Katrien de Moor, Søren Forchhammer
Pubblicato in: Journal of Audio Engineering Society, Numero 70 (10), 2022, Pagina/e 810-823, ISSN 1549-4950
Editore: Audio Engineering Society
DOI: 10.17743/jaes.2022.0034

A perceptual model of motion quality for rendering with adaptive refresh-rate and resolution

Autori: Gyorgy Denes, Akshay Jindal, Aliaksei Mikhailiuk, Rafał K. Mantiuk
Pubblicato in: ACM Transactions on Graphics, Numero 39/4, 2020, Pagina/e 1, ISSN 0730-0301
Editore: Association for Computing Machinary, Inc.
DOI: 10.1145/3386569.3392411

Conference proceedings (29)

Hybrid Learning-Based And Hevc-Based Coding Of Light Fields

Autori: Milan Stepanov, Giuseppe Valenzise, Frederic Dufaux
Pubblicato in: 2020 IEEE International Conference on Image Processing (ICIP), 2020, Pagina/e 3344-3348, ISBN 978-1-7281-6395-6
Editore: IEEE
DOI: 10.1109/icip40778.2020.9190971

Evaluation of the Bubble view Metaphor for the Crowdsourcing Study of Visual Attention Deployment in Tone-Mapped Images

Autori: W. Ellahi, T. Vigier and P. Le Callet
Pubblicato in: 2021 9th European Workshop on Visual Information Processing (EUVIP), 2021
Editore: EUVIP
DOI: 10.1109/euvip50544.2021.9483985

The Effect of Temporal Sub-sampling on the Accuracy of Volumetric Video Quality Assessment

Autori: Ali Ak, Emin Zerman, Suiyi Ling, Patrick Le Callet, Aljosa Smolic
Pubblicato in: 2021
Editore: IEEE PCS 2021, Picture Coding Symposium
DOI: 10.1109/pcs50896.2021.9477449

Can Visual Scanpath Reveal Personal Image Memorability? Investigation of HMM Tools for Gaze Patterns Analysis

Autori: W. Ellahi, T. Vigier and P. Le Callet
Pubblicato in: 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX), 2020
Editore: QoMEX
DOI: 10.1109/qomex48832.2020.9123102

On Spammer Detection in Crowdsourcing Pairwise Comparison Tasks: Case Study on Two Multimedia QoE Assessment Scenarios

Autori: Ali Ak, Mona Abid, Matthieu Perreira da Silva, Patrick Le Callet
Pubblicato in: 2021
Editore: IEEE ICME 2021, First International Workshop on Quality of Experience in Interactive Multimedia
DOI: 10.1109/icmew53276.2021.9455992

A machine-learning approach to illuminant estimation using statistical regularities in photoreceptor signals from real-world surfaces

Autori: Allie C. Hexley, Takuma Morimoto, Keiji Uchikawa, Hannah E. Smithson
Pubblicato in: ECVP 43rd European Conference on Visual Perception (ECVP) 2021 Online, 2022
Editore: Perception
DOI: 10.1177/03010066211059887

Active sampling for pairwise comparisons via approximate message passing and information gain maximization

Autori: Aliaksei Mikhailiuk, Clifford Wilmot, Maria Perez-Ortiz, Dingcheng Yue, Rafał K. Mantiuk
Pubblicato in: International Conference on Patter Recognition (ICPR), 2020
Editore: IEEE
DOI: 10.48550/arxiv.2004.05691

A Simulation System for Scene Synthesis in Virtual Reality

Autori: Jingyu Liu, Claire Mantel, Florian Schweiger, Søren Forchhammer
Pubblicato in: International Conference on Virtual Reality and Mixed Reality, Numero 18, 2021, Pagina/e 67-84, ISBN 978-3-030-90738-9
Editore: Springer
DOI: 10.1007/978-3-030-90739-6_5

A Comprehensive Analysis of Crowdsourcing for Subjective Evaluation of Tone Mapping Operators

Autori: Ali Ak, Abhishek Goswami, Wolf Hauser, Patrick Le Callet, Frédéric Dufaux
Pubblicato in: Image Quality and System Performance, IS&T International Symposium on Electronic Imaging (EI 2021), 2020
Editore: SPIE
DOI: 10.2352/issn.2470-1173.2021.9.iqsp-262

A machine-learning framework to predict TMO preference based on image and visual attention features

Autori: W. Ellahi, T. Vigier and P. L. Callet
Pubblicato in: 2021 IEEE 23rd International Workshop on Multimedia Signal Processing (MMSP), 2021
Editore: MMSP
DOI: 10.1109/mmsp53017.2021.9733461

Predicting Visible Image Differences Under Varying Display Brightness and Viewing Distance

Autori: Nanyang Ye, Krzysztof Wolski, Rafal K. Mantiuk
Pubblicato in: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, Pagina/e 5429-5437, ISBN 978-1-7281-3293-8
Editore: IEEE
DOI: 10.1109/cvpr.2019.00558

147th Audio Engineering Society Convention

Autori: Sarvesh Agrawal, Adèle Simon, Søren Bech, Klau Bærentsen, Søren Forchhammer
Pubblicato in: 2019, ISBN 978-1-942220-31-2
Editore: Audio Engineering Society
DOI: 10.17743/aesconv.2019.978-1-942220-31-2

Pixel-Wise Confidences for Stereo Disparities Using Recurrent Neural Networks

Autori: Muhammad Shahzeb Khan gul, Michel Bätz, Joachim Keinert
Pubblicato in: British Machine Vision Conference, Numero 2019, 2019, Pagina/e 1-13
Editore: British Machine Vision Association
DOI: 10.24406/iis-n-581312

Investigating Epipolar Plane Image Representations for Objective Quality Evaluation of Light Field Images

Autori: Ali Ak, Patrick Le-Callet
Pubblicato in: 2019 8th European Workshop on Visual Information Processing (EUVIP), 2019, Pagina/e 135-139, ISBN 978-1-7281-4496-2
Editore: IEEE
DOI: 10.1109/EUVIP47703.2019.8946194

Towards Perceptually Plausible Training of Image Restoration Neural Networks

Autori: Ali Ak, Patrick Le-Callet
Pubblicato in: 2019 Ninth International Conference on Image Processing Theory, Tools and Applications (IPTA), 2019, Pagina/e 1-5, ISBN 978-1-7281-3975-3
Editore: IEEE
DOI: 10.1109/IPTA.2019.8936096

A Benchmark of Light Field View Interpolation Methods

Autori: Dingcheng Yue, Muhammad Shahzeb Khan Gul, Michel Batz, Joachim Keinert, Rafal Mantiuk
Pubblicato in: 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), 2020, Pagina/e 1-6, ISBN 978-1-7281-1485-9
Editore: IEEE
DOI: 10.1109/icmew46912.2020.9106041

A High-Resolution High Dynamic Range Light-Field Dataset with an Application to View Synthesis and Tone-Mapping

Autori: M. Shahzeb Khan Gul, Thorsten Wolf, Michel Batz, Matthias Ziegler, Joachim Keinert
Pubblicato in: 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), 2020, Pagina/e 1-6, ISBN 978-1-7281-1485-9
Editore: IEEE
DOI: 10.1109/icmew46912.2020.9105964

Towards a Perceived Audiovisual Quality Model for Immersive Content

Autori: Randy Frans Fela, Nick Zacharov, Soren Forchhammer
Pubblicato in: 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX), 2020, Pagina/e 1-6, ISBN 978-1-7281-5965-2
Editore: IEEE
DOI: 10.1109/qomex48832.2020.9123134

View Synthesis-based Distributed Light Field Compression

Autori: M. Umair Mukati, Milan Stepanov, Giuseppe Valenzise, Frederic Dufaux, Soren Forchhammer
Pubblicato in: 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), Numero 2020, 2020, Pagina/e 1-6, ISBN 978-1-7281-1485-9
Editore: IEEE
DOI: 10.1109/icmew46912.2020.9105980

EPIC: Context Adaptive Lossless Light Field Compression using Epipolar Plane Images

Autori: Muhammad Umair Mukati, Soren Forchhammer
Pubblicato in: 2020 Data Compression Conference (DCC), Numero 2020, 2020, Pagina/e 43-52, ISBN 978-1-7281-6457-1
Editore: IEEE
DOI: 10.1109/dcc47342.2020.00012

RNNSC: Recurrent Neural Network-Based Stereo Compression Using Image and State Warping

Autori: M. Shahzeb Khan Gul, Hamid Suleman, Michel Bätz, and Joachim Keinert
Pubblicato in: Data Compression Conference (DCC), 2022, Pagina/e 455, ISBN 978-1-6654-7893-9
Editore: IEEE
DOI: 10.1109/dcc52660.2022.00066

No-Reference Quality Evaluation of Light Field Content Based on Structural Representation of The Epipolar Plane Image

Autori: Ali Ak, Suiyi Ling, Patrick Le Callet
Pubblicato in: 2020
Editore: IEEE The 1st ICME Workshop on Hyper-Realistic Multimedia for Enhanced Quality of Experience
DOI: 10.1109/icmew46912.2020.9105975

HMM-Based Framework to Measure the Visual Fidelity of Tone Mapping Operators

Autori: W. Ellahi, T. Vigier and P. Le Callet
Pubblicato in: 2020
Editore: 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)
DOI: 10.1109/icmew46912.2020.9106029

Characterizing fixational eye movements as a candidate biomarker of neurodegenerative disorders

Autori: Allie C. Hexley, Anna K. Hauperich, Laura K. Young, Tom McLeish, Hannah E. Smithson
Pubblicato in: 2021
Editore: Opthalmic and Physiological Optics
DOI: 10.1111/opo.12900

Light-Field View Synthesis Using A Convolutional Block Attention Module

Autori: M. Shahzeb Khan Gul, M. Umair Mukati, Michel Batz, Soren Forchhammer, Joachim Keinert
Pubblicato in: 2021 IEEE International Conference on Image Processing (ICIP), 2021, Pagina/e 3398-3402, ISBN 978-1-6654-4115-5
Editore: IEEE
DOI: 10.1109/icip42928.2021.9506586

Reliability of Crowdsourcing for Subjective Quality Evaluation of Tone Mapping Operators

Autori: Abhishek Goswami, Ali Ak, Wolf Hauser, Frédéric Dufaux, Patrick Le Callet.
Pubblicato in: International Workshop on Multimedia Signal Processing (MMSP'2021), 2021
Editore: IEEE

Tone Mapping Operators: Progressing Towards Semantic-Awareness

Autori: Abhishek Goswami, Mathis Petrovich, Wolf Hauser, Frederic Dufaux
Pubblicato in: 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), 2020, ISBN 978-1-7281-1485-9
Editore: IEEE
DOI: 10.1109/icmew46912.2020.9106057

Perception-Driven Hybrid Foveated Depth of Field Rendering for Head-Mounted Displays

Autori: Jingyu Liu, Claire Mantel, Søren Forchhammer
Pubblicato in: Proceedings of 2021 IEEE International Symposium on Mixed and Augmented Reality, Numero 22, 2021, Pagina/e 1-10, ISBN 978-1-6654-0158-6
Editore: IEEE
DOI: 10.1109/ismar52148.2021.00014

Learning-based lossless light field compression

Autori: Milan Stepanov, Muhammad Umair Mukati, Giuseppe Valenzise, Søren Forchhammer, Frédéric Dufaux
Pubblicato in: IEEE International Workshop on Multimedia Signal Processing (MMSP’2021), 2021
Editore: IEEE

Non-peer reviewed articles (1)

RV-TMO: Large-Scale Dataset for Subjective Quality Assessment of Tone Mapped Images

Autori: Ali Ak, Abhishek Goswami, Wolf Hauser, Patrick Le Callet, Frederic Dufaux
Pubblicato in: IEEE, 2022, ISSN 1520-9210
Editore: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tmm.2022.3203211

Other (2)

Multicamera Lightfield: High Dynamic Range Dataset Specification (Internal JPEG Input Document WG1M87038)

Autori: Gul, Muhammad Shahzeb Khan, Michel Bätz, Matthias Ziegler, Joachim Keinert, and Siegfried Fößel
Pubblicato in: Internal JPEG Input Document to ISO/IEC 21794 (JPEG PLENO), 2020
Editore: ISO/IEC 21794 (JPEG PLENO)

QUALINET White Paper on Definitions of Immersive Media Experience (IMEx)

Autori: Andrew Perkis, Christian Timmerer, Sabina Baraković, Jasmina Baraković Husić, Søren Bech, Sebastian Bosse, Jean Botev, Kjell Brunnström, Luis Cruz, Katrien De Moor, Andrea de Polo Saibanti, Wouter Durnez, Sebastian Egger-Lampl, Ulrich Engelke, Tiago H. Falk, Jesús Gutiérrez, Asim Hameed, Andrew Hines, Tanja Kojic, Dragan Kukolj, Eirini Liotou, Dragorad Milovanovic, Sebastian Möller, Niall
Pubblicato in: European Network on Quality of Experience in Multimedia Systems and Services, 14th QUALINET meeting (online)., 2020
Editore: European Network on Quality of Experience in Multimedia Systems and Services
DOI: 10.48550/arxiv.2007.07032

Book chapters (1)

Immersion in Audiovisual Experiences

Autori: Sarvesh Agrawal, Søren Bech
Pubblicato in: Sonic Interactions in Virtual Environments, 2022, ISBN 978-3-031-04020-7
Editore: Springer
DOI: 10.1007/978-3-031-04021-4_11