Perceptual encoding of high fidelity light fields

Project Information

EyeCode

Grant agreement ID: 725253

DOI 10.3030/725253

Project closed

EC signature date 17 March 2017

Start date 1 July 2017

End date 31 March 2023

Funded under

• EXCELLENT SCIENCE - European Research Council (ERC)

Total cost € 1 868 855,00

EU contribution € 1 868 855,00

Coordinated by

THE CHANCELLOR MASTERS AND SCHOLARS OF THE UNIVERSITY OF CAMBRIDGE
United Kingdom

Publications

Conference proceedings (17)

How to cheat with metrics in single-image HDR reconstruction

Author(s): Gabriel Eilertsen, Saghi Hajisharif, Param Hanji, Apostolia Tsirikoglou, Rafał K. Mantiuk, Jonas Unger
Published in: 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW), 2021, Page(s) 3998-4007
Publisher: IEEE
DOI: 10.1109/iccvw54120.2021.00445

Transformation Consistency Regularization- A Semi-Supervised Paradigm for Image-to-Image Translation

Author(s): Mustafa, Aamir; Mantiuk, Rafal K.
Published in: Proc. European Conference on Computer Vision (ECCV), Issue 1, 2020
Publisher: Springer
DOI: 10.17863/CAM.56431

Active Sampling for Pairwise Comparisons via Approximate Message Passing and Information Gain Maximization

Author(s): Mikhailiuk, Aliaksei; Wilmot, Clifford; Perez-Ortiz, Maria; Yue, Dingcheng; Mantiuk, Rafal
Published in: International Conference on Patter Recognition (ICPR), Issue 1, 2020
Publisher: IEEE

The effect of display brightness and viewing distance: a dataset for visually lossless image compression

Author(s): Aliaksei Mikhailiuk, Nanyang Ye and Rafał K. Mantiuk
Published in: Electronic Imaging, Human Vision and Electronic Imaging, 2021, Page(s) 152-1 - 152-8
Publisher: IS&T
DOI: 10.2352/issn.2470-1173.2021.11.hvei-152

Noise-aware merging of high dynamic range image stacks without camera calibration

Author(s): Param Hanji, Fangcheng Zhong, Rafał K. Mantiuk
Published in: Advances in Image Manipulation (ECCV workshop), 2020
Publisher: Elsevier

A Comparative Study on the Loss Functions for Image Enhancement Networks

Author(s): Aamir Mustafa, Hongjie You, Rafał K. Mantiuk
Published in: London Imaging Meeting, 2022
Publisher: IS&T
DOI: 10.2352/lim.2022.1.1.04

Impact of correct and simulated focus cues on perceived realism

Author(s): Joseph March; Anantha Krishnan; Simon Watt; Marek Wernikowski; Hongyun Gao; Ali Özgür Yöntem; Rafal Mantiuk
Published in: Proc. of SIGGRAPH Asia 2022, Issue 2, 2022
Publisher: ACM
DOI: 10.1145/3550469.3555405

Trained Perceptual Transform for Quality Assessment of High Dynamic Range Images and Video

Author(s): Nanyang Ye, Maria Perez-Ortiz, Rafal K. Mantiuk
Published in: 2018 25th IEEE International Conference on Image Processing (ICIP), 2018, Page(s) 1718-1722, ISBN 978-1-4799-7061-2
Publisher: IEEE
DOI: 10.1109/icip.2018.8451207

Psychometric scaling of TID2013 dataset

Author(s): Mikhailiuk, A; Perez-Ortiz, M; Mantiuk, Rafal
Published in: In: Atzori, L, (ed.) Proceedings of the 2018 Tenth International Conference on Quality of Multimedia Experience (QoMEX). IEEE: Cagliari, Italy. (2018), Issue 1, 2018
Publisher: IEEE
DOI: 10.17863/CAM.26628

Predicting Visible Image Differences Under Varying Display Brightness and Viewing Distance

Author(s): Nanyang Ye, Krzysztof Wolski, Rafal K. Mantiuk
Published in: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Issue http://openaccess.thecvf.com/content_CVPR_2019/html/Ye_Predicting_Visible_Image_Differences_Under_Varying_Display_Brightness_and_Viewing_CVPR_2019_paper.html, 2019, Page(s) 5429-5437, ISBN 978-1-7281-3293-8
Publisher: IEEE
DOI: 10.1109/cvpr.2019.00558

Single-Frame Regularization for Temporally Stable CNNs

Author(s): Gabriel Eilertsen, Rafal K. Mantiuk, Jonas Unger
Published in: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, Page(s) 11168-11177, ISBN 978-1-7281-3293-8
Publisher: IEEE
DOI: 10.1109/cvpr.2019.01143

Predicting visible flicker in temporally changing images

Author(s): Gyorgy Denes, Rafał K. Mantiuk
Published in: Human Vision and Electronic Imaging, 2020
Publisher: IS&T

Visibility Metric for Visually Lossless Image Compression

Author(s): Nanyang Ye, Maria Perez-Ortiz, Rafal K. Mantiuk
Published in: 2019 Picture Coding Symposium (PCS), 2019, Page(s) 1-5, ISBN 978-1-7281-4704-8
Publisher: IEEE
DOI: 10.1109/pcs48520.2019.8954560

Distilling Style from Image Pairs for Global Forward and Inverse Tone Mapping

Author(s): Aamir Mustafa, Param Hanji, Rafał K. Mantiuk
Published in: The 19th ACM SIGGRAPH European Conference on Visual Media Production (CVMP), 2022
Publisher: ACM
DOI: 10.1145/3565516.3565520

Minjung Kim, Maryam Azimi, and Rafał K. Mantiuk

Author(s): Minjung Kim, Maryam Azimi, and Rafał K. Mantiuk
Published in: Proc. IS&T Int’l. Symp. on Electronic Imaging: Human Vision and Electronic Imaging, 2021, Page(s) 153-1 - 153-7
Publisher: IS&T
DOI: 10.2352/issn.2470-1173.2021.11.hvei-153

Practical Color Contrast Sensitivity Functions for Luminance Levels up to 10000 cd/m2

Author(s): Rafal Mantiuk; Minjung Kim; Maliha Ashraf; Qiang Xu; M. Ronnier Luo; Jasna Martinovic; Sophie Wuerger
Published in: Color Imaging Conference, Issue 2, 2020
Publisher: IS&T
DOI: 10.2352/issn.2169-2629.2020.28.1

Comparison of single image HDR reconstruction methods — the caveats of quality assessment

Author(s): Hanji, Param; Mantiuk, Rafal; Eilertsen, Gabriel; Hajisharif, Saghi; Unger, Jonas
Published in: Proc. of SIGGRAPH 2022, Issue 1, 2022
Publisher: ACM
DOI: 10.1145/3528233.3530729

Peer reviewed articles (16)

Training a Task-Specific Image Reconstruction Loss

Author(s): Mustafa, Aamir; Mikhailiuk, Aliaksei; Iliescu, Dan Andrei; Babbar, Varun; Mantiuk, Rafal K.
Published in: 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Issue 26429381, 2022, ISSN 2642-9381
Publisher: IEEE
DOI: 10.1109/wacv51458.2022.00010

stelaCSF - A Unified Model of Contrast Sensitivity as the Function of Spatio-Temporal Frequency, Eccentricity, Luminance and Area

Author(s): Rafal K. Mantiuk, Maliha Ashraf, Alexandre Chapiro
Published in: ACM Transactions on Graphics, 2022, ISSN 0730-0301
Publisher: Association for Computing Machinary, Inc.
DOI: 10.1145/3528223.3530115

Consolidated Dataset and Metrics for High-Dynamic-Range Image Quality

Author(s): Aliaksei Mikhailiuk, Maria Perez-Ortiz, Dingcheng Yue, Wilson Samuel Suen, Rafa Mantiuk
Published in: IEEE Transactions on Multimedia, 2021, Page(s) 1-1, ISSN 1520-9210
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tmm.2021.3076298

Perceptual model for adaptive local shading and refresh rate

Author(s): Akshay Jindal, Krzysztof Wolski, Karol Myszkowski, Rafał K. Mantiuk
Published in: Perceptual model for adaptive local shading and refresh rate, 2021, Page(s) 281, ISSN 0730-0301
Publisher: Association for Computing Machinary, Inc.
DOI: 10.1145/3478513.3480514

FovVideoVDP: a visible difference predictor for wide field-of-view video

Author(s): Rafał K. Mantiuk, Gyorgy Denes, Alexandre Chapiro, Anton Kaplanyan, Gizem Rufo, Romain Bachy, Trisha Lian, and Anjul Patney
Published in: ACM Transactions on Graphics, Issue 40(4), 2021, Page(s) 49, ISSN 0730-0301
Publisher: Association for Computing Machinary, Inc.
DOI: 10.1145/3450626.3459831

Robust estimation of exposure ratios in multi-exposure image stacks

Author(s): Param Hanji, Rafal K. Mantiuk
Published in: IEEE Transactions on Computational Imaging, 2023, Page(s) 721-731, ISSN 2333-9403
Publisher: IEEE
DOI: 10.1109/tci.2023.3301338

Reproducing reality with a high-dynamic-range multi-focal stereo display

Author(s): Fangcheng Zhong, Akshay Jindal, Ali Özgür Yöntem, Param Hanji, Simon J. Watt, Rafał K. Mantiuk
Published in: ACM Transactions on Graphics, Issue 40 (6), 2021, Page(s) 241, ISSN 0730-0301
Publisher: Association for Computing Machinary, Inc.
DOI: 10.1145/3478513.3480513

Demonstrating a multi-primary high dynamic range display system for vision experiments

Author(s): Allie C. Hexley, Ali Özgür Yöntem, Manuel Spitschan, Hannah E. Smithson, Rafal Mantiuk
Published in: Journal of the Optical Society of America A, Issue 37/4, 2020, Page(s) A271, ISSN 1084-7529
Publisher: Optical Society of America
DOI: 10.1364/josaa.384022

A perceptual model of motion quality for rendering with adaptive refresh-rate and resolution

Author(s): Gyorgy Denes, Akshay Jindal, Aliaksei Mikhailiuk, Rafał K. Mantiuk
Published in: ACM Transactions on Graphics, Issue 39/4, 2020, ISSN 0730-0301
Publisher: Association for Computing Machinary, Inc.
DOI: 10.1145/3386569.3392411

Dataset and Metrics for Predicting Local Visible Differences

Author(s): Krzysztof Wolski, Daniele Giunchi, Nanyang Ye, Piotr Didyk, Karol Myszkowski, Radosław Mantiuk, Hans-Peter Seidel, Anthony Steed, Rafał K. Mantiuk
Published in: ACM Transactions on Graphics, Issue 37/5, 2018, Page(s) 1-14, ISSN 0730-0301
Publisher: Association for Computing Machinary, Inc.
DOI: 10.1145/3196493

Temporal Resolution Multiplexing: Exploiting the limitations of spatio-temporal vision for more efficient VR rendering

Author(s): Gyorgy Denes, Kuba Maruszczyk, George Ash, Rafal Mantiuk
Published in: IEEE Transactions on Visualization and Computer Graphics, Issue 1, 2019, Page(s) 1-1, ISSN 1077-2626
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tvcg.2019.2898741

DiCE

Author(s): Fangcheng Zhong, George Alex Koulieris, George Drettakis, Martin S. Banks, Mathieu Chambe, Frédo Durand, Rafał K. Mantiuk
Published in: ACM Transactions on Graphics (TOG), Issue 38/6, 2019, Page(s) 1-13, ISSN 0730-0301
Publisher: Association for Computing Machinary, Inc.
DOI: 10.1145/3355089.3356552

Selecting texture resolution using a task‐specific visibility metric

Author(s): K. Wolski, D. Giunchi, S. Kinuwaki, P. Didyk, K. Myszkowski, A. Steed, R. K. Mantiuk
Published in: Computer Graphics Forum, Issue 38/7, 2019, Page(s) 685-696, ISSN 0167-7055
Publisher: Blackwell Publishing Inc.
DOI: 10.1111/cgf.13871

From Pairwise Comparisons and Rating to a Unified Quality Scale

Author(s): Maria Perez-Ortiz, Aliaksei Mikhailiuk, Emin Zerman, Vedad Hulusic, Giuseppe Valenzise, Rafal K. Mantiuk
Published in: IEEE Transactions on Image Processing, Issue 29, 2020, Page(s) 1139-1151, ISSN 1057-7149
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tip.2019.2936103

improving depth perception under low luminance

Author(s): Wolski, K; Zhong, F; Myszkowski, K; Mantiuk, RK
Published in: ACM Transactions on Graphics, Issue 15577368, 2022, ISSN 1557-7368
Publisher: ACM
DOI: 10.1145/3528223.3530136

Spatio-chromatic contrast sensitivity under mesopic and photopic light levels

Author(s): Sophie Wuerger, Maliha Ashraf, Minjung Kim, Jasna Martinovic, María Pérez-Ortiz, Rafal K. Mantiuk
Published in: Journal of Vision, Issue 20/4, 2020, Page(s) 23, ISSN 1534-7362
Publisher: Association for Research in Vision and Ophthalmology
DOI: 10.1167/jov.20.4.23

Non-peer reviewed articles (1)

The Relation Between MOS and Pairwise Comparisons and the Importance of Cross-Content Comparisons

Author(s): Emin Zerman, Vedad Hulusic, Giuseppe Valenzise, Rafał K. Mantiuk, Frédéric Dufaux
Published in: Electronic Imaging, Issue 2018/14, 2018, Page(s) 1-6, ISSN 2470-1173
Publisher: Society for Imaging Science and Technology
DOI: 10.2352/issn.2470-1173.2018.14.hvei-517