Computational Light fields IMaging

Project Information

CLIM

Grant agreement ID: 694122

DOI 10.3030/694122

Project closed

EC signature date 25 April 2016

Start date 1 September 2016

End date 28 February 2022

Funded under

• EXCELLENT SCIENCE - European Research Council (ERC)

Total cost € 2 461 086,00

EU contribution € 2 461 086,00

Coordinated by

INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET AUTOMATIQUE
France

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Publications

Peer reviewed articles (24)

Single Sensor Compressive Light Field Video Camera

Author(s): Saghi Hajisharif, Ehsan Miandji, Christine Guillemot, Jonas Unger
Published in: Computer Graphics Forum, Issue 39/2, 2020, Page(s) 463-474, ISSN 0167-7055
Publisher: Blackwell Publishing Inc.
DOI: 10.1111/cgf.13944

Local Low Rank Approximation With a Parametric Disparity Model for Light Field Compression

Author(s): Elian Dib, Mikael Le Pendu, Xiaoran Jiang, Christine Guillemot
Published in: IEEE Transactions on Image Processing, Issue 29, 2020, Page(s) 9641-9653, ISSN 1057-7149
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tip.2020.3029655

Compressive HDR light field imaging using a single multi-ISO sensor

Author(s): E. Miandji, H.-N. Nguyen, S. Hajisharif, J. Unger, C. Guillemot
Published in: IEEE Trans. on Computational Imaging, Issue Dec. 2021, 2021, Page(s) 1369 - 1384, ISSN 2333-9403
Publisher: IEEE
DOI: 10.1109/tci.2021.3132191

Compressively sampled light field reconstruction using orthogonal frequency selection and refinement

Author(s): Fatma Hawary, Guillaume Boisson, Christine Guillemot, Philippe Guillotel
Published in: Signal Processing: Image Communication, Issue 92, 2021, Page(s) 116087, ISSN 0923-5965
Publisher: Elsevier BV
DOI: 10.1016/j.image.2020.116087

A learning-based view extrapolation method for axial super-resolution

Author(s): Zhaolin Xiao, Jinglei Shi, Xiaoran Jiang, Christine Guillemot
Published in: Neurocomputing, Issue 455, 2021, Page(s) 229-241, ISSN 0925-2312
Publisher: Elsevier BV
DOI: 10.1016/j.neucom.2021.05.056

Compression of Plenoptic Point Cloud Attributes Using 6-D Point Clouds and 6-D Transforms

Author(s): M. Krivokuca, E. Miandji, C. Guillemot, P. Chou
Published in: IEEE Transactions on Multimedia, Issue Nov. 2021, 2021, ISSN 1941-0077
Publisher: IEEE
DOI: 10.1109/tmm.2021.3129341

Deep Unrolling for Light Field Compressed Acquisition using Coded Masks

Author(s): Guillaume Le Guludec, Christine Guillemot
Published in: IEEE Access, Issue 21693536, 2022, Page(s) 1-17, ISSN 2169-3536
Publisher: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2022.3168362

Deep Residual Architecture Using Pixel and Feature Cues for View Synthesis and Temporal Interpolation

Author(s): Jinglei Shi, Xiaoran Jiang, Christine Guillemot
Published in: IEEE Trans. on Computational Imaging, Issue March 2022, 2022, ISSN 2333-9403
Publisher: IEEE
DOI: 10.1109/tci.2022.3160671

Multi-Mask Camera Model for Compressed Acquisition of Light Fields

Author(s): Hoai-Nam Nguyen, Ehsan Miandji, Christine Guillemot
Published in: IEEE Transactions on Computational Imaging, Issue 7, 2021, Page(s) 191-208, ISSN 2333-9403
Publisher: IEEE
DOI: 10.1109/tci.2021.3053702

Scene Flow Estimation From Sparse Light Fields Using a Local 4D Affine Model

Author(s): Pierre David, Mikael Le Pendu, Christine Guillemot
Published in: IEEE Transactions on Computational Imaging, Issue 6, 2020, Page(s) 791-805, ISSN 2333-9403
Publisher: IEEE
DOI: 10.1109/tci.2020.2981200

Prediction and Sampling With Local Graph Transforms for Quasi-Lossless Light Field Compression

Author(s): Mira Rizkallah, Thomas Maugey, Christine Guillemot
Published in: IEEE Transactions on Image Processing, Issue 29, 2020, Page(s) 3282-3295, ISSN 1057-7149
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tip.2019.2959215

Light Field Compression With Homography-Based Low-Rank Approximation

Author(s): Xiaoran Jiang, Mikael Le Pendu, Reuben A. Farrugia, Christine Guillemot
Published in: IEEE Journal of Selected Topics in Signal Processing, Issue 11/7, 2017, Page(s) 1132-1145, ISSN 1932-4553
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/JSTSP.2017.2747078

Super Resolution of Light Field Images Using Linear Subspace Projection of Patch-Volumes

Author(s): Reuben A. Farrugia, Christian Galea, Christine Guillemot
Published in: IEEE Journal of Selected Topics in Signal Processing, Issue 11/7, 2017, Page(s) 1058-1071, ISSN 1932-4553
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/JSTSP.2017.2747127

Light Field Inpainting Propagation via Low Rank Matrix Completion

Author(s): Mikael Le Pendu, Xiaoran Jiang, Christine Guillemot
Published in: IEEE Transactions on Image Processing, Issue 27/4, 2018, Page(s) 1981-1993, ISSN 1057-7149
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TIP.2018.2791864

Light Field Super-Resolution using a Low-Rank Prior and Deep Convolutional Neural Networks

Author(s): Reuben Farrugia, Christine Guillemot
Published in: IEEE Transactions on Pattern Analysis and Machine Intelligence, Issue January 2019, 2019, Page(s) 1-1, ISSN 0162-8828
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tpami.2019.2893666

A Fourier Disparity Layer Representation for Light Fields

Author(s): Mikael Le Pendu, Christine Guillemot, Aljosa Smolic
Published in: IEEE Transactions on Image Processing, Issue 28/11, 2019, Page(s) 5740-5753, ISSN 1057-7149
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/TIP.2019.2922099

4D Anisotropic Diffusion Framework with PDEs for Light Field Regularization and Inverse Problems

Author(s): Pierre Allain, Laurent Guillo, Christine Guillemot
Published in: IEEE Transactions on Computational Imaging, Issue 06/2019, 2019, Page(s) 1-1, ISSN 2333-9403
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tci.2019.2919229

A Framework for Learning Depth From a Flexible Subset of Dense and Sparse Light Field Views

Author(s): Jinglei Shi, Xiaoran Jiang, Christine Guillemot
Published in: IEEE Transactions on Image Processing, Issue 28/12, 2019, Page(s) 5867-5880, ISSN 1057-7149
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tip.2019.2923323

Geometry-Aware Graph Transforms for Light Field Compact Representation

Author(s): Mira Rizkallah, Xin Su, Thomas Maugey, Christine Guillemot
Published in: IEEE Transactions on Image Processing, Issue 07/2019, 2019, Page(s) 1-1, ISSN 1057-7149
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tip.2019.2928873

Light Fields for Face Analysis

Author(s): Chiara Galdi, Valeria Chiesa, Christoph Busch, Paulo Lobato Correia, Jean-Luc Dugelay, Christine Guillemot
Published in: Sensors, Issue 19/12, 2019, Page(s) 2687, ISSN 1424-8220
Publisher: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/s19122687

A simple framework to leverage state-of-the-art single-image super-resolution methods to restore light fields

Author(s): Reuben A. Farrugia, Christine Guillemot
Published in: Signal Processing: Image Communication, Issue Sept. 2019, 2019, Page(s) 115638, ISSN 0923-5965
Publisher: Elsevier BV
DOI: 10.1016/j.image.2019.115638

Rate-Distortion Optimized Graph Coarsening and Partitioning for Light Field Coding

Author(s): Mira Rizkallah, Thomas Maugey, Christine Guillemot
Published in: IEEE Transactions on Image Processing, Issue 30, 2021, Page(s) 5518-5532, ISSN 1057-7149
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tip.2021.3085203

Deep Light Field Acquisition Using Learned Coded Mask Distributions for Color Filter Array Sensors

Author(s): Guillaume Le Guludec; Ehsan Miandji; Christine Guillemot
Published in: IEEE Transactions on Computational Imaging, Issue 1, 2021, ISSN 2333-9403
Publisher: IEEE
DOI: 10.1109/tci.2021.3077131

A Lightweight Neural Network for Monocular View Generation with Occlusion Handling

Author(s): Simon Evain, Christine Guillemot
Published in: IEEE Transactions on Pattern Analysis and Machine Intelligence, 2019, Page(s) 1-1, ISSN 0162-8828
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tpami.2019.2960689

Conference proceedings (26)

Deep video frame rate up-conversion network using feature-based progressive residue refinement

Author(s): J. Shi, X. Jiang, C. Guillemot
Published in: 17th International Conference on Computer Vision Theory and Applications (VISAPP), Issue Feb. 2022, 2022
Publisher: Visigrapp

Sphere Mapping for Feature Extraction From 360° Fish-Eye Captures

Author(s): Fatma Hawary, Thomas Maugey, Christine Guillemot
Published in: 2020 IEEE 22nd International Workshop on Multimedia Signal Processing (MMSP), 2020, Page(s) 1-6, ISBN 978-1-7281-9320-5
Publisher: IEEE
DOI: 10.1109/mmsp48831.2020.9287149

Colour Compression of Plenoptic Point Clouds Using Raht-Klt with Prior Colour Clustering and Specular/Diffuse Component Separation

Author(s): Maja Krivokuca, Christine Guillemot
Published in: ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2020, Page(s) 1978-1982, ISBN 978-1-5090-6631-5
Publisher: IEEE
DOI: 10.1109/icassp40776.2020.9053862

Color and Angular Reconstruction of Light Fields from Incomplete-Color Coded Projections

Author(s): Hoai-Nam Nguyen, Christine Guillemot
Published in: ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2020, Page(s) 1494-1498, ISBN 978-1-5090-6631-5
Publisher: IEEE
DOI: 10.1109/icassp40776.2020.9053559

Learning Fused Pixel and Feature-Based View Reconstructions for Light Fields

Author(s): Jinglei Shi, Xiaoran Jiang, Christine Guillemot
Published in: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, Page(s) 2552-2561, ISBN 978-1-7281-7168-5
Publisher: IEEE
DOI: 10.1109/cvpr42600.2020.00263

Regularizing the Deep Image Prior with a Learned Denoiser for Linear Inverse Problems

Author(s): R. Fermanian, M. Le Pendu, C. Guillemot
Published in: IEEE 23rd workshop on Multimedia Siganl Processing, Issue Oct. 2021, 2021
Publisher: IEEE

Light field compression using depth image based view synthesis

Author(s): Xiaoran Jiang, Mikael Le Pendu, Christine Guillemot
Published in: 2017 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), Issue July 2017, 2017, Page(s) 19-24, ISBN 978-1-5386-0560-8
Publisher: IEEE
DOI: 10.1109/ICMEW.2017.8026313

Graph-based light fields representation and coding using geometry information

Author(s): Xin Su, Mira Rizkallah, Thomas Maugey, Christine Guillemot
Published in: 2017 IEEE International Conference on Image Processing (ICIP), Issue Sept. 2017, 2017, Page(s) 4023-4027, ISBN 978-1-5090-2175-8
Publisher: IEEE
DOI: 10.1109/ICIP.2017.8297038

White lenslet image guided demosaicing for plenoptic cameras

Author(s): Pierre David, Mikael Le Pendu, Christine Guillemot
Published in: 2017 IEEE 19th International Workshop on Multimedia Signal Processing (MMSP), Issue Oct. 2017, 2017, Page(s) 1-6, ISBN 978-1-5090-3649-3
Publisher: IEEE
DOI: 10.1109/MMSP.2017.8122234

Epipolar Plane Diffusion: An Efficient Approach for Light Field Editing

Author(s): Oriel Frigo and Christine Guillemot
Published in: British Machine Vision Conference (BMVC), Issue Sept. 2017, 2017
Publisher: British Machine Vision Association (BMVA)

Depth Estimation with Occlusion Handling from a Sparse Set of Light Field Views

Author(s): Xiaoran Jiang, Mikael Le Pendu, Christine Guillemot
Published in: 2018 25th IEEE International Conference on Image Processing (ICIP), Issue Sept. 2018, 2018, Page(s) 634-638, ISBN 978-1-4799-7061-2
Publisher: IEEE
DOI: 10.1109/ICIP.2018.8451466

Rate-Distortion Optimized Super-Ray Merging for Light Field Compression

Author(s): Xin Su, Mira Rizkallah, Thomas Mauzev, Christine Guillemot
Published in: 2018 26th European Signal Processing Conference (EUSIPCO), Issue Sept. 2018, 2018, Page(s) 1850-1854, ISBN 978-9-0827-9701-5
Publisher: IEEE
DOI: 10.23919/eusipco.2018.8553485

Graph-based Transforms for Predictive Light Field Compression based on Super-Pixels

Author(s): Mira Rizkallah, Xin Su, Thomas Maugey, Christine Guillemot
Published in: 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Issue Apr. 2018, 2018, Page(s) 1718-1722, ISBN 978-1-5386-4658-8
Publisher: IEEE
DOI: 10.1109/ICASSP.2018.8462288

High Dynamic Range Light Fields via Weighted Low Rank Approximation

Author(s): Mikael Le Pendu, Christine Guillemot, Aljosa Smolic
Published in: 2018 25th IEEE International Conference on Image Processing (ICIP), Issue Sept. 2018, 2018, Page(s) 1728-1732, ISBN 978-1-4799-7061-2
Publisher: IEEE
DOI: 10.1109/ICIP.2018.8451584

Multi-Shot Single Sensor Light Field Camera Using a Color Coded Mask

Author(s): Ehsan Miandji, Jonas Unger, Christine Guillemot
Published in: 2018 26th European Signal Processing Conference (EUSIPCO), Issue Sept.2018, 2018, Page(s) 226-230, ISBN 978-9-0827-9701-5
Publisher: IEEE
DOI: 10.23919/eusipco.2018.8553230

A Learning Based Depth Estimation Framework for 4D Densely and Sparsely Sampled Light Fields

Author(s): Xiaoran Jiang, Jinglei Shi, Christine Guillemot
Published in: ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Issue 05/2019, 2019, Page(s) 2257-2261, ISBN 978-1-4799-8131-1
Publisher: IEEE
DOI: 10.1109/ICASSP.2019.8683773

Denoising of 3D Point Clouds Constructed from Light Fields

Author(s): Christian Galea, Christine Guillemot
Published in: ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Issue 05/2019, 2019, Page(s) 1882-1886, ISBN 978-1-4799-8131-1
Publisher: IEEE
DOI: 10.1109/ICASSP.2019.8683548

Super-Ray Based Low Rank Approximation for Light Field Compression

Author(s): Elian Dib, Mikael Le Pendu, Xiaoran Jiang, Christine Guillemot
Published in: 2019 Data Compression Conference (DCC), Issue 03/2019, 2019, Page(s) 369-378, ISBN 978-1-7281-0657-1
Publisher: IEEE
DOI: 10.1109/DCC.2019.00045

Light Field Denoising Using 4D Anisotropic Diffusion

Author(s): Pierre Allain, Laurent Guillo, Christine Guillemot
Published in: ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Issue 05/2019, 2019, Page(s) 1692-1696, ISBN 978-1-4799-8131-1
Publisher: IEEE
DOI: 10.1109/ICASSP.2019.8682709

Graph-Based Spatio-Angular Prediction for Quasi-Lossless Compression of Light Fields

Author(s): Mira Rizkallah, Thomas Maugey, Christine Guillemot
Published in: 2019 Data Compression Conference (DCC), Issue 03/2019, 2019, Page(s) 379-388, ISBN 978-1-7281-0657-1
Publisher: IEEE
DOI: 10.1109/DCC.2019.00046

Light Field Compression Using Fourier Disparity Layers

Author(s): Elian Dib, Mikael Le Pendu, Christine Guillemot
Published in: 2019 IEEE International Conference on Image Processing (ICIP), Issue 09/2019, 2019, Page(s) 3751-3755, ISBN 978-1-5386-6249-6
Publisher: IEEE
DOI: 10.1109/icip.2019.8803756

3D Scene Modeling from Dense Video Light Fields

Author(s): Xiaoran Jiang, Christian Galea, Laurent Guillo, Christine Guillemot
Published in: 2018 International Conference on 3D Immersion (IC3D), Issue 12/2018, 2018, Page(s) 1-7, ISBN 978-1-5386-7590-8
Publisher: IEEE
DOI: 10.1109/ic3d.2018.8657908

Sparse to Dense Scene Flow Estimation From Light Fields

Author(s): Pierre David, Mikael Le Pendu, Christine Guillemot
Published in: 2019 IEEE International Conference on Image Processing (ICIP), Issue 09/2019, 2019, Page(s) 3736-3740, ISBN 978-1-5386-6249-6
Publisher: IEEE
DOI: 10.1109/icip.2019.8803520

Sub-Dip: Optimization On A Subspace With Deep Image Prior Regularization And Application To Superresolution

Author(s): Alexander Sagel, Aline Roumy, Christine Guillemot
Published in: ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2020, Page(s) 2513-2517, ISBN 978-1-5090-6631-5
Publisher: IEEE
DOI: 10.1109/icassp40776.2020.9054270

A Neural Network with Adversarial Loss for Light Field Synthesis from a Single Image

Author(s): Simon Evain, Christine Guillemot
Published in: Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, 2021, Page(s) 175-184, ISBN 978-989-758-488-6
Publisher: SCITEPRESS - Science and Technology Publications
DOI: 10.5220/0010268701750184

Angularly Consistent Light Field Video Interpolation

Author(s): Pierre David, Mikael Le Pendu, Christine Guillemot
Published in: 2020 IEEE International Conference on Multimedia and Expo (ICME), 2020, Page(s) 1-6, ISBN 978-1-7281-1331-9
Publisher: IEEE
DOI: 10.1109/icme46284.2020.9102968

Other (2)

Light field image processing: overview and research issues

Author(s): Christine Guillemot and Reuben Farrugia
Published in: MMTC Communications - Frontiers, Issue vol. 12, No. 4, July 2017, 2017
Publisher: IEEE Multimedia Communications Technical Committee

Light field video dataset captured by a R8 Raytrix camera (with disparity maps)

Author(s): Guillo , Laurent; Jiang , Xiaoran; Lafruit , Gauthier; Guillemot , Christine
Published in: https://hal.inria.fr/hal-01804578, Issue Apr. 2018, 2018
Publisher: MPEG

Book chapters (1)

Fast Light Field Inpainting Propagation Using Angular Warping and Color-Guided Disparity Interpolation

Author(s): Pierre Allain, Laurent Guillo, Christine Guillemot
Published in: Advanced Concepts for Intelligent Vision Systems - 19th International Conference, ACIVS 2018, Poitiers, France, September 24–27, 2018, Proceedings, Issue 11182, 2018, Page(s) 559-570, ISBN 978-3-030-01448-3
Publisher: Springer International Publishing
DOI: 10.1007/978-3-030-01449-0_47