Plenoptic Imaging

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Deliverables

Project website online

Project website prepared and published

Plenoptics conference

Conference organized by the network focusing on topics related to plenoptic imaging.

Industry event

Presenting project results to industry

Publications

Temporal resolution Improvement in Dynamic Speckle Analysis

Author(s): Mikhail Levchenko, Elena Stoykova, Violeta Madjarova
Published in: Materials, Methods and Technologies, 2022, Page(s) 189-197, ISSN 1314-7269
Publisher: Science Events Ltd

CR-DARTS: Channel Redistribution-Based Differentiable Architecture Search

Author(s): Ali Hassan, Tingting Zhang, Karen Egiazarian, Mårten Sjöström
Published in: IEEE Access, Issue 13, 2025, Page(s) 201166-201182, ISSN 2169-3536
Publisher: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2025.3637375

HEADSET: Human Emotion Awareness under Partial Occlusions Multimodal DataSET

Author(s): Fatemeh Ghorbani Lohesara, Davi Rabbouni Freitas, Christine Guillemot, Karen Eguiazarian, Sebastian Knorr
Published in: IEEE Transactions on Visualization and Computer Graphics, Issue 29, 2023, Page(s) 4686-4696, ISSN 1077-2626
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tvcg.2023.3320236

Normalization in dynamic speckle analysis for non-destructive monitoring of speed of processes

Author(s): Elena Stoykova, Dimana Nazarova, Lian nedelchev, Mikhail Levchenko, Natalia Berberova, B. Ivanov
Published in: Journal of Physics: Conference Series, 2021, ISSN 1742-6596
Publisher: IOP Publishing Ltd
DOI: 10.1088/1742-6596/2091/1/012002

Noise analysis in outdoor dynamic speckle measurement

Author(s): Mikhail Levchenko, Elena Stoykova, Branimir Ivanov, Lian Nedelchev, Dimana Nazarova, Kihong Choi, Joongki Park
Published in: Applied Optics, Issue 62, 2024, Page(s) D187, ISSN 1559-128X
Publisher: Optica Publishing Group
DOI: 10.1364/ao.478518

Intensity-based dynamic speckle method using JPEG and JPEG2000 compression

Author(s): Elena Stoykova, Blaga Blagoeva, Natalia Berberova, Mikhail Levchenko
Published in: Applied Optics, 2022, Page(s) Vol 61, Iddue 5, pp. B287-B296, ISSN 2155-3165
Publisher: Optica Publishing Group
DOI: 10.1364/ao.444831

Adaptive Segmentation-Based Initialization for Steered Mixture of Experts Image Regression

Author(s): Yi-Hsin Li, Sebastian Knorr, Mårten Sjöström, Thomas Sikora
Published in: IEEE Transactions on Multimedia, Issue 27, 2025, Page(s) 9802-9817, ISSN 1520-9210
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tmm.2025.3618576

Visibility-Based Geometry Pruning of Neural Plenoptic Scene Representations

Author(s): Davi R. Freitas, Ioan Tabus, Christine Guillemot
Published in: IEEE Transactions on Multimedia, Issue 28, 2026, Page(s) 1-16, ISSN 1520-9210
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tmm.2025.3618548

Transfer Learning-Based Approach for Thickness Estimation on Optical Coherence Tomography of Varicose Veins

Author(s): Maryam Viqar, Violeta Madjarova, Elena Stoykova, Dimitar Nikolov, Ekram Khan, Keehoon Hong
Published in: Micromachines, Issue 15, 2025, Page(s) 902, ISSN 2072-666X
Publisher: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/mi15070902

Dynamic load balancing for real-time multiview path tracing on multi-GPU architectures

Author(s): Erwan Leria, Markku Makitalo, Julius Ikkala, Pekka Jääskeläinen
Published in: Virtual Reality & Intelligent Hardware, Issue 7, 2025, Page(s) 393-405, ISSN 2096-5796
Publisher: Elsevier BV
DOI: 10.1016/j.vrih.2022.08.013

PVSDNet: Joint Depth Prediction and View Synthesis Via Shared Latent Spaces in Real-Time

Author(s): Manu Gond, Emin Zerman, Sebastian Knorr, Mårten Sjöström
Published in: IEEE Access, Issue 14, 2026, Page(s) 9021-9037, ISSN 2169-3536
Publisher: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2026.3653905

REDARTS: Regressive Differentiable Neural Architecture Search for Exploring Optimal Light Field Disparity Estimation Network

Author(s): Ali Hassan, Mårten Sjöström, Tingting Zhang, Karen Egiazarian
Published in: IEEE Transactions on Emerging Topics in Computational Intelligence, Issue 10, 2026, Page(s) 531-542, ISSN 2471-285X
Publisher: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/tetci.2025.3592281

Reconstruction of Optical Coherence Tomography Images from Wavelength Space Using Deep Learning

Author(s): Maryam Viqar, Erdem Sahin, Elena Stoykova, Violeta Madjarova
Published in: Sensors, Issue 25, 2024, Page(s) 93, ISSN 1424-8220
Publisher: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/s25010093

Double-phase metasurface operators for all-optical image processing

Author(s): Linzhi Yu, Haobijam J. Singh, Jesse Pietila, Humeyra Caglayan
Published in: Light: Science & Applications, Issue 15, 2026, ISSN 2047-7538
Publisher: Springer Science and Business Media LLC
DOI: 10.1038/s41377-025-02153-w

Modified Watershed Approach for Segmentation of Complex Optical Coherence Tomographic Images

Author(s): Maryam Viqar, Violeta Madjarova, Elena Stoykova
Published in: Materials, Methods, and Technologies, 2022, Page(s) 180-188, ISSN 1314-7269
Publisher: Science Events Ltd

Geometry-aware video inpainting for joint headset occlusion removal and face reconstruction in social extended reality

Author(s): Fatemeh Ghorbani Lohesara, Karen Eguiazarian, Sebastian Knorr
Published in: Journal of Electronic Imaging, Issue 34, 2025, ISSN 1017-9909
Publisher: S P I E - International Society for Optical Engineering
DOI: 10.1117/1.jei.34.5.051003

Efficient and Fast Light Field Compression via VAE-Based Spatial and Angular Disentanglement

Author(s): Soheib Takhtardeshir, Roger Olsson, Christine Guillemot, Mårten Sjöström
Published in: IEEE Access, Issue 13, 2025, Page(s) 18594-18607, ISSN 2169-3536
Publisher: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2025.3532608

Learning flat optics for extended depth of field microscopy imaging

Author(s): Ipek Anil Atalay Appak, Erdem Sahin, Christine Guillemot, Humeyra Caglayan
Published in: Nanophotonics, Issue 12, 2023, Page(s) 3623-3632, ISSN 2192-8614
Publisher: Walter de Gruyter GmbH
DOI: 10.1515/nanoph-2023-0321

Multifunctional Meta-optic Azimuthal Shear Interferometer

Author(s): Linzhi Yu, Sergei Shevtsov, Haobijam Johnson Singh, Peter G. Kazansky, Humeyra Caglayan
Published in: Nano Letters, Issue 25, 2025, Page(s) 7419-7425, ISSN 1530-6984
Publisher: American Chemical Society
DOI: 10.1021/acs.nanolett.5c00873

Inverse metasurface design enabling arbitrary spectral and polarization control

Author(s): Md Imran Hossain, Linzhi Yu, Humeyra Caglayan
Published in: Optical Materials Express, Issue 15, 2025, Page(s) 3036, ISSN 2159-3930
Publisher: Optical Society of America
DOI: 10.1364/ome.576189

Phase-Shifting Structured Illumination with a Polarization-Encoded Metasurface

Author(s): Linzhi Yu, Jesse Pietila, Haobijam Johnson Singh, Humeyra Caglayan
Published in: Nano Letters, Issue 25, 2025, Page(s) 11696-11702, ISSN 1530-6984
Publisher: American Chemical Society
DOI: 10.1021/acs.nanolett.5c02789

Dynamic speckle imaging with SVD compression

Author(s): Elena Stoykova, Mikhail Levchenko, B. Ivanoc, Violeta Madjarova, Dimana Nazarova, Lian Nedelchev, A. Mascikhin, J. Park
Published in: Journal of Physics: Conference Series, 2022, ISSN 1742-6596
Publisher: IOP Publishing Ltd
DOI: 10.1088/1742-6596/2407/1/012049

Dualf-D: Disentangled Dual-Hyperprior Approach for Light Field Image Compression

Author(s): Soheib Takhtardeshir, Roger Olsson, Christine Guillemot, Mårten Sjöström
Published in: Signal processing: Image Communication, 2025, ISSN 0923-5965
Publisher: Elsevier BV
DOI: 10.2139/ssrn.5294260

Subjective Visual Quality Assessment of Compressed Light Field Images: Learning-based vs. Conventional Methods

Author(s): Emin Zerman, Soheib Takhtardeshir, Anthony Trioux, Jianlong Qin, Wenjie Wu, Roger Olsson, Mårten Sjöström
Published in: 2025 IEEE International Workshop on Multimedia Signal Processing (MMSP), 2026, Page(s) 96-101
Publisher: IEEE
DOI: 10.1109/mmsp64401.2025.11324097

A Deep Learning based Light Field Image Compression as Pseudo Video Sequences with Additional in-loop Filtering

Author(s): Soheib Takhtardeshir, Roger Olsson, Christine Guillemot, Mårten Sjöström
Published in: Electronic Imaging, Issue 36, 2024, Page(s) 103-1-103-6, ISSN 2470-1173
Publisher: Society for Imaging Science & Technology
DOI: 10.2352/ei.2024.36.18.3dia-103

Edge-preserving denoising and super-resolution in OCT imagery using deep SMoE gating networks

Author(s): Aytac Ozkan, Violeta Madjarova, Thomas Sikora, Elena V. Stoykova
Published in: Biomedical Spectroscopy, Microscopy, and Imaging III, 2024, Page(s) 86
Publisher: SPIE
DOI: 10.1117/12.3017126

Towards Realistic Landmark-Guided Facial Video Inpainting Based on GANs

Author(s): Fatemeh Ghorbani Lohesara, Karen Eguiazarian, Sebastian Knorr
Published in: Electronic Imaging, Issue 36, 2024, Page(s) 246-1-246-6, ISSN 2470-1173
Publisher: Society for Imaging Science & Technology
DOI: 10.2352/ei.2024.36.10.ipas-246

Vanishing Point Aided Hash-Frequency Encoding for Neural Radiance Fields (NeRF) from Sparse 360°Input

Author(s): Kai Gu, Thomas Maugey, Sebastian Knorr, Christine Guillemot
Published in: 2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 2024, Page(s) 1142-1151, ISBN 979-8-3503-2838-7
Publisher: IEEE
DOI: 10.1109/ismar59233.2023.00131

Perceptually Optimized Model for Near-Eye Light Field Reconstruction

Author(s): Ugur Gudelek, Erdem Sahin, Atanas Gotchev
Published in: 2023 IEEE 25th International Workshop on Multimedia Signal Processing (MMSP), 2023, Page(s) 1-6, ISBN 979-8-3503-3894-2
Publisher: IEEE
DOI: 10.1109/mmsp59012.2023.10337716

DUALF-C: Disentangled Light Field Compression with Entropy-Aware Bitstream Generation

Author(s): Soheib Takhtardeshir, Roger Olsson, Christine Guillemot, Mårten Sjöström
Published in: 2025 International Conference on Visual Communications and Image Processing (VCIP), 2026, Page(s) 1-5
Publisher: IEEE
DOI: 10.1109/vcip67698.2025.11396841

A Spherical Light Field Database for Immersive Telecommunication and Telepresence Applications

Author(s): Emin Zerman, Manu Gond, Soheib Takhtardeshir, Roger Olsson, Mårten Sjöström
Published in: 2024 16th International Conference on Quality of Multimedia Experience (QoMEX), 2024, Page(s) 200-206, ISBN 979-8-3503-6158-2
Publisher: IEEE
DOI: 10.1109/qomex61742.2024.10598264

A simulation framework for perceptual characterization of holographic near-eye displays

Author(s): Ugur Gudelek, Erdem Sahin, Atanas Gotchev
Published in: Optical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR) VII, 2026, Page(s) 97
Publisher: SPIE
DOI: 10.1117/12.3101467

Segmentation-based Initialization for Steered Mixture of Experts

Author(s): Yi-Hsin Li, Mårten Sjöström, Sebastian Knorr, Thomas Sikora
Published in: 2023 IEEE International Conference on Visual Communications and Image Processing (VCIP), 2024, Page(s) 1-5, ISBN 979-8-3503-5986-2
Publisher: IEEE
DOI: 10.1109/vcip59821.2023.10402643

LFSphereNet: Real Time Spherical Light Field Reconstruction from a Single Omnidirectional Image

Author(s): Manu Gond, Emin Zerman, Sebastian Knorr, Mårten Sjöström
Published in: Proceedings of the 20th ACM SIGGRAPH European Conference on Visual Media Production, Issue 10, 2024, Page(s) 1-10
Publisher: ACM
DOI: 10.1145/3626495.3626500

Expression-aware video inpainting for HMD removal in XR applications

Author(s): Fatemeh Ghorbani Lohesara, Karen Egiazarian, Sebastian Knorr
Published in: Proceedings of the 20th ACM SIGGRAPH European Conference on Visual Media Production, 2024, Page(s) 1-9
Publisher: ACM
DOI: 10.1145/3626495.3626497

Denoising OCT images using steered mixture of experts with multi-model inference

Author(s): Aytac Ozkan, Elena Stoykova, Thomas Sikora, Violeta Madjarova
Published in: Optical Coherence Tomography and Coherence Domain Optical Methods in Biomedicine XXVIII, 2024, Page(s) 91
Publisher: SPIE
DOI: 10.1117/12.3000625

Opto-UNet: Optimized UNet for Segmentation of Varicose Veins in Optical Coherence Tomography

Author(s): Maryam Viqar, Violeta Madjarova, Vipul Baghel, Elena Stoykova
Published in: 2022 10th European Workshop on Visual Information Processing (EUVIP), 2022
Publisher: IEEE
DOI: 10.1109/euvip53989.2022.9922769

Light-Weight EPINET Architecture for Fast Light Field Disparity Estimation

Author(s): Ali Hassan, Mårten Sjöström, Tingting Zhang, Karen Egiazarian
Published in: 2022 IEEE 24th International Workshop on Multimedia Signal Processing (MMSP), 2022
Publisher: IEEE
DOI: 10.1109/mmsp55362.2022.9949378

Environmental Noise Impact on Dynamic Speckle Imaging

Author(s): Elena Stoykova, Mikhail Levchenko, Blaga Blagoeva, Dimana Nazarova, Lian Nedelchev, Nataliya Berberova-Buhova, Kihong Choi, and Joongki Park
Published in: Digital Holography and 3-D Imaging 2022, 2022
Publisher: Optica Publishing Group
DOI: 10.1364/dh.2022.w1a.3

Interactive Multi-GPU Light Field Path Tracing Using Multi-Source Spatial Reprojection

Author(s): Erwan Leria, Markku Mäkitalo, Pekka Jääskeläinen, Mårten Sjöström, Tingting Zhang
Published in: 30th ACM Symposium on Virtual Reality Software and Technology, 2024, Page(s) 1-11
Publisher: ACM
DOI: 10.1145/3641825.3687710

Real-Time View Synthesis with Multiplane Image Network using Multimodal Supervision

Author(s): Manu Gond, Mohammadreza Shamshirgarha, Emin Zerman, Sebastian Knorr, Mårten Sjöström
Published in: 2025 IEEE International Workshop on Multimedia Signal Processing (MMSP), 2026, Page(s) 60-65
Publisher: IEEE
DOI: 10.1109/mmsp64401.2025.11324036

RegSegField: Mask-Regularization and Hierarchical Segmentation for Novel View Synthesis from Sparse Inputs

Author(s): Kai Gu, Thomas Maugey, Knorr Sebastian, Christine Guillemot
Published in: Proceedings of 21st ACM SIGGRAPH Conference on Visual Media Production, 2025, Page(s) 1-10
Publisher: ACM
DOI: 10.1145/3697294.3697299

EPINET-Lite: Rethinking Mixed Convolutions for Efficient Light Field Disparity Estimation Network

Author(s): Ali Hassan, Tingting Zhang, Karen Egiazarian, Mårten Sjöström
Published in: 2025 IEEE International Workshop on Multimedia Signal Processing (MMSP), 2026, Page(s) 120-125
Publisher: IEEE
DOI: 10.1109/mmsp64401.2025.11324204

Intensity-based dynamic speckle method for analysis of variable-rate dynamic events

Author(s): Elena Stoykova, Lian Nedelchev, Blaga Blagoeva, Branimir Ivanov, Mikhail Levchenko, Nataliya Berberova-Buhova, Dimana Nazarova
Published in: Optical Measurement Systems for Industrial Inspection XIII, 2023, Page(s) 85
Publisher: SPIE
DOI: 10.1117/12.2673462

Deep Learning based Segmentation of Optical Coherence Tomographic Images of Human Saphenous Varicose Vein

Author(s): Maryam Viqar, Violeta Madjarova, Amit Kumar Yadav, Desislava Pashkuleva, and Alexander S. Machikhin
Published in: Digital Holography and 3D Imaging 2022, 2022
Publisher: Optica Publishing Group
DOI: 10.1364/dh.2022.w2a.5

3D SMoE Splatting for Edge-aware Realtime Radiance Field Rendering

Author(s): Yi-Hsin Li, Thomas Sikora, Sebastian Knorr, Mårten Sjöström
Published in: Proceedings of the SIGGRAPH Asia 2025 Conference Papers, 2025, Page(s) 1-11
Publisher: ACM
DOI: 10.1145/3757377.3763899

Training Methods for Regularizing Gradients on Multi-Task Image Restoration Problems

Author(s): Samuel Willingham, Mårten Sjöström, Christine Guillemot
Published in: Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, 2024, Page(s) 145-153
Publisher: SCITEPRESS - Science and Technology Publications
DOI: 10.5220/0012368100003660

A Visual Quality of Experience Toolkit for Realistic Immersive Telepresence Applications

Author(s): Manu Gond, Emin Zerman, Mohammadreza Shamshirgarha, Sebastian Knorr, Mårten Sjöström
Published in: 17th International Conference on Quality of Multimedia Experience (QoMEX 2025), 2025
Publisher: 17th International Conference on Quality of Multimedia Experience (QoMEX 2025)

Maximum a Posteriori Training of Diffusion Models for Image Restoration

Author(s): Samuel Willingham, Mårten Sjöström, Christine Guillemot
Published in: 2025 33rd European Signal Processing Conference (EUSIPCO), 2025, Page(s) 1882-1886
Publisher: IEEE
DOI: 10.23919/eusipco63237.2025.11226569

Real-time Stereoscopic Image-parallel Path Tracing

Author(s): Erwan Leria, Markku Mäkitalo, Pekka Jääskeläinen
Published in: Electronic Imaging, Issue 36, 2024, Page(s) 181-1-181-6, ISSN 2470-1173
Publisher: Society for Imaging Science & Technology
DOI: 10.2352/ei.2024.36.13.ervr-181

A Comparative Assessment of Implicit and Explicit Plenoptic Scene Representations

Author(s): Davi R. Freitas, Ricardo L. de Queiroz, Ioan Tabus, Christine Guillemot
Published in: 2024 IEEE 26th International Workshop on Multimedia Signal Processing (MMSP), 2024, Page(s) 1-6, ISBN 979-8-3503-8726-1
Publisher: IEEE
DOI: 10.1109/mmsp61759.2024.10743228

Portable low-cost setup for outdoor implementation of dynamic speckle technique

Author(s): Mikhail Levchenko, Elena Stoykova, Keehoon Hong, Joongki Park
Published in: Optical Measurement Systems for Industrial Inspection XIII, 2023, Page(s) 55
Publisher: SPIE
DOI: 10.1117/12.2673460

Steered-Mixture-of-Experts Regression for Image Denoising with Multi-Model Inference

Author(s): Aytac Özkan, Yi-Hsin Li, Thomas Sikora
Published in: 2023 31st European Signal Processing Conference (EUSIPCO), 2023, Page(s) 546-550
Publisher: IEEE
DOI: 10.23919/eusipco58844.2023.10289994

Geometry-Based Compression of Plenoptic Point Clouds

Author(s): Davi R. Freitas, Gustavo L. Sandri, Ricardo L. De Queiroz
Published in: 2022 IEEE 24th International Workshop on Multimedia Signal Processing (MMSP), 2022, Page(s) 1-5
Publisher: IEEE
DOI: 10.1109/mmsp55362.2022.9949107

Omni-nerf: neural radiance field from 360° image captures

Author(s): Kai Gu, Thomas Maugey, Sebastian Knorr, Christine Guillemot
Published in: 2022 IEEE International Conference on Multimedia and Expo (ICME), 2022
Publisher: IEEE
DOI: 10.1109/icme52920.2022.9859817

Prior for Multi-Task Inverse Problems in Image Reconstruction Using Deep Equilibrium Models

Author(s): Samuel Willingham, Mårten Sjöström, Christine Guillemot
Published in: 2023 31st European Signal Processing Conference (EUSIPCO), 2023, Page(s) 1220-1224, ISBN 979-8-3503-2811-0
Publisher: IEEE
DOI: 10.23919/eusipco58844.2023.10289950

Compression of PlenOctree Model Attributes Enabling Fast Communication and Rendering of Neural Radiance Fields

Author(s): Davi R. Freitas, Christine Guillemot, Ioan Tabus
Published in: 2023 31st European Signal Processing Conference (EUSIPCO), 2023, Page(s) 590-594, ISBN 979-8-3503-2811-0
Publisher: IEEE
DOI: 10.23919/eusipco58844.2023.10289984

A Visual Quality of Experience Toolkit for Realistic Immersive Telepresence Applications

Author(s): Manu Gond, Emin Zerman, Mohammadreza Shamshirgarha, Sebastian Knorr, Mårten Sjöström
Published in: 2025 17th International Conference on Quality of Multimedia Experience (QoMEX), 2025, Page(s) 1-7
Publisher: IEEE
DOI: 10.1109/qomex65720.2025.11219996

WAVE-UNET: Wavelength-based image reconstruction method using attention UNET for OCT images

Author(s): Maryam Viqar, Erdem Sahin, Violeta Madjarova, Elena Stoykova, Keehoon Hong
Published in: Medical Imaging 2024: Physics of Medical Imaging, 2024, Page(s) 154, ISSN 1605-7422
Publisher: SPIE
DOI: 10.1117/12.3006615

Segmentation-Driven Initialization for Sparse-view 3D Gaussian Splatting

Author(s): Yi-Hsin Li, Thomas Sikora, Sebastian Knorr, Mårten Sjöström
Published in: ssrn.com, 2026
Publisher: Elsevier BV
DOI: 10.2139/ssrn.6080592

Searching for OpenAIRE data...

Deliverables

Publications

Share this page Share this page on social networks

Download Download the content of the page