Advanced Visual and Geometric Computing for 3D Capture, Display, and Fabrication

Informations projet

EVOCATION

N° de convention de subvention: 813170

DOI

10.3030/813170

Projet clôturé

Date de signature de la CE 17 Août 2018

Date de début 1 Octobre 2018

Date de fin 31 Mai 2023

Financé au titre de

• EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions

Coût total

€ 3 639 335,04

Contribution de l’UE

€ 3 639 335,04

Coordonné par

UNIVERSITAET ROSTOCK
Germany

CORDIS fournit des liens vers les livrables publics et les publications des projets HORIZON.

Les liens vers les livrables et les publications des projets du 7e PC, ainsi que les liens vers certains types de résultats spécifiques tels que les jeux de données et les logiciels, sont récupérés dynamiquement sur OpenAIRE .

Livrables

Documents, reports (22)

Interim report on development of new computational fabrication techniques
Interim report on the development of new geometry and material acquisition techniques and processing methods
Indoor mapping for AEC
Summer school 3 report
Interim report on the development of new display system technologies
Standardized format coupling geometry and optical material properties
Summer school 2 report
New architecture for high-fidelity light-field display

New architecture for highfidelity lightfield display

New technologies for high-level structured reconstruction with visual and depth sensing

New technologies for highlevel structured reconstruction with visual and depth sensing

New technologies for integrated shape and surface reflectance digitization
New Technologies for scalable interactive visualization
State-of-the-art report on computational fabrication

State-of-the-art report on computational fabrication.

State-of-the-art report on geometry and material acquisition and processing

State-of-the-art report on geometry and material acquisition and processing.

State-of-the-art report on display systems

State-of-the-art report on display systems.

Summer school 1 report

Summer school 1 report.

New technologies for enhanced fabrication
Immersive tele-collaboration

Immersive telecollaboration

New technologies for telepresence on pixel-intensive displays

New technologies for telepresence on pixelintensive displays

Interim report on the development of new interactive visualization techniques
New technologies for material emulation
State-of-the-art report on interactive visualization

State-of-the-art report on interactive visualization.

Capture and replication for cultural heritage

Publications

Conference proceedings (33)

Recommendations on the viewing distance of light field displays

Auteurs: Peter A. Kara and Attila Barsi and Roopak R. Tamboli and Mary Guindy and Maria G. Martini and Tibor Balogh and Aniko Simon
Publié dans: SPIE Digital Optical Technologies 2021, 2021, Page(s) 166 -- 179
Éditeur: SPIE
DOI: 10.1117/12.2594266

Evaluating deep learning methods for low resolution point cloud registration in outdoor scenarios

Auteurs: Siddique, Arslan; Corsini, Massimiliano; Ganovelli, Fabio; Cignoni, Paolo
Publié dans: STAG 2021 - Eurographics Italian Chapter Conference, pp. 187–191, Online Conference, 28-29/10/2021, Numéro 3, 2021
Éditeur: The Eurographics Association
DOI: 10.2312/stag.20211489

Interaction methods for light field displays by means of a theater model environment

Auteurs: Mary Guindy and Attila Barsi and Peter A. Kara and Tibor Balogh and Aniko Simon
Publié dans: SPIE Optics + Optoelectronics, 2021, Page(s) 109 -- 118
Éditeur: SPIE
DOI: 10.1117/12.2589126

Perceptual preference for 3D interactions and realistic physical camera motions on light field displays

Auteurs: Mary Guindy and Peter A. Kara and Tibor Balogh and Aniko Simon
Publié dans: Virtual, Augmented, and Mixed Reality (XR) Technology for Multi-Domain Operations III, 2022, Page(s) 154 -- 162
Éditeur: SPIE
DOI: 10.1117/12.2624591

CLASSROOM : synthetic high dynamic range light field dataset

Auteurs: Guindy, Mary, Adhikarla, Vamsi K., Kara, Peter Andras, Balogh, Tibor and Simon, Aniko
Publié dans: Applications of Digital Image Processing XLV, 2022
Éditeur: SPIE

On the simulation of hand-held cameras in light-field rendering

Auteurs: Mary Guindy and Attila Barsi and Peter A. Kara and Tibor Balogh and Aniko Simon
Publié dans: SPIE Optics + Optoelectronics, 2021, Page(s) 119 -- 124
Éditeur: SPIE
DOI: 10.1117/12.2589129

Exploratory study on a segmented shell made of recycled-HDPE plastic

Auteurs: Laccone F.; Manolas I.; Malomo L.; Cignoni P.
Publié dans: Exploratory study on a segmented shell made of recycled-HDPE plastic, 2021, ISBN 9781739939335
Éditeur: Spatial Structures Research Centre of the University of Surrey
DOI: 10.15126/900337

A Robust Feature-aware Sparse Mesh Representation

Auteurs: Perez, Lizeth Joseline Fuentes and Calla, Luciano Arnaldo Romero and Montenegro, Anselmo Antunes and Mura, Claudio and Pajarola, Renato
Publié dans: Pacific Graphics Short Papers, 2020, Page(s) 25-30, ISBN 978-3-03868-120-5
Éditeur: The Eurographics Association
DOI: 10.2312/pg.20201226

Guiding Lens-based Exploration using Annotation Graphs

Auteurs: Moonisa Ahsan, Fabio Marton, Ruggero Pintus and Enrico Gobbetti
Publié dans: Proc. Smart Tools and Applications in Graphics (STAG), 2021, Page(s) 85-90, ISBN 978-3-03868-165-6
Éditeur: The Eurographics Association
DOI: 10.2312/stag.20211477

One step closer to a better experience : analysis of the suitable viewing distance ranges of light field visualization usage contexts for observers with reduced visual capabilities

Auteurs: Simon, Aniko, Kara, Peter A., Guindy, Mary, Qiu, Xinyu, Szy, Laszlo and Balogh, Tibor
Publié dans: Novel Optical Systems, Methods, and Applications XXV, 2022
Éditeur: SPIE
DOI: 10.1117/12.2633613

A Cross-polarization as a Possible Cause for Color Shift in Illumination

Auteurs: Abu Haila, Tarek and Tausch, Reimar and Fellner, Dieter and Santos, Pedro and Ritz, Martin
Publié dans: Electronic Imaging, 2023
Éditeur: Society for Imaging Science and Technology
DOI: 10.2352/ei.2023.35.15.color-192

The Perceptually-Supported and the Subjectively-Preferred Viewing Distance of Projection-Based Light Field Displays

Auteurs: Kara, Péter A., Guindy, Mary, Balogh, Tibor and Simon, Aniko
Publié dans: 2021 International Conference on 3D Immersion (IC3D), 2021, ISBN 978-1-6654-5830-6
Éditeur: IEEE
DOI: 10.1109/ic3d53758.2021.9687222

Who watches the watches: on the delivery of the specifications of smart wearable devices and recommendations on the related best practices

Auteurs: Aniko Simon, Laszlo Szy, Peter A. Kara, and Mary Guindy
Publié dans: Smart Biomedical and Physiological Sensor Technology XIX, 2022, Page(s) 1212303
Éditeur: SPIE
DOI: 10.1117/12.2619012

Through a different lens: the perceived quality of light field visualization assessed by test participants with imperfect visual acuity and color blindness

Auteurs: Aniko Simon and Mary Guindy and Peter A. Kara and Tibor Balogh and Laszlo Szy
Publié dans: Big Data IV: Learning, Analytics, and Applications, 2022, Page(s) 212 -- 221
Éditeur: SPIE
DOI: 10.1117/12.2618638

Latent Factor Modeling of Perceived Quality for Stereoscopic 3D Video Recommendation

Auteurs: Appina, Balasubramanyam, Sharma, Mansi, Kumar, Santosh, Kara, Peter A., Simon, Aniko and Guindy, Mary
Publié dans: 2021 International Conference on 3D Immersion (IC3D), 2021, ISBN 978-1-6654-5830-6
Éditeur: IEEE
DOI: 10.1109/ic3d53758.2021.9687271

Analysis of high dynamic range light field images in practical utilization contexts

Auteurs: Guindy, Mary, Kara, Peter A., Balogh, Tibor and Simon, Aniko
Publié dans: Novel Optical Systems, Methods, and Applications XXV, 2022
Éditeur: SPIE
DOI: 10.1117/12.2633912

Gaussian Mixture Convolution Networks

Auteurs: Adam Celarek and Pedro Hermosilla and Bernhard Kerbl and Timo Ropinski and Michael Wimmer
Publié dans: The Tenth International Conference on Learning Representations (ICLR 2022), 2022, Page(s) 1 - 23
Éditeur: OpenReview.org
DOI: 10.48550/arxiv.2202.09153

3D light field LED wall

Auteurs: Tibor Balogh and Attila Barsi and Peter A. Kara and Mary Guindy and Aniko Simon and Zsolt Nagy
Publié dans: SPIE Digital Optical Technologies 2021, 2021, Page(s) 180 -- 190
Éditeur: SPIE
DOI: 10.1117/12.2594276

Performance Evaluation of HDR Image Reconstruction Techniques on Light Field Images

Auteurs: Guindy, Mary and Kiran, Adhikarla V. and Kara, Peter A. and Balogh, Tibor and Simon, Aniko
Publié dans: 2021 International Conference on 3D Immersion (IC3D), 2021, ISBN 978-1-6654-5830-6
Éditeur: IEEE
DOI: 10.1109/ic3d53758.2021.9687182

Exploiting Neighboring Pixels Similarity for Effective SV-BRDF Reconstruction from Sparse MLICs

Auteurs: Ruggero Pintus, Moonisa Ahsan, Fabio Marton and Enrico Gobbetti
Publié dans: The 19th Eurographics Workshop on Graphics and Cultural Heritage, 2021, Page(s) 103-112, ISBN 978-3-03868-141-0
Éditeur: The Eurographics Association
DOI: 10.2312/gch.20211412

Realistic physical camera motion for light field visualization

Auteurs: Mary Guindy and Attila Barsi and Peter A. Kara and Tibor Balogh and Aniko Simon
Publié dans: SPIE Optics + Optoelectronics, 2021, Page(s) 70 -- 77
Éditeur: SPIE
DOI: 10.1117/12.2589128

Automatic 3D reconstruction of structured indoor environments

Auteurs: Giovanni Pintore, Claudio Mura, Fabio Ganovelli, Lizeth Fuentes-Perez, Renato Pajarola, Enrico Gobbetti
Publié dans: ACM SIGGRAPH 2020 Courses, 2020, Page(s) 1-218, ISBN 9781450379724
Éditeur: ACM
DOI: 10.1145/3388769.3407469

Cost Volume Refinement for Depth Prediction

Auteurs: Cardoso, Joao Afonso,Goncalves, Nuno, and Wimmer, Michael
Publié dans: 25th International Conference on Pattern Recognition, 2021, Page(s) 354-361, ISBN 978-1-7281-8808-9
Éditeur: IEEE
DOI: 10.1109/icpr48806.2021.9412730

Effect of Polarization on RGB Imaging and Color Accuracy/Fidelity

Auteurs: Abu Haila, Tarek and Tausch, Reimar and Ritz, Martin and Santos, Pedro and Fellner, Dieter
Publié dans: Color and Imaging Conference, 2022
Éditeur: Society for Imaging Science and Technology
DOI: 10.2352/cic.2022.30.1.30

Towards reconstructing HDR light fields by combining 2D and 3D CNN architectures

Auteurs: Mary Guindy and Adhikarla V. Kiran and Peter A. Kara and Tibor Balogh and Aniko Simon
Publié dans: Big Data IV: Learning, Analytics, and Applications, 2022, Page(s) 192 -- 197
Éditeur: SPIE
DOI: 10.1117/12.2618993

A computational tool for the analysis of 3D bending-active structures based on the dynamic relaxation method

Auteurs: Manolas I. and Laccone F. and Cherchi G. and Malomo L. and Cignoni P.
Publié dans: Smart Tools and Applications in Graphics - Eurographics Italian Chapter Conference, Cagliari, Italy, 17-18/11/2022, 2022
Éditeur: Eurographics Association, Eindhoven, NLD
DOI: 10.2312/stag.20221250

Exploratory study on a segmented shell made of recycled-HDPE plastic.

Auteurs: Laccone, Francesco and Manolas, Iason and Malomo, Luigi and Cignoni, Paolo
Publié dans: International Conference on Spatial Structures, 2022
Éditeur: Spatial Structures Research Centre of the University of Surrey

SliceNet: Deep Dense Depth Estimation From a Single Indoor Panorama Using a Slice-Based Representation

Auteurs: Giovanni Pintore, Marco Agus, Eva Almansa, Jens Schneider, Enrico Gobbetti
Publié dans: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021, Page(s) 11536-11545
Éditeur: Computer Vision Foundation

3D battlespace visualization and defense applications on commercial and use-case-dedicated light field displays

Auteurs: Peter A. Kara and Tibor Balogh and Mary Guindy and Aniko Simon
Publié dans: Big Data IV: Learning, Analytics, and Applications, 2022, Page(s) 183 -- 191
Éditeur: SPIE
DOI: 10.1117/12.2618979

Ebb & Flow: Uncovering Costantino Nivola's Olivetti Sandcast through 3D Fabricationand Virtual Exploration

Auteurs: Moonisa Ahsan, Giuliana Altea, Fabio Bettio, Marco Callieri, Antonella Camarda, Paolo Cignoni, Enrico Gobbetti, Paolo Ledda, Alessandro Lutzu, Fabio Marton, Giuseppe Mignemi, and Federico Ponchio
Publié dans: The 20th Eurographics Workshop on Graphics and Cultural Heritage, 2022, Page(s) 85-94
Éditeur: Eurographics Association
DOI: 10.2312/gch.20221230

Multi-Display Ray Tracing Framework

Auteurs: Romero Calla, Luciano Arnaldo and Mohanto, Bipul and Pajarola, Renato and Staadt, Oliver
Publié dans: 2023, ISBN 978-3-03868-211-0
Éditeur: The Eurographics Association
DOI: 10.2312/egp.20231025

Nor-Vdpnet: A No-Reference High Dynamic Range Quality Metric Trained On Hdr-Vdp 2

Auteurs: Francesco Banterle; Alessandro Artusi; Alejandro Moreo; Fabio Carrara
Publié dans: 2020 IEEE International Conference on Image Processing (ICIP), 2020, Page(s) 126-130, ISBN 978-1-7281-6396-3
Éditeur: IEEE
DOI: 10.1109/icip40778.2020.9191202

Thresholds of perceptual fatigue based on 3D object motion vectors and relative object size in virtual reality

Auteurs: Fanni A. Geyer, Vince A. Szakal, Peter A. Kara, Aniko Simon, and Mary Guindy
Publié dans: Virtual, Augmented, and Mixed Reality (XR) Technology for Multi-Domain Operations III, 2022, Page(s) 121250I
Éditeur: SPIE
DOI: 10.1117/12.2625118

Book chapters (1)

AtlantaNet: Inferring the 3D Indoor Layout from a Single $$360^\circ $$ Image Beyond the Manhattan World Assumption

Auteurs: Giovanni Pintore, Marco Agus, Enrico Gobbetti
Publié dans: Computer Vision – ECCV 2020 - 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part VIII, Numéro 12353, 2020, Page(s) 432-448, ISBN 978-3-030-58597-6
Éditeur: Springer International Publishing
DOI: 10.1007/978-3-030-58598-3_26

Peer reviewed articles (21)

Inducing robustness and plausibility in deep learning optical 3D printer models

Auteurs: Danwu Chen and Philipp Urban
Publié dans: Optics Express, Numéro 11, 2022, Page(s) 18119--18133, ISSN 1094-4087
Éditeur: Optical Society of America
DOI: 10.1364/oe.455115

Beyond perceptual thresholds and personal preference : towards novel research questions and methodologies of quality of experience studies on light field visualization

Auteurs: Kara, Peter A., Tamboli, Roopak R., Shafiee, Edris, Martini, Maria G., Simon, Aniko and Guindy, Mary
Publié dans: Electronics, Numéro 11/6, 2022, Page(s) 953, ISSN 2079-9292
Éditeur: MDPI AG
DOI: 10.3390/electronics11060953

Automated Generation of Flat Tileable Patterns and 3d Reduced Model Simulation

Auteurs: Iason Manolas; Francesco Laccone; Gianmarco Cherchi; Luigi Malomo; Paolo Cignoni
Publié dans: Computers & graphics, Numéro 8, 2022, Page(s) 141 - 151, ISSN 0097-8493
Éditeur: Pergamon Press Ltd.
DOI: 10.2139/ssrn.4095672

Volume-aware design of composite molds

Auteurs: Thomas Alderighi, Luigi Malomo, Daniela Giorgi, Bernd Bickel, Paolo Cignoni, Nico Pietroni
Publié dans: ACM Transactions on Graphics, Numéro 38/4, 2019, Page(s) 1-12, ISSN 0730-0301
Éditeur: Association for Computing Machinary, Inc.
DOI: 10.1145/3306346.3322981

Audio-visual annotation graphs for guiding lens-based scene exploration

Auteurs: Moonisa Ahsan, Fabio Marton, Ruggero Pintus, Enrico Gobbetti
Publié dans: Computers & Graphics, 2022, ISSN 0097-8493
Éditeur: Pergamon Press Ltd.
DOI: 10.1016/j.cag.2022.05.003

Multi-printer learning framework for efficient optical printer characterization

Auteurs: Danwu Chen and Philipp Urban
Publié dans: Optics Express, Numéro 31/8, 2023, Page(s) 13486-13502, ISSN 1094-4087
Éditeur: Optical Society of America
DOI: 10.1364/oe.487526

A Novel Approach for Exploring Annotated Data With Interactive Lenses

Auteurs: Bettio, Fabio and Ahsan, Moonisa and Marton, Fabio and Gobbetti, Enrico
Publié dans: Computer Graphics Forum, Numéro 40/3, 2021, Page(s) 387-398, ISSN 1467-8659
Éditeur: The Eurographics Association and John Wiley & Sons Ltd.
DOI: 10.1111/cgf.14315

Web-based Exploration of Annotated Multi-Layered Relightable Image Models

Auteurs: Alberto Jaspe-Villanueva, Moonisa Ahsan, Ruggero Pintus, Andrea Giachetti, Fabio Marton, Enrico Gobbetti
Publié dans: Journal on Computing and Cultural Heritage, Numéro 14/2, 2021, Page(s) 1-29, ISSN 1556-4673
Éditeur: Association for Computing Machinary, Inc.
DOI: 10.1145/3430846

Deep learning models for optically characterizing 3D printers

Auteurs: Danwu Chen and Philipp Urban
Publié dans: Optics Express, Numéro 29/2, 2021, Page(s) 615-631, ISSN 1094-4087
Éditeur: Optical Society of America
DOI: 10.1364/oe.410796

INDOOR MOBILE MAPPING SYSTEMS AND (BIM) DIGITAL MODELS FOR CONSTRUCTION PROGRESS MONITORING

Auteurs: Sgrenzaroli, M. and Ortiz Barrientos, J. and Vassena, G. and Sanchez, A. and Ciribini, A. and Mastrolembo Ventura, S. and Comai, S.
Publié dans: The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Numéro XLIII-B1-2022, 2022, Page(s) 121--127, ISSN 0924-2716
Éditeur: Elsevier BV
DOI: 10.5194/isprs-archives-xliii-b1-2022-121-2022

Instant Automatic Emptying of Panoramic Indoor Scenes

Auteurs: Giovanni Pintore, Marco Agus, Eva Almansa, and Enrico Gobbetti
Publié dans: IEEE Transactions on Visualization and Computer Graphics, Numéro 28(1), 2022, Page(s) 3629-3639, ISSN 1941-0506
Éditeur: IEEE
DOI: 10.1109/tvcg.2022.3202999

Walk2Map: Extracting Floor Plans from Indoor Walk Trajectories

Auteurs: Mura, Claudio; Pajarola, R; Schindler, Konrad; Niloy, Mitra
Publié dans: Computer Graphics Forum, Numéro Volume 40, Numéro 2, 2021, Page(s) 375-388, ISSN 0167-7055
Éditeur: Blackwell Publishing Inc.
DOI: 10.1111/cgf.142640

State‐of‐the‐art in Automatic 3D Reconstruction of Structured Indoor Environments

Auteurs: Giovanni Pintore, Claudio Mura, Fabio Ganovelli, Lizeth Fuentes‐Perez, Renato Pajarola, Enrico Gobbetti
Publié dans: Computer Graphics Forum, Numéro 39/2, 2020, Page(s) 667-699, ISSN 0167-7055
Éditeur: Blackwell Publishing Inc.
DOI: 10.1111/cgf.14021

An integrative view of foveated rendering

Auteurs: Mohanto, Bipul; Islam, ABM Tariqul; Gobbetti, Enrico; Staadt, Oliver
Publié dans: Computers & Graphics, Numéro 3, 2021, ISSN 0097-8493
Éditeur: Pergamon Press Ltd.
DOI: 10.1016/j.cag.2021.10.010

A bending-active twisted-arch plywood structure: computational design and fabrication of the FlexMaps Pavilion

Auteurs: Francesco Laccone, Luigi Malomo, Jesús Pérez, Nico Pietroni, Federico Ponchio, Bernd Bickel, Paolo Cignoni
Publié dans: SN Applied Sciences, Numéro 2/9, 2020, Page(s) 1505, ISSN 2523-3963
Éditeur: Springer
DOI: 10.1007/s42452-020-03305-w

Training and Predicting Visual Error for Real-Time Applications

Auteurs: Cardoso, Joao Liborio and Kerbl, Bernhard and Yang, Lei and Uralsky, Yury and Wimmer, Michael
Publié dans: Proceedings of the ACM on Computer Graphics and Interactive Techniques, Numéro 5(1), 2022, Page(s) 1-17, ISSN 2577-6193
Éditeur: ACM
DOI: 10.1145/3522625

Deep3DLayout: 3D Reconstruction of an Indoor Layout from a Spherical Panoramic Image

Auteurs: Pintore, Giovanni and Almansa, Eva and Agus, Marco and Gobbetti, Enrico
Publié dans: ACM Transactions on Graphics, Numéro 40/6, 2021, Page(s) 250:1-12, ISSN 0730-0301
Éditeur: Association for Computing Machinary, Inc.
DOI: 10.1145/3478513.3480480

Camera Animation for Immersive Light Field Imaging

Auteurs: Guindy, Mary, Attila Barsi, Peter A. Kara, Vamsi K. Adhikarla, Tibor Balogh, and Aniko Simon
Publié dans: Electronics, Numéro 20799292, 2022, ISSN 2079-9292
Éditeur: MDPI
DOI: 10.3390/electronics11172689

Optimizing Object Decomposition to Reduce Visual Artifacts in 3D Printing

Auteurs: I. Filoscia, T. Alderighi, D. Giorgi, L. Malomo, M. Callieri, P. Cignoni
Publié dans: Computer Graphics Forum, Numéro 39/2, 2020, Page(s) 423-434, ISSN 0167-7055
Éditeur: Blackwell Publishing Inc.
DOI: 10.1111/cgf.13941

Exploiting Local Shape and MaterialSimilarity for Effective SV-BRDF Reconstruction from Sparse Multi-LightImage Collections

Auteurs: Ruggero Pintus, Moonisa Ahsan, Antonio Zorcolo, Fabio Bettio, Fabio Marton, and Enrico Gobbetti
Publié dans: ACM Journal on Computing and Cultural Heritage, Numéro 16(2), 2023, ISSN 1556-4673
Éditeur: Association for Computing Machinary, Inc.
DOI: 10.1145/3593428

Quantifying the Error of Light Transport Algorithms

Auteurs: A. Celarek, W. Jakob, M. Wimmer, J. Lehtinen
Publié dans: Computer Graphics Forum, Numéro 38/4, 2019, Page(s) 111-121, ISSN 0167-7055
Éditeur: Blackwell Publishing Inc.
DOI: 10.1111/cgf.13775

Thesis and dissertations (1)

Scalable Exploration of Complex Objects and Environments Beyond Plain Visual Replication

Auteurs: Moonisa Ahsan
Publié dans: 2023
Éditeur: University of Cagliari