Scan2CAD: Learning to Digitize the Real World

Project Information

Scan2CAD

Grant agreement ID: 804724

DOI

10.3030/804724

Project closed

EC signature date 31 August 2018

Start date 1 January 2019

End date 31 December 2024

Funded under

• EXCELLENT SCIENCE - European Research Council (ERC)

Total cost

€ 1 500 000,00

EU contribution

€ 1 500 000,00

Coordinated by

TECHNISCHE UNIVERSITAET MUENCHEN
Germany

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Publications

Conference proceedings (27)

Convolutional Neural Networks on non-uniform geometrical signals using Euclidean spectral transformation

Author(s): "Jiang, Chiyu ""Max""; Wang, Dequan; Huang, Jingwei; Marcus, Philip; Nießner, Matthias"
Published in: Issue 2, 2019
Publisher: ICLR

IGNOR: Image-guided Neural Object Rendering

Author(s): Thies, Justus; Zollhöfer, Michael; Theobalt, Christian; Stamminger, Marc; Nießner, Matthias
Published in: Issue 10, 2020
Publisher: ICLR

RetrievalFuse: Neural 3D Scene Reconstruction with a Database

Author(s): Siddiqui, Yawar; Thies, Justus; Ma, Fangchang; Shan, Qi; Nießner, Matthias; Dai, Angela
Published in: Issue 16, 2021
Publisher: ICCV

Modeling 3D Shapes by Reinforcement Learning

Author(s): Lin, Cheng; Fan, Tingxiang; Wang, Wenping; Nießner, Matthias
Published in: Issue 1, 2020
Publisher: ECCV

Neural RGB-D Surface Reconstruction

Author(s): Azinović, Dejan; Martin-Brualla, Ricardo; Goldman, Dan B; Nießner, Matthias; Thies, Justus
Published in: Issue 3, 2022
Publisher: CVPR

Neural Deformation Graphs for Globally-consistent Non-rigid Reconstruction

Author(s): Aljaz Bozic; Pablo Palafox; Michael Zollhöfer; Justus Thies; Angela Dai; Matthias Nießner
Published in: CVPR, Issue 1, 2021
Publisher: CVPR
DOI: 10.1109/cvpr46437.2021.00150

Adversarial Texture Optimization from RGB-D Scans

Author(s): Huang, Jingwei; Thies, Justus; Dai, Angela; Kundu, Abhijit; Jiang, Chiyu Max; Guibas, Leonidas; Nießner, Matthias; Funkhouser, Thomas
Published in: Issue 10, 2020
Publisher: CVPR

RevealNet: Seeing Behind Objects in RGB-D Scans

Author(s): Hou, Ji; Dai, Angela; Nießner, Matthias
Published in: Issue 7, 2020
Publisher: CVPR

Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction

Author(s): Guy Gafni; Justus Thies; Michael Zollhöfer; Matthias Nießner
Published in: CVPR, Issue 3, 2021
Publisher: CVPR
DOI: 10.1109/cvpr46437.2021.00854

FaceForensics++: Learning to Detect Manipulated Facial Images

Author(s): Andreas Rossler, Davide Cozzolino, Luisa Verdoliva, Christian Riess, Justus Thies, Matthias Niessner
Published in: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), 2019, Page(s) 1-11, ISBN 978-1-7281-4803-8
Publisher: IEEE
DOI: 10.1109/iccv.2019.00009

Joint Embedding of 3D Scan and CAD Objects

Author(s): Manuel Dahnert, Angela Dai, Leonidas Guibas, Matthias Niessner
Published in: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), 2019, Page(s) 8748-8757, ISBN 978-1-7281-4803-8
Publisher: IEEE
DOI: 10.1109/iccv.2019.00884

SPSG: Self-Supervised Photometric Scene Generation from RGB-D Scans

Author(s): Angela Dai; Yawar Siddiqui; Justus Thies; Julien Valentin; Matthias Nießner
Published in: CVPR, Issue 6, 2020
Publisher: CVPR
DOI: 10.1109/cvpr46437.2021.00179

3D-SIS: 3D Semantic Instance Segmentation of RGB-D Scans

Author(s): Ji Hou; Angela Dai; Matthias NieBner
Published in: CVPR, Issue 6, 2019
Publisher: CVPR
DOI: 10.1109/cvpr.2019.00455

Spherical CNNs on Unstructured Grids

Author(s): "Jiang, Chiyu ""Max""; Huang, Jingwei; Kashinath, Karthik; Prabhat; Marcus, Philip; Niessner, Matthias"
Published in: Issue 2, 2019
Publisher: ICLR

RIO: 3D Object Instance Re-Localization in Changing Indoor Environments

Author(s): Johanna Wald, Armen Avetisyan, Nassir Navab, Federico Tombari, Matthias Niessner
Published in: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), 2019, Page(s) 7657-7666, ISBN 978-1-7281-4803-8
Publisher: IEEE
DOI: 10.1109/iccv.2019.00775

SG-NN: Sparse Generative Neural Networks for Self-Supervised Scene Completion of RGB-D Scans

Author(s): Dai, Angela; Diller, Christian; Nießner, Matthias
Published in: Issue 2, 2020
Publisher: CVPR

DeepVoxels: Learning Persistent 3D Feature Embeddings

Author(s): Vincent Sitzmann, Justus Thies, Felix Heide, Matthias NieBner, Gordon Wetzstein, Michael Zollhofer
Published in: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, Page(s) 2432-2441, ISBN 978-1-7281-3293-8
Publisher: IEEE
DOI: 10.1109/cvpr.2019.00254

ScanRefer: 3D Object Localization in RGB-D Scans using Natural Language

Author(s): Chen, Dave Zhenyu; Chang, Angel X.; Nießner, Matthias
Published in: Issue 2, 2020
Publisher: ECCV

3D-SIS: 3D Semantic Instance Segmentation of RGB-D Scans

Author(s): Hou, Ji; Dai, Angela; Nießner, Matthias
Published in: Issue 6, 2019
Publisher: CVPR

SceneCAD: Predicting Object Alignments and Layouts in RGB-D Scans

Author(s): Avetisyan, Armen; Khanova, Tatiana; Choy, Christopher; Dash, Denver; Dai, Angela; Nießner, Matthias
Published in: Issue 2, 2020
Publisher: ECCV

End-to-End CAD Model Retrieval and 9DoF Alignment in 3D Scans

Author(s): Avetisyan, Armen; Dai, Angela; Nießner, Matthias
Published in: Issue 8, 2019
Publisher: ICCV

DeepDeform: Learning Non-rigid RGB-D Reconstruction with Semi-supervised Data

Author(s): Božič, Aljaž; Zollhöfer, Michael; Theobalt, Christian; Nießner, Matthias
Published in: Issue 1, 2020
Publisher: CVPR

Scan2CAD: Learning CAD Model Alignment in RGB-D Scans

Author(s): Avetisyan, Armen; Dahnert, Manuel; Dai, Angela; Savva, Manolis; Chang, Angel X.; Nießner, Matthias
Published in: Issue 9, 2019
Publisher: CVPR

Local Implicit Grid Representations for 3D Scenes

Author(s): Jiang, Chiyu Max; Sud, Avneesh; Makadia, Ameesh; Huang, Jingwei; Nießner, Matthias; Funkhouser, Thomas
Published in: Issue 2, 2020
Publisher: CVPR

3D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentation

Author(s): Engelmann, Francis; Bokeloh, Martin; Fathi, Alireza; Leibe, Bastian; Nießner, Matthias
Published in: Issue 6, 2020
Publisher: CVPR

ScanRefer: 3D Object Localization in RGB-D Scans using Natural Language

Author(s): Dave Zhenyu Chen; Angel X. Chang; Matthias Nießner
Published in: ECCV (20), Issue 4, 2020
Publisher: ECCV
DOI: 10.1007/978-3-030-58565-5_13

RevealNet: Seeing Behind Objects in RGB-D Scans

Author(s): Ji Hou; Angela Dai; Matthias NieBner
Published in: CVPR, Issue 1, 2020
Publisher: CVPR
DOI: 10.1109/cvpr42600.2020.00217

Book chapters (1)

SceneCAD: Predicting Object Alignments and Layouts in RGB-D Scans

Author(s): Armen Avetisyan; Tatiana Khanova; Christopher Choy; Denver Dash; Angela Dai; Matthias Nießner
Published in: Computer Vision – ECCV 2020 ISBN: 9783030585419, Issue 4, 2020
Publisher: ECCV
DOI: 10.1007/978-3-030-58542-6_36

Peer reviewed articles (1)

Deferred neural rendering

Author(s): Justus Thies, Michael Zollhöfer, Matthias Nießner
Published in: ACM Transactions on Graphics, Issue 38/4, 2019, Page(s) 1-12, ISSN 0730-0301
Publisher: Association for Computing Machinary, Inc.
DOI: 10.1145/3306346.3323035