Scan2CAD: Learning to Digitize the Real World

Project Information

Scan2CAD

Grant agreement ID: 804724

DOI 10.3030/804724

EC signature date 31 August 2018

Start date 1 January 2019

End date 31 December 2024

Funded under

• EXCELLENT SCIENCE - European Research Council (ERC)

Total cost € 1 500 000,00

EU contribution € 1 500 000,00

Coordinated by

TECHNISCHE UNIVERSITAET MUENCHEN
Germany

Publications

Conference proceedings (27)

Convolutional Neural Networks on non-uniform geometrical signals using Euclidean spectral transformation

Author(s): "Jiang, Chiyu ""Max""; Wang, Dequan; Huang, Jingwei; Marcus, Philip; Nießner, Matthias"
Published in: Issue 2, 2019
Publisher: ICLR

IGNOR: Image-guided Neural Object Rendering

Author(s): Thies, Justus; Zollhöfer, Michael; Theobalt, Christian; Stamminger, Marc; Nießner, Matthias
Published in: Issue 10, 2020
Publisher: ICLR

RetrievalFuse: Neural 3D Scene Reconstruction with a Database

Author(s): Siddiqui, Yawar; Thies, Justus; Ma, Fangchang; Shan, Qi; Nießner, Matthias; Dai, Angela
Published in: Issue 16, 2021
Publisher: ICCV

Modeling 3D Shapes by Reinforcement Learning

Author(s): Lin, Cheng; Fan, Tingxiang; Wang, Wenping; Nießner, Matthias
Published in: Issue 1, 2020
Publisher: ECCV

Neural RGB-D Surface Reconstruction

Author(s): Azinović, Dejan; Martin-Brualla, Ricardo; Goldman, Dan B; Nießner, Matthias; Thies, Justus
Published in: Issue 3, 2022
Publisher: CVPR

Neural Deformation Graphs for Globally-consistent Non-rigid Reconstruction

Author(s): Aljaz Bozic; Pablo Palafox; Michael Zollhöfer; Justus Thies; Angela Dai; Matthias Nießner
Published in: CVPR, Issue 1, 2021
Publisher: CVPR
DOI: 10.1109/cvpr46437.2021.00150

Adversarial Texture Optimization from RGB-D Scans

Author(s): Huang, Jingwei; Thies, Justus; Dai, Angela; Kundu, Abhijit; Jiang, Chiyu Max; Guibas, Leonidas; Nießner, Matthias; Funkhouser, Thomas
Published in: Issue 10, 2020
Publisher: CVPR

RevealNet: Seeing Behind Objects in RGB-D Scans

Author(s): Hou, Ji; Dai, Angela; Nießner, Matthias
Published in: Issue 7, 2020
Publisher: CVPR

Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction

Author(s): Guy Gafni; Justus Thies; Michael Zollhöfer; Matthias Nießner
Published in: CVPR, Issue 3, 2021
Publisher: CVPR
DOI: 10.1109/cvpr46437.2021.00854

FaceForensics++: Learning to Detect Manipulated Facial Images

Author(s): Andreas Rossler, Davide Cozzolino, Luisa Verdoliva, Christian Riess, Justus Thies, Matthias Niessner
Published in: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), 2019, Page(s) 1-11, ISBN 978-1-7281-4803-8
Publisher: IEEE
DOI: 10.1109/iccv.2019.00009

Joint Embedding of 3D Scan and CAD Objects

Author(s): Manuel Dahnert, Angela Dai, Leonidas Guibas, Matthias Niessner
Published in: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), 2019, Page(s) 8748-8757, ISBN 978-1-7281-4803-8
Publisher: IEEE
DOI: 10.1109/iccv.2019.00884

SPSG: Self-Supervised Photometric Scene Generation from RGB-D Scans

Author(s): Angela Dai; Yawar Siddiqui; Justus Thies; Julien Valentin; Matthias Nießner
Published in: CVPR, Issue 6, 2020
Publisher: CVPR
DOI: 10.1109/cvpr46437.2021.00179

3D-SIS: 3D Semantic Instance Segmentation of RGB-D Scans

Author(s): Ji Hou; Angela Dai; Matthias NieBner
Published in: CVPR, Issue 6, 2019
Publisher: CVPR
DOI: 10.1109/cvpr.2019.00455

Spherical CNNs on Unstructured Grids

Author(s): "Jiang, Chiyu ""Max""; Huang, Jingwei; Kashinath, Karthik; Prabhat; Marcus, Philip; Niessner, Matthias"
Published in: Issue 2, 2019
Publisher: ICLR

RIO: 3D Object Instance Re-Localization in Changing Indoor Environments

Author(s): Johanna Wald, Armen Avetisyan, Nassir Navab, Federico Tombari, Matthias Niessner
Published in: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), 2019, Page(s) 7657-7666, ISBN 978-1-7281-4803-8
Publisher: IEEE
DOI: 10.1109/iccv.2019.00775

SG-NN: Sparse Generative Neural Networks for Self-Supervised Scene Completion of RGB-D Scans

Author(s): Dai, Angela; Diller, Christian; Nießner, Matthias
Published in: Issue 2, 2020
Publisher: CVPR

DeepVoxels: Learning Persistent 3D Feature Embeddings

Author(s): Vincent Sitzmann, Justus Thies, Felix Heide, Matthias NieBner, Gordon Wetzstein, Michael Zollhofer
Published in: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, Page(s) 2432-2441, ISBN 978-1-7281-3293-8
Publisher: IEEE
DOI: 10.1109/cvpr.2019.00254

ScanRefer: 3D Object Localization in RGB-D Scans using Natural Language

Author(s): Chen, Dave Zhenyu; Chang, Angel X.; Nießner, Matthias
Published in: Issue 2, 2020
Publisher: ECCV

3D-SIS: 3D Semantic Instance Segmentation of RGB-D Scans

Author(s): Hou, Ji; Dai, Angela; Nießner, Matthias
Published in: Issue 6, 2019
Publisher: CVPR

SceneCAD: Predicting Object Alignments and Layouts in RGB-D Scans

Author(s): Avetisyan, Armen; Khanova, Tatiana; Choy, Christopher; Dash, Denver; Dai, Angela; Nießner, Matthias
Published in: Issue 2, 2020
Publisher: ECCV

End-to-End CAD Model Retrieval and 9DoF Alignment in 3D Scans

Author(s): Avetisyan, Armen; Dai, Angela; Nießner, Matthias
Published in: Issue 8, 2019
Publisher: ICCV

DeepDeform: Learning Non-rigid RGB-D Reconstruction with Semi-supervised Data

Author(s): Božič, Aljaž; Zollhöfer, Michael; Theobalt, Christian; Nießner, Matthias
Published in: Issue 1, 2020
Publisher: CVPR

Scan2CAD: Learning CAD Model Alignment in RGB-D Scans

Author(s): Avetisyan, Armen; Dahnert, Manuel; Dai, Angela; Savva, Manolis; Chang, Angel X.; Nießner, Matthias
Published in: Issue 9, 2019
Publisher: CVPR

Local Implicit Grid Representations for 3D Scenes

Author(s): Jiang, Chiyu Max; Sud, Avneesh; Makadia, Ameesh; Huang, Jingwei; Nießner, Matthias; Funkhouser, Thomas
Published in: Issue 2, 2020
Publisher: CVPR

3D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentation

Author(s): Engelmann, Francis; Bokeloh, Martin; Fathi, Alireza; Leibe, Bastian; Nießner, Matthias
Published in: Issue 6, 2020
Publisher: CVPR

ScanRefer: 3D Object Localization in RGB-D Scans using Natural Language

Author(s): Dave Zhenyu Chen; Angel X. Chang; Matthias Nießner
Published in: ECCV (20), Issue 4, 2020
Publisher: ECCV
DOI: 10.1007/978-3-030-58565-5_13

RevealNet: Seeing Behind Objects in RGB-D Scans

Author(s): Ji Hou; Angela Dai; Matthias NieBner
Published in: CVPR, Issue 1, 2020
Publisher: CVPR
DOI: 10.1109/cvpr42600.2020.00217

Book chapters (1)

SceneCAD: Predicting Object Alignments and Layouts in RGB-D Scans

Author(s): Armen Avetisyan; Tatiana Khanova; Christopher Choy; Denver Dash; Angela Dai; Matthias Nießner
Published in: Computer Vision – ECCV 2020 ISBN: 9783030585419, Issue 4, 2020
Publisher: ECCV
DOI: 10.1007/978-3-030-58542-6_36

Peer reviewed articles (1)

Deferred neural rendering

Author(s): Justus Thies, Michael Zollhöfer, Matthias Nießner
Published in: ACM Transactions on Graphics, Issue 38/4, 2019, Page(s) 1-12, ISSN 0730-0301
Publisher: Association for Computing Machinary, Inc.
DOI: 10.1145/3306346.3323035