Learning Generative 3D Scene Models for Training and Validating Intelligent Systems

Información del proyecto

LEGO-3D

Identificador del acuerdo de subvención: 850533

DOI

10.3030/850533

Fecha de la firma de la CE 22 Octubre 2019

Fecha de inicio 1 Octubre 2020

Fecha de finalización 31 Marzo 2026

Financiado con arreglo a

• EXCELLENT SCIENCE - European Research Council (ERC)

Coste total

€ 1 467 500,00

Aportación de la UE

€ 1 467 500,00

Coordinado por

EBERHARD KARLS UNIVERSITAET TUEBINGEN
Germany

CORDIS proporciona enlaces a los documentos públicos y las publicaciones de los proyectos de los programas marco HORIZONTE.

Los enlaces a los documentos y las publicaciones de los proyectos del Séptimo Programa Marco, así como los enlaces a algunos tipos de resultados específicos, como conjuntos de datos y «software», se obtienen dinámicamente de OpenAIRE .

Publicaciones

Conference proceedings (27)

ARAH: Animatable Volume Rendering of Articulated Human SDFs

Autores: S. Wang, K. Schwarz, A. Geiger, S. Tang
Publicado en: European Conference on Computer Vision (ECCV), 2022
Editor: Springer

KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs

Autores: C. Reiser, S. Peng, Y. Liao, A. Geiger
Publicado en: International Conference on Computer Vision (ICCV), 2021
Editor: IEEE/CVF

AG3D: Learning to Generate 3D Avatars from 2D Image Collections

Autores: Zijian Dong, Xu Chen, Jinlong Yang, Michael J. Black, Otmar Hilliges, Andreas Geiger
Publicado en: 2023 IEEE/CVF International Conference on Computer Vision (ICCV), 2024, Página(s) 14870-14881
Editor: IEEE
DOI: 10.1109/iccv51070.2023.01370

SMD-Nets: Stereo Mixture Density Networks

Autores: F. Tosi, Y. Liao, C. Schmitt, A. Geiger
Publicado en: Conference on Computer Vision and Pattern Recognition (CVPR), 2021
Editor: IEEE/CV

Hidden Biases of End-to-End Driving Models

Autores: Bernhard Jaeger, Kashyap Chitta, Andreas Geiger
Publicado en: 2023 IEEE/CVF International Conference on Computer Vision (ICCV), 2024, Página(s) 8206-8215
Editor: IEEE
DOI: 10.1109/iccv51070.2023.00757

UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstruction

Autores: Oechsle, Michael; Peng, Songyou; Geiger, Andreas
Publicado en: International Conference on Computer Vision (ICCV), 2021
Editor: IEEE/CVF
DOI: 10.1109/iccv48922.2021.00554

Shape As Points: A Differentiable Poisson Solver

Autores: "Peng, Songyou; Jiang, Chiyu ""Max""; Liao, Yiyi; Niemeyer, Michael; Pollefeys, Marc; Geiger, Andreas"
Publicado en: Advances in Neural Information Processing Systems (NeurIPS), 2021
Editor: Curran Associates, Inc.
DOI: 10.48550/arxiv.2106.03452

IntrinsicAvatar: Physically Based Inverse Rendering of Dynamic Humans from Monocular Videos via Explicit Ray Tracing

Autores: Shaofei Wang, Božidar Antić, Andreas Geiger, Siyu Tang
Publicado en: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024, Página(s) 1877-1888
Editor: IEEE
DOI: 10.1109/cvpr52733.2024.00184

MuRF: Multi-Baseline Radiance Fields

Autores: Haofei XU, Anpei Chen, Yuedong Chen, Christos Sakaridis, Yulun Zhang, Marc Pollefeys, Andreas Geiger, Fisher Yu
Publicado en: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024, Página(s) 20041-20050
Editor: IEEE
DOI: 10.1109/cvpr52733.2024.01894

GOOD: Exploring geometric cues for detecting objects in an open world

Autores: H. Huang, A. Geiger, D. Zhang
Publicado en: International Conference on Learning Representations (ICLR), 2023
Editor: OpenReview

Mip-Splatting: Alias-Free 3D Gaussian Splatting

Autores: Zehao Yu, Anpei Chen, Binbin Huang, Torsten Sattler, Andreas Geiger
Publicado en: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024, Página(s) 19447-19456
Editor: IEEE
DOI: 10.1109/cvpr52733.2024.01839

2D Gaussian Splatting for Geometrically Accurate Radiance Fields

Autores: Binbin Huang, Zehao Yu, Anpei Chen, Andreas Geiger, Shenghua Gao
Publicado en: Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers '24, 2024, Página(s) 1-11
Editor: ACM
DOI: 10.1145/3641519.3657428

GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fields

Autores: Geiger, Andreas; Niemeyer, Michael
Publicado en: Conference on Computer Vision and Pattern Recognition (CVPR), 2021
Editor: IEEE/CVF
DOI: 10.48550/arxiv.2011.12100

Multi-Modal Fusion Transformer for End-to-End Autonomous Driving

Autores: Aditya Prakash, Kashyap Chitta, Andreas Geiger
Publicado en: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023, Página(s) 7073-7083
Editor: IEEE
DOI: 10.1109/cvpr46437.2021.00700

NeLF-Pro: Neural Light Field Probes for Multi-Scale Novel View Synthesis

Autores: Zinuo You, Andreas Geiger, Anpei Chen
Publicado en: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024, Página(s) 19833-19843
Editor: IEEE
DOI: 10.1109/cvpr52733.2024.01875

Projected GANs Converge Faster

Autores: A. Sauer, K. Chitta, J. Müller, A. Geiger
Publicado en: Advances in Neural Information Processing Systems (NeurIPS), 2021
Editor: Curran Associates, Inc.
DOI: 10.48550/arxiv.2111.01007

StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasets

Autores: A. Sauer, K. Schwarz, A. Geiger
Publicado en: International Conference on Computer Graphics and Interactive Techniques (SIGGRAPH), 2022
Editor: Association for Computing Machinery
DOI: 10.48550/arxiv.2202.00273

MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Images

Autores: S. Wang, M. Mihajlovic, Q. Ma, A. Geiger, S. Tang
Publicado en: Advances in Neural Information Processing Systems (NeurIPS), 2021
Editor: Curran Associates, Inc.

GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformers

Autores: Takeru Miyato, Bernhard Jaeger, Max Welling, Andreas Geiger
Publicado en: International Conference on Learning Representations (ICLR), 2024
Editor: OpenReview.net
DOI: 10.48550/arxiv.2310.10375

VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Grids

Autores: K. Schwarz, A. Sauer, M. Niemeyer, Y. Liao, A. Geiger
Publicado en: Advances in Neural Information Processing Systems (NeurIPS), 2022
Editor: Curran Associates, Inc.

Parting with Misconceptions about Learning-based Vehicle Motion Planning

Autores: Dauner, Daniel; Hallgarten, Marcel; Geiger, Andreas; Chitta, Kashyap
Publicado en: Conference on Robot Learning, 2023
Editor: Proceedings of Machine Learning Research
DOI: 10.48550/arxiv.2306.07962

Counterfactual Generative Networks

Autores: Sauer, Axel; Geiger, Andreas
Publicado en: International Conference on Learning Representations (ICLR), 2021
Editor: OpenReview
DOI: 10.48550/arxiv.2101.06046

3DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splatting

Autores: Zhiyin Qian, Shaofei Wang, Marko Mihajlovic, Andreas Geiger, Siyu Tang
Publicado en: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024, Página(s) 5020-5030
Editor: IEEE
DOI: 10.1109/cvpr52733.2024.00480

CAMPARI: Camera-Aware Decomposed Generative Neural Radiance Fields

Autores: Michael Niemeyer; Andreas Geiger
Publicado en: International Conference on 3D Vision (3DV), 2021
Editor: IEEE Computer Society
DOI: 10.1109/3dv53792.2021.00103

HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splatting

Autores: Hongyu Zhou, Jiahao Shao, Lu Xu, Dongfeng Bai, Weichao Qiu, Bingbing Liu, Yue Wang, Andreas Geiger, Yiyi Liao
Publicado en: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024, Página(s) 21336-21345
Editor: IEEE
DOI: 10.1109/cvpr52733.2024.02016

GraphDreamer: Compositional 3D Scene Synthesis from Scene Graphs

Autores: Gege Gao, Weiyang Liu, Anpei Chen, Andreas Geiger, Bernhard Schölkopf
Publicado en: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024, Página(s) 21295-21304
Editor: IEEE
DOI: 10.1109/cvpr52733.2024.02012

MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstruction

Autores: Z. Yu, S. Peng, M. Niemeyer, T. Sattler, A. Geiger
Publicado en: Advances in Neural Information Processing Systems (NeurIPS), 2022
Editor: Curran Associates, Inc.

Peer reviewed articles (8)

KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3D

Autores: Liao, Yiyi; Xie, Jun; Geiger, Andreas
Publicado en: IEEE Transactions on Pattern Analysis and Machine Intelligence, Edición 1, 2022, ISSN 1939-3539
Editor: IEEE Computer Society
DOI: 10.1109/tpami.2022.3179507

End-to-End Autonomous Driving: Challenges and Frontiers

Autores: Li Chen, Penghao Wu, Kashyap Chitta, Bernhard Jaeger, Andreas Geiger, Hongyang Li
Publicado en: IEEE Transactions on Pattern Analysis and Machine Intelligence, Edición 46, 2024, Página(s) 10164-10183, ISSN 0162-8828
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tpami.2024.3435937

Unifying Flow, Stereo and Depth Estimation

Autores: Haofei Xu, Jing Zhang, Jianfei Cai, Hamid Rezatofighi, Fisher Yu, Dacheng Tao, Andreas Geiger
Publicado en: IEEE Transactions on Pattern Analysis and Machine Intelligence, Edición 45, 2023, Página(s) 13941-13958, ISSN 0162-8828
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tpami.2023.3298645

Binary Opacity Grids: Capturing Fine Geometric Detail for Mesh-Based View Synthesis

Autores: Christian Reiser, Stephan Garbin, Pratul Srinivasan, Dor Verbin, Richard Szeliski, Ben Mildenhall, Jonathan Barron, Peter Hedman, Andreas Geiger
Publicado en: ACM Transactions on Graphics, Edición 43, 2024, Página(s) 1-14, ISSN 0730-0301
Editor: Association for Computing Machinary, Inc.
DOI: 10.1145/3658130

MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenes

Autores: Christian Reiser, Rick Szeliski, Dor Verbin, Pratul Srinivasan, Ben Mildenhall, Andreas Geiger, Jon Barron, Peter Hedman
Publicado en: ACM Transactions on Graphics, Edición 42, 2024, Página(s) 1-12, ISSN 0730-0301
Editor: Association for Computing Machinary, Inc.
DOI: 10.1145/3592426

TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving

Autores: K. Chitta, A. Prakash, B. Jaeger, Z. Yu, K. Renz, A. Geiger
Publicado en: IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023, ISSN 0162-8828
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tpami.2022.3200245

Towards Scalable Multi-View Reconstruction of Geometry and Materials

Autores: Carolin Schmitt, Božidar Antić, Andrei Neculai, Joo Ho Lee, Andreas Geiger
Publicado en: IEEE Transactions on Pattern Analysis and Machine Intelligence, Edición 45, 2024, Página(s) 15850-15869, ISSN 0162-8828
Editor: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tpami.2023.3314348

Gaussian Opacity Fields: Efficient Adaptive Surface Reconstruction in Unbounded Scenes

Autores: Zehao Yu, Torsten Sattler, Andreas Geiger
Publicado en: ACM Transactions on Graphics, Edición 43, 2024, Página(s) 1-13, ISSN 0730-0301
Editor: Association for Computing Machinary, Inc.
DOI: 10.1145/3687937

Book chapters (3)

LaRa: Efficient Large-Baseline Radiance Fields

Autores: Anpei Chen, Haofei Xu, Stefano Esposito, Siyu Tang, Andreas Geiger
Publicado en: Lecture Notes in Computer Science, Computer Vision – ECCV 2024, 2024, Página(s) 338-355
Editor: Springer Nature Switzerland
DOI: 10.1007/978-3-031-73247-8_20

Efficient Depth-Guided Urban View Synthesis

Autores: Sheng Miao, Jiaxin Huang, Dongfeng Bai, Weichao Qiu, Bingbing Liu, Andreas Geiger, Yiyi Liao
Publicado en: Lecture Notes in Computer Science, Computer Vision – ECCV 2024, 2025, Página(s) 90-107
Editor: Springer Nature Switzerland
DOI: 10.1007/978-3-031-73404-5_6

SLEDGE: Synthesizing Driving Environments with Generative Models and Rule-Based Traffic

Autores: Kashyap Chitta, Daniel Dauner, Andreas Geiger
Publicado en: Lecture Notes in Computer Science, Computer Vision – ECCV 2024, 2024, Página(s) 57-74
Editor: Springer Nature Switzerland
DOI: 10.1007/978-3-031-73235-5_4