Learning Generative 3D Scene Models for Training and Validating Intelligent Systems

Informacje na temat projektu

LEGO-3D

Identyfikator umowy o grant: 850533

DOI

10.3030/850533

Data podpisania przez KE 22 Października 2019

Data rozpoczęcia 1 Października 2020

Data zakończenia 31 Marca 2026

Finansowanie w ramach

• EXCELLENT SCIENCE - European Research Council (ERC)

Koszt całkowity

€ 1 467 500,00

Wkład UE

€ 1 467 500,00

Koordynowany przez

EBERHARD KARLS UNIVERSITAET TUEBINGEN
Germany

CORDIS oferuje możliwość skorzystania z odnośników do publicznie dostępnych publikacji i rezultatów projektów realizowanych w ramach programów ramowych HORYZONT.

Odnośniki do rezultatów i publikacji związanych z poszczególnymi projektami 7PR, a także odnośniki do niektórych konkretnych kategorii wyników, takich jak zbiory danych i oprogramowanie, są dynamicznie pobierane z systemu OpenAIRE .

Publikacje

Conference proceedings (27)

ARAH: Animatable Volume Rendering of Articulated Human SDFs

Autorzy: S. Wang, K. Schwarz, A. Geiger, S. Tang
Opublikowane w: European Conference on Computer Vision (ECCV), 2022
Wydawca: Springer

KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs

Autorzy: C. Reiser, S. Peng, Y. Liao, A. Geiger
Opublikowane w: International Conference on Computer Vision (ICCV), 2021
Wydawca: IEEE/CVF

AG3D: Learning to Generate 3D Avatars from 2D Image Collections

Autorzy: Zijian Dong, Xu Chen, Jinlong Yang, Michael J. Black, Otmar Hilliges, Andreas Geiger
Opublikowane w: 2023 IEEE/CVF International Conference on Computer Vision (ICCV), 2024, Strona(/y) 14870-14881
Wydawca: IEEE
DOI: 10.1109/iccv51070.2023.01370

SMD-Nets: Stereo Mixture Density Networks

Autorzy: F. Tosi, Y. Liao, C. Schmitt, A. Geiger
Opublikowane w: Conference on Computer Vision and Pattern Recognition (CVPR), 2021
Wydawca: IEEE/CV

Hidden Biases of End-to-End Driving Models

Autorzy: Bernhard Jaeger, Kashyap Chitta, Andreas Geiger
Opublikowane w: 2023 IEEE/CVF International Conference on Computer Vision (ICCV), 2024, Strona(/y) 8206-8215
Wydawca: IEEE
DOI: 10.1109/iccv51070.2023.00757

UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstruction

Autorzy: Oechsle, Michael; Peng, Songyou; Geiger, Andreas
Opublikowane w: International Conference on Computer Vision (ICCV), 2021
Wydawca: IEEE/CVF
DOI: 10.1109/iccv48922.2021.00554

Shape As Points: A Differentiable Poisson Solver

Autorzy: "Peng, Songyou; Jiang, Chiyu ""Max""; Liao, Yiyi; Niemeyer, Michael; Pollefeys, Marc; Geiger, Andreas"
Opublikowane w: Advances in Neural Information Processing Systems (NeurIPS), 2021
Wydawca: Curran Associates, Inc.
DOI: 10.48550/arxiv.2106.03452

IntrinsicAvatar: Physically Based Inverse Rendering of Dynamic Humans from Monocular Videos via Explicit Ray Tracing

Autorzy: Shaofei Wang, Božidar Antić, Andreas Geiger, Siyu Tang
Opublikowane w: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024, Strona(/y) 1877-1888
Wydawca: IEEE
DOI: 10.1109/cvpr52733.2024.00184

MuRF: Multi-Baseline Radiance Fields

Autorzy: Haofei XU, Anpei Chen, Yuedong Chen, Christos Sakaridis, Yulun Zhang, Marc Pollefeys, Andreas Geiger, Fisher Yu
Opublikowane w: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024, Strona(/y) 20041-20050
Wydawca: IEEE
DOI: 10.1109/cvpr52733.2024.01894

GOOD: Exploring geometric cues for detecting objects in an open world

Autorzy: H. Huang, A. Geiger, D. Zhang
Opublikowane w: International Conference on Learning Representations (ICLR), 2023
Wydawca: OpenReview

Mip-Splatting: Alias-Free 3D Gaussian Splatting

Autorzy: Zehao Yu, Anpei Chen, Binbin Huang, Torsten Sattler, Andreas Geiger
Opublikowane w: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024, Strona(/y) 19447-19456
Wydawca: IEEE
DOI: 10.1109/cvpr52733.2024.01839

2D Gaussian Splatting for Geometrically Accurate Radiance Fields

Autorzy: Binbin Huang, Zehao Yu, Anpei Chen, Andreas Geiger, Shenghua Gao
Opublikowane w: Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers '24, 2024, Strona(/y) 1-11
Wydawca: ACM
DOI: 10.1145/3641519.3657428

GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fields

Autorzy: Geiger, Andreas; Niemeyer, Michael
Opublikowane w: Conference on Computer Vision and Pattern Recognition (CVPR), 2021
Wydawca: IEEE/CVF
DOI: 10.48550/arxiv.2011.12100

Multi-Modal Fusion Transformer for End-to-End Autonomous Driving

Autorzy: Aditya Prakash, Kashyap Chitta, Andreas Geiger
Opublikowane w: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023, Strona(/y) 7073-7083
Wydawca: IEEE
DOI: 10.1109/cvpr46437.2021.00700

NeLF-Pro: Neural Light Field Probes for Multi-Scale Novel View Synthesis

Autorzy: Zinuo You, Andreas Geiger, Anpei Chen
Opublikowane w: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024, Strona(/y) 19833-19843
Wydawca: IEEE
DOI: 10.1109/cvpr52733.2024.01875

Projected GANs Converge Faster

Autorzy: A. Sauer, K. Chitta, J. Müller, A. Geiger
Opublikowane w: Advances in Neural Information Processing Systems (NeurIPS), 2021
Wydawca: Curran Associates, Inc.
DOI: 10.48550/arxiv.2111.01007

StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasets

Autorzy: A. Sauer, K. Schwarz, A. Geiger
Opublikowane w: International Conference on Computer Graphics and Interactive Techniques (SIGGRAPH), 2022
Wydawca: Association for Computing Machinery
DOI: 10.48550/arxiv.2202.00273

MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Images

Autorzy: S. Wang, M. Mihajlovic, Q. Ma, A. Geiger, S. Tang
Opublikowane w: Advances in Neural Information Processing Systems (NeurIPS), 2021
Wydawca: Curran Associates, Inc.

GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformers

Autorzy: Takeru Miyato, Bernhard Jaeger, Max Welling, Andreas Geiger
Opublikowane w: International Conference on Learning Representations (ICLR), 2024
Wydawca: OpenReview.net
DOI: 10.48550/arxiv.2310.10375

VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Grids

Autorzy: K. Schwarz, A. Sauer, M. Niemeyer, Y. Liao, A. Geiger
Opublikowane w: Advances in Neural Information Processing Systems (NeurIPS), 2022
Wydawca: Curran Associates, Inc.

Parting with Misconceptions about Learning-based Vehicle Motion Planning

Autorzy: Dauner, Daniel; Hallgarten, Marcel; Geiger, Andreas; Chitta, Kashyap
Opublikowane w: Conference on Robot Learning, 2023
Wydawca: Proceedings of Machine Learning Research
DOI: 10.48550/arxiv.2306.07962

Counterfactual Generative Networks

Autorzy: Sauer, Axel; Geiger, Andreas
Opublikowane w: International Conference on Learning Representations (ICLR), 2021
Wydawca: OpenReview
DOI: 10.48550/arxiv.2101.06046

3DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splatting

Autorzy: Zhiyin Qian, Shaofei Wang, Marko Mihajlovic, Andreas Geiger, Siyu Tang
Opublikowane w: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024, Strona(/y) 5020-5030
Wydawca: IEEE
DOI: 10.1109/cvpr52733.2024.00480

CAMPARI: Camera-Aware Decomposed Generative Neural Radiance Fields

Autorzy: Michael Niemeyer; Andreas Geiger
Opublikowane w: International Conference on 3D Vision (3DV), 2021
Wydawca: IEEE Computer Society
DOI: 10.1109/3dv53792.2021.00103

HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splatting

Autorzy: Hongyu Zhou, Jiahao Shao, Lu Xu, Dongfeng Bai, Weichao Qiu, Bingbing Liu, Yue Wang, Andreas Geiger, Yiyi Liao
Opublikowane w: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024, Strona(/y) 21336-21345
Wydawca: IEEE
DOI: 10.1109/cvpr52733.2024.02016

GraphDreamer: Compositional 3D Scene Synthesis from Scene Graphs

Autorzy: Gege Gao, Weiyang Liu, Anpei Chen, Andreas Geiger, Bernhard Schölkopf
Opublikowane w: 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024, Strona(/y) 21295-21304
Wydawca: IEEE
DOI: 10.1109/cvpr52733.2024.02012

MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstruction

Autorzy: Z. Yu, S. Peng, M. Niemeyer, T. Sattler, A. Geiger
Opublikowane w: Advances in Neural Information Processing Systems (NeurIPS), 2022
Wydawca: Curran Associates, Inc.

Peer reviewed articles (8)

KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3D

Autorzy: Liao, Yiyi; Xie, Jun; Geiger, Andreas
Opublikowane w: IEEE Transactions on Pattern Analysis and Machine Intelligence, Numer 1, 2022, ISSN 1939-3539
Wydawca: IEEE Computer Society
DOI: 10.1109/tpami.2022.3179507

End-to-End Autonomous Driving: Challenges and Frontiers

Autorzy: Li Chen, Penghao Wu, Kashyap Chitta, Bernhard Jaeger, Andreas Geiger, Hongyang Li
Opublikowane w: IEEE Transactions on Pattern Analysis and Machine Intelligence, Numer 46, 2024, Strona(/y) 10164-10183, ISSN 0162-8828
Wydawca: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tpami.2024.3435937

Unifying Flow, Stereo and Depth Estimation

Autorzy: Haofei Xu, Jing Zhang, Jianfei Cai, Hamid Rezatofighi, Fisher Yu, Dacheng Tao, Andreas Geiger
Opublikowane w: IEEE Transactions on Pattern Analysis and Machine Intelligence, Numer 45, 2023, Strona(/y) 13941-13958, ISSN 0162-8828
Wydawca: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tpami.2023.3298645

Binary Opacity Grids: Capturing Fine Geometric Detail for Mesh-Based View Synthesis

Autorzy: Christian Reiser, Stephan Garbin, Pratul Srinivasan, Dor Verbin, Richard Szeliski, Ben Mildenhall, Jonathan Barron, Peter Hedman, Andreas Geiger
Opublikowane w: ACM Transactions on Graphics, Numer 43, 2024, Strona(/y) 1-14, ISSN 0730-0301
Wydawca: Association for Computing Machinary, Inc.
DOI: 10.1145/3658130

MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenes

Autorzy: Christian Reiser, Rick Szeliski, Dor Verbin, Pratul Srinivasan, Ben Mildenhall, Andreas Geiger, Jon Barron, Peter Hedman
Opublikowane w: ACM Transactions on Graphics, Numer 42, 2024, Strona(/y) 1-12, ISSN 0730-0301
Wydawca: Association for Computing Machinary, Inc.
DOI: 10.1145/3592426

TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving

Autorzy: K. Chitta, A. Prakash, B. Jaeger, Z. Yu, K. Renz, A. Geiger
Opublikowane w: IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023, ISSN 0162-8828
Wydawca: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tpami.2022.3200245

Towards Scalable Multi-View Reconstruction of Geometry and Materials

Autorzy: Carolin Schmitt, Božidar Antić, Andrei Neculai, Joo Ho Lee, Andreas Geiger
Opublikowane w: IEEE Transactions on Pattern Analysis and Machine Intelligence, Numer 45, 2024, Strona(/y) 15850-15869, ISSN 0162-8828
Wydawca: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tpami.2023.3314348

Gaussian Opacity Fields: Efficient Adaptive Surface Reconstruction in Unbounded Scenes

Autorzy: Zehao Yu, Torsten Sattler, Andreas Geiger
Opublikowane w: ACM Transactions on Graphics, Numer 43, 2024, Strona(/y) 1-13, ISSN 0730-0301
Wydawca: Association for Computing Machinary, Inc.
DOI: 10.1145/3687937

Book chapters (3)

LaRa: Efficient Large-Baseline Radiance Fields

Autorzy: Anpei Chen, Haofei Xu, Stefano Esposito, Siyu Tang, Andreas Geiger
Opublikowane w: Lecture Notes in Computer Science, Computer Vision – ECCV 2024, 2024, Strona(/y) 338-355
Wydawca: Springer Nature Switzerland
DOI: 10.1007/978-3-031-73247-8_20

Efficient Depth-Guided Urban View Synthesis

Autorzy: Sheng Miao, Jiaxin Huang, Dongfeng Bai, Weichao Qiu, Bingbing Liu, Andreas Geiger, Yiyi Liao
Opublikowane w: Lecture Notes in Computer Science, Computer Vision – ECCV 2024, 2025, Strona(/y) 90-107
Wydawca: Springer Nature Switzerland
DOI: 10.1007/978-3-031-73404-5_6

SLEDGE: Synthesizing Driving Environments with Generative Models and Rule-Based Traffic

Autorzy: Kashyap Chitta, Daniel Dauner, Andreas Geiger
Opublikowane w: Lecture Notes in Computer Science, Computer Vision – ECCV 2024, 2024, Strona(/y) 57-74
Wydawca: Springer Nature Switzerland
DOI: 10.1007/978-3-031-73235-5_4