Deep Learning for Dynamic 3D Visual Scene Understanding

Informazioni relative al progetto

DeeViSe

ID dell’accordo di sovvenzione: 773161

DOI

10.3030/773161

Progetto chiuso

Data della firma CE 19 Marzo 2018

Data di avvio 1 Aprile 2018

Data di completamento 31 Marzo 2023

Finanziato da

• EXCELLENT SCIENCE - European Research Council (ERC)

Costo totale

€ 2 000 000,00

Contributo UE

€ 2 000 000,00

Coordinato da

RHEINISCH-WESTFAELISCHE TECHNISCHE HOCHSCHULE AACHEN
Germany

CORDIS fornisce collegamenti ai risultati finali pubblici e alle pubblicazioni dei progetti ORIZZONTE.

I link ai risultati e alle pubblicazioni dei progetti del 7° PQ, così come i link ad alcuni tipi di risultati specifici come dataset e software, sono recuperati dinamicamente da .OpenAIRE .

Pubblicazioni

Peer reviewed articles (3)

Track to Reconstruct and Reconstruct to Track

Autori: Jonathon Luiten, Tobias Fischer, Bastian Leibe
Pubblicato in: IEEE Robotics and Automation Letters, Numero 5/2, 2020, Pagina/e 1803-1810, ISSN 2377-3766
Editore: IEEE
DOI: 10.1109/lra.2020.2969183

MeTRAbs: Metric-Scale Truncation-Robust Heatmaps for Absolute 3D Human Pose Estimation

Autori: Istvan Sarandi, Timm Linder, Kai Oliver Arras, Bastian Leibe
Pubblicato in: IEEE Transactions on Biometrics, Behavior, and Identity Science, Numero 3/1, 2021, Pagina/e 16-30, ISSN 2637-6407
Editore: IEEE
DOI: 10.1109/tbiom.2020.3037257

HOTA: A Higher Order Metric for Evaluating Multi-object Tracking

Autori: Jonathon Luiten, Aljos̆a Os̆ep, Patrick Dendorfer, Philip Torr, Andreas Geiger, Laura Leal-Taixé, Bastian Leibe
Pubblicato in: International Journal of Computer Vision, Numero 129/2, 2021, Pagina/e 548-578, ISSN 0920-5691
Editore: Kluwer Academic Publishers
DOI: 10.1007/s11263-020-01375-2

Conference proceedings (39)

From Points to Multi-Object 3D Reconstruction

Autori: Francis Engelmann, Konstantinos Rematas, Bastian Leibe, Vittorio Ferrari
Pubblicato in: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021, ISBN 978-1-6654-4509-2
Editore: IEEE
DOI: 10.1109/cvpr46437.2021.00456

Mask3D: Mask Transformer for 3D Semantic Instance Segmentation

Autori: Jonas Schult, Francis Engelmann, Alexander Hermans, Or Litany, Siyu Tang, Bastian Leibe
Pubblicato in: 2023 IEEE International Conference on Robotics and Automation (ICRA), 2023
Editore: IEEE
DOI: 10.1109/icra48891.2023.10160590

UnOVOST: Unsupervised Offline Video Object Segmentation and Tracking

Autori: Jonathon Luiten, Idil Esen Zulfikar, Bastian Leibe
Pubblicato in: 2020 IEEE Winter Conference on Applications of Computer Vision (WACV), 2020, Pagina/e 1989-1998, ISBN 978-1-7281-6553-0
Editore: IEEE
DOI: 10.1109/wacv45572.2020.9093285

TarViS: A Unified Approach for Target-based Video Segmentation

Autori: Ali Athar, Alexander Hermans, Jonathon Luiten, Deva Ramanan, Bastian Leibe
Pubblicato in: 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023
Editore: IEEE
DOI: 10.48550/arxiv.2301.02657

3D Segmentation of Humans in Point Clouds with Synthetic Data

Autori: Ayça Takmaz, Jonas Schult, Irem Kaftan, Mertcan Akçay, Bastian Leibe, Robert Sumner, Francis Engelmann, Siyu Tang
Pubblicato in: 2023 IEEE/CVF International Conference on Computer Vision (ICCV), 2023
Editore: IEEE
DOI: 10.48550/arxiv.2212.00786

Differentiable Soft-Masked Attention

Autori: Ali Athar, Jonathon Luiten, Alexander Hermans, Deva Ramanan, Bastian Leibe
Pubblicato in: 2022 CVRP Transformers for Vision Workshop, 2022
Editore: arxiv
DOI: 10.48550/arxiv.2206.00182

Siam R-CNN: Visual Tracking by Re-Detection

Autori: Paul Voigtlaender, Jonathon Luiten, Philip H.S. Torr, Bastian Leibe
Pubblicato in: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, Pagina/e 6577-6587, ISBN 978-1-7281-7168-5
Editore: IEEE
DOI: 10.1109/cvpr42600.2020.00661

DynaMITe: Dynamic Query Bootstrapping for Multi-object Interactive Segmentation Transformer

Autori: Amit Kumar Rana, Sabarinath Mahadevan, Alexander Hermans, Bastian Leibe
Pubblicato in: 2023 IEEE/CVF International Conference on Computer Vision (ICCV), 2023
Editore: IEEE
DOI: 10.48550/arxiv.2304.06668

BURST: A Benchmark for Unifying Object Recognition, Segmentation and Tracking in Video

Autori: Ali Athar, Jonathon Luiten, Paul Voigtlaender, Tarasha Khurana, Achal Dave, Bastian Leibe, Deva Ramanan
Pubblicato in: 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2023
Editore: IEEE
DOI: 10.1109/wacv56688.2023.00172

Making a Case for 3D Convolutions for Object Segmentation in Videos

Autori: Mahadevan, Sabarinath; Athar, Ali; Ošep, Aljoša; Hennen, Sebastian; Leal-Taixé, Laura; Leibe, Bastian
Pubblicato in: British Machine Vision Conference (BMVC), 2020
Editore: BMVA

Reducing the Annotation Effort for Video Object Segmentation Datasets

Autori: Voigtlaender, Paul; Luo, Lishu; Yuan, Chun; Jiang, Yong; Leibe, Bastian
Pubblicato in: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2021, Pagina/e 3060-3069
Editore: IEEE

HODOR: High-level Object Descriptors for Object Re-segmentation in Video Learned from Static Images

Autori: Ali Athar, Jonathon Luiten, Alexander Hermans, Deva Ramanan, Bastian Leibe
Pubblicato in: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, ISBN 978-1-6654-6946-3
Editore: IEEE
DOI: 10.1109/cvpr52688.2022.00303

Dilated Point Convolutions: On the Receptive Field Size of Point Convolutions on 3D Point Clouds

Autori: Francis Engelmann, Theodora Kontogianni, Bastian Leibe
Pubblicato in: 2020 IEEE International Conference on Robotics and Automation (ICRA), 2020, Pagina/e 9463-9469, ISBN 978-1-7281-7395-5
Editore: IEEE
DOI: 10.1109/icra40945.2020.9197503

4D-StOP: Panoptic Segmentation of 4D LiDAR Using Spatio-Temporal Object Proposal Generation and Aggregation

Autori: Lars Kreuzberg, Idil Esen Zülfikar, Sabarinath Mahadevan, Francis Engelmann, Bastian Leibe
Pubblicato in: 2022 ECCV Workshops, 2022
Editore: Springer
DOI: 10.1007/978-3-031-25056-9_34

Reposing Humans by Warping 3D Features

Autori: Markus Knoche, Istvan Sarandi, Bastian Leibe
Pubblicato in: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2020, Pagina/e 4499-4504, ISBN 978-1-7281-9360-1
Editore: IEEE
DOI: 10.1109/cvprw50498.2020.00530

4D Generic Video Object Proposals

Autori: Aljosa Osep, Paul Voigtlaender, Mark Weber, Jonathon Luiten, Bastian Leibe
Pubblicato in: 2020 IEEE International Conference on Robotics and Automation (ICRA), 2020, Pagina/e 10031-10037, ISBN 978-1-7281-7395-5
Editore: IEEE
DOI: 10.1109/icra40945.2020.9196949

DualConvMesh-Net: Joint Geodesic and Euclidean Convolutions on 3D Meshes

Autori: Jonas Schult, Francis Engelmann, Theodora Kontogianni, Bastian Leibe
Pubblicato in: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, Pagina/e 8609-8619, ISBN 978-1-7281-7168-5
Editore: IEEE
DOI: 10.1109/cvpr42600.2020.00864

Learning 3D Human Pose Estimation from Dozens of Datasets using a Geometry-Aware Autoencoder to Bridge Between Skeleton Formats

Autori: Istvan Sarandi, Alexander Hermans, Bastian Leibe
Pubblicato in: 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2023
Editore: IEEE
DOI: 10.1109/wacv56688.2023.00297

MOTS: Multi-Object Tracking and Segmentation

Autori: Paul Voigtlaender, Michael Krause, Aljosa Osep, Jonathon Luiten, Berin Balachandar Gnana Sekar, Andreas Geiger, Bastian Leibe
Pubblicato in: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, Pagina/e 7934-7943, ISBN 978-1-7281-3293-8
Editore: IEEE
DOI: 10.1109/cvpr.2019.00813

Know What Your Neighbors Do: 3D Semantic Segmentation of Point Clouds

Autori: Francis Engelmann, Theodora Kontogianni, Jonas Schult, Bastian Leibe
Pubblicato in: Computer Vision – ECCV 2018 Workshops - Munich, Germany, September 8-14, 2018, Proceedings, Part III, Numero 11131, 2019, Pagina/e 395-409, ISBN 978-3-030-11014-7
Editore: Springer International Publishing
DOI: 10.1007/978-3-030-11015-4_29

Large-Scale Object Mining for Object Discovery from Unlabeled Video

Autori: Aljosa Osep, Paul Voigtlaender, Jonathon Luiten, Stefan Breuers, Bastian Leibe
Pubblicato in: 2019 International Conference on Robotics and Automation (ICRA), 2019, Pagina/e 5502-5508, ISBN 978-1-5386-6027-0
Editore: IEEE
DOI: 10.1109/icra.2019.8793683

PReMVOS: Proposal-Generation, Refinement and Merging for Video Object Segmentation

Autori: Jonathon Luiten, Paul Voigtlaender, Bastian Leibe
Pubblicato in: Computer Vision – ACCV 2018 - 14th Asian Conference on Computer Vision, Perth, Australia, December 2–6, 2018, Revised Selected Papers, Part IV, Numero 11364, 2019, Pagina/e 565-580, ISBN 978-3-030-20869-1
Editore: Springer International Publishing
DOI: 10.1007/978-3-030-20870-7_35

Iteratively Trained Interactive Segmentation

Autori: Mahadevan, Sabarinath; Voigtlaender, Paul; Leibe, Bastian
Pubblicato in: British Machine Vision Conference (BMVC), 2018
Editore: BMVA

Visual Person Understanding Through Multi-task and Multi-dataset Learning

Autori: Kilian Pfeiffer, Alexander Hermans, István Sárándi, Mark Weber, Bastian Leibe
Pubblicato in: Pattern Recognition - 41st DAGM German Conference, DAGM GCPR 2019, Dortmund, Germany, September 10–13, 2019, Proceedings, Numero 11824, 2019, Pagina/e 551-566, ISBN 978-3-030-33675-2
Editore: Springer International Publishing
DOI: 10.1007/978-3-030-33676-9_39

AlignNet-3D: Fast Point Cloud Registration of Partially Observed Objects

Autori: Johannes GroB, Aljosa Osep, Bastian Leibe
Pubblicato in: 2019 International Conference on 3D Vision (3DV), 2019, Pagina/e 623-632, ISBN 978-1-7281-3131-3
Editore: IEEE
DOI: 10.1109/3dv.2019.00074

Towards Large-Scale Video Video Object Mining

Autori: Aljosa Osep, Paul Voigtlaender, Jonathon Luiten, Stefan Breuers, Bastian Leibe
Pubblicato in: ECCV 2018 Workshop on Interactive and Adaptive Learning in an Open World, 2018
Editore: arXiv

Direct Shot Correspondence Matching

Autori: Umer Rafi, Jürgen Gall, Bastian Leibe
Pubblicato in: British Machine Vision Conference (BMVC), 2018
Editore: BMVA

Synthetic Occlusion Augmentation with Volumetric Heatmaps for the 2018 ECCV PoseTrack Challenge on 3D Human Pose Estimation

Autori: Istvan Sarandi, Timm Linder, Kai Arras, Bastian Leibe
Pubblicato in: ECCV 2018 Workshops, 2018
Editore: arXiv

Video Instance Segmentation 2019: A Winning Approach for Combined Detection, Segmentation, Classification and Tracking

Autori: Jonathon Luiten, Philipp Torr, Bastian Leibe
Pubblicato in: The IEEE International Conference on Computer Vision (ICCV) Workshops, 2019
Editore: Computer Vision Foundation

Exploring the Combination of PReMVOS, BoLTVOS and UnOVOST for the 2019 YouTube-VOS Challenge

Autori: Jonathon Luiten, Paul Voigtlaender, Bastian Leibe
Pubblicato in: ICCV Workshops, 2019
Editore: Computer Vision Foundation

Single-Shot Panoptic Segmentation

Autori: Mark Weber, Jonathon Luiten, Bastian Leibe
Pubblicato in: 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2020, Pagina/e 8476-8483, ISBN 978-1-7281-6212-6
Editore: IEEE
DOI: 10.1109/iros45743.2020.9341546

Metric-Scale Truncation-Robust Heatmaps for 3D Human Pose Estimation

Autori: Istvan Sarandi, Timm Linder, Kai O. Arras, Bastian Leibe
Pubblicato in: 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), 2020, Pagina/e 407-414, ISBN 978-1-7281-3079-8
Editore: IEEE
DOI: 10.1109/fg47880.2020.00108

Opening up Open World Tracking

Autori: Yang Liu, Idil Esen Zulfikar, Jonathon Luiten, Achal Dave, Deva Ramanan, Bastian Leibe, Aljosa Osep, Laura Leal-Taixe
Pubblicato in: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, ISBN 978-1-6654-6946-3
Editore: IEEE
DOI: 10.1109/cvpr52688.2022.01846

A Single-Stage, Bottom-up Approach for Occluded VIS using Spatio-temporal Embeddings

Autori: Ali Athar, Sabarinath Mahadevan, Aljosa Osep, Laura Leal-Taixe, Bastian Leibe
Pubblicato in: 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW), 2021, ISBN 978-1-6654-0191-3
Editore: IEEE
DOI: 10.1109/iccvw54120.2021.00431

Mix3D: Out-of-Context Data Augmentation for 3D Scenes

Autori: Alexey Nekrasov, Jonas Schult, Or Litany, Bastian Leibe, Francis Engelmann
Pubblicato in: 2021 International Conference on 3D Vision (3DV), 2021, ISBN 978-1-6654-2688-6
Editore: IEEE
DOI: 10.1109/3dv53792.2021.00022

3D-MPA: Multi-Proposal Aggregation for 3D Semantic Instance Segmentation

Autori: Francis Engelmann, Martin Bokeloh, Alireza Fathi, Bastian Leibe, Matthias NieBner
Pubblicato in: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, Pagina/e 9028-9037, ISBN 978-1-7281-7168-5
Editore: IEEE
DOI: 10.1109/cvpr42600.2020.00905

Global Hierarchical Attention for 3D Point Cloud Analysis

Autori: Dan Jia, Alexander Hermans, Bastian Leibe
Pubblicato in: DAGM German Conference on Pattern Recognition, 2022, ISBN 978-3-031-16787-4
Editore: Springer
DOI: 10.1007/978-3-031-16788-1_17

D2Conv3D: Dynamic Dilated Convolutions for Object Segmentation in Videos

Autori: Christian Schmidt, Ali Athar, Sabarinath Mahadevan, Bastian Leibe
Pubblicato in: 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2022, ISBN 978-1-6654-0915-5
Editore: IEEE
DOI: 10.1109/wacv51458.2022.00199

Point2Vec for Self-Supervised Representation Learning on Point Clouds

Autori: Karim Abou Zeid, Jonas Schult, Alexander Hermans, Bastian Leibe
Pubblicato in: DAGM GCPR 2023, 2023
Editore: Springer
DOI: 10.48550/arxiv.2303.16570

Book chapters (2)

3D Bird’s-Eye-View Instance Segmentation

Autori: Cathrin Elich, Francis Engelmann, Theodora Kontogianni, Bastian Leibe
Pubblicato in: Pattern Recognition - 41st DAGM German Conference, DAGM GCPR 2019, Dortmund, Germany, September 10–13, 2019, Proceedings, Numero 11824, 2019, Pagina/e 48-61, ISBN 978-3-030-33675-2
Editore: Springer International Publishing
DOI: 10.1007/978-3-030-33676-9_4

STEm-Seg: Spatio-Temporal Embeddings for Instance Segmentation in Videos

Autori: Ali Athar, Sabarinath Mahadevan, Aljos̆a Os̆ep, Laura Leal-Taixé, Bastian Leibe
Pubblicato in: Computer Vision – ECCV 2020 - 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XI, Numero 12356, 2020, Pagina/e 158-177, ISBN 978-3-030-58620-1
Editore: Springer International Publishing
DOI: 10.1007/978-3-030-58621-8_10