Periodic Reporting for period 3 - Scan2CAD (Scan2CAD: Learning to Digitize the Real World)
Berichtszeitraum: 2022-01-01 bis 2023-06-30
The use of technology has seen a rapid increase in the past several decades, with more and more of our daily activities relying on digital content. Digitization of real world object would change the way we interact with the world. It would allow us to get a realistic look of our new apartment, let us see what new furniture looks like in our homes before buying it, make digital conferences feel closer to real ones, significantly increase the speed at which we can generate 3D content for movies or video games etc.
The overall objectives of our project are:
- learn how humans model 3D content
- create a photo-realistic replica of the real world
- allow computers to perceive the real world the same way humans do (e.g. object detection or classification)
- the creation of holograms as the step beyond virtual/augmented reality
- Automatic retrieval and alignment of CAD models to real-world objects using a shape database
- Neural 3D scene reconstruction with a database
- 3D Semantic Instance Segmentation of RGB-D Scans
- 3D Mesh creation from unstructured range scans
- Context-aware captioning of RGB-D scans