Project description
CAD-quality 3D representation for virtual environments
The automated creation of accurate, high-quality 3D representations of the world is a fundamental challenge for the digital era. Such an achievement would impact entertainment and immersive technologies, medical applications and industrial manufacturing pipelines. However, despite remarkable progress in scanning devices and 3D reconstruction algorithms, the resulting models remain highly impractical for display or use in virtual environments due to their limited quality. The EU-funded Scan2CAD project will address these limitations by shedding light on the design process of artist-created assets and the correlation to real-world observations and replicating the process conditioned on these real-world input scans. Project results will pave the way towards turning 3D scans into CAD-quality 3D assets.
Objective
"One of the most fundamental challenges in the digital age is to automatically create accurate, high-quality 3D representations of the world around us. This would have far-reaching impact, from enabling advances entertainment and immersive technologies (e.g. mixed reality) to medical applications and industrial manufacturing pipelines. Despite remarkable progress in scanning devices and 3D reconstruction algorithms, the resulting models remain highly impractical for display or use in virtual environments. This is due to the limited quality of these reconstructed 3D models, which is still far from the quality of assets designed by professional artists in countless of working hours. We believe that the key to addressing these shortcomings is understanding the design process of artist-created assets. We can then learn the correlation to real-world observations and replicate the process conditioned on these real-world input scans. In this proposal, we will answer the question ""How can we turn 3D scans into CAD-quality 3D assets?"".
"
Fields of science
Keywords
Programme(s)
Topic(s)
Funding Scheme
ERC-STG - Starting GrantHost institution
80333 Muenchen
Germany