Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS

Learning to synthesize interactive 3D models

Project description

Automating interactive 3D model synthesis

Creating 3D models requires a significant amount of manual effort, even for trained 3D artists. However, there is a pressing need to automate the production of 3D models that are usable in interactive 3D environments and simulations. The automation of synthesising interactive 3D models is crucial for various applications such as virtual and mixed reality environments, animation pipelines automation, training robots for object interaction, 3D printing of functional objects and digital entertainment. In this context, the ERC-funded NEURi3D project aims to automate the creation of interactive 3D models of objects and characters. This project will develop deep architectures for creating interactive models, learning methods to replace real-world objects with digital representations, and generative models to automatically synthesise interactive 3D objects and characters.

Objective

"Visualizing our surroundings and imagination has been an integral part of human history. In today's era, we have the privilege to immerse in 3D digital environments and interact with virtual objects and characters. However, creating digital representations of environments (i.e. 3D models) often requires excessive amount of manual effort and time even for trained 3D artists. Over the recent years, there have been remarkable advances in deep learning methods that attempt to reconstruct 3D models from real-world data captured in images or scans. However, we are still far from automatically producing 3D models usable in interactive 3D environments and simulations i.e. the resulting reconstructed 3D models lack controllers and metadata related to their articulation structure, possible motions, and interaction with other objects or agents. Automating the synthesis of interactive 3D models is crucial for several applications, such as (a) virtual and mixed reality environments where objects and characters are not static, but instead move and interact with each other, (b) automating animation pipelines, (c) training robots for object interaction in simulated environments, (d) 3D printing of functional objects, (e) digital entertainment. In this project, we will answer the question: ""how can we automate the generation of interactive 3D models of objects and characters?"". Our project will include the following thrusts:
(1) We will design deep architectures that automatically infer motion controllers and interaction-related metadata for input 3D models, effectively making them interactive.
(2) We will develop learning methods that replace dynamic real-world objects and characters captured in scans and video with high-quality, interactive, and animated 3D models as digital representatives.
(3) We will develop generative models that synthesize interactive 3D objects and characters automatically, and further help reconstructing them from scans and video more faithfully."

Fields of science (EuroSciVoc)

Keywords

Programme(s)

Topic(s)

Funding Scheme

HORIZON-ERC - HORIZON ERC Grants

See all projects funded under this funding scheme

Call for proposal

(opens in new window) ERC-2023-COG

See all projects funded under this call

Host institution

POLYTECHNEIO KRITIS
Net EU contribution
€ 2 000 000,00
Address
BUILDING E4, TECHNICAL UNIVERSITY CAMPUS COUNOUPIDIANA
731 00 CHANIA
Greece
Region
Αττική Aττική Κεντρικός Τομέας Αθηνών
Activity type
Higher or Secondary Education Establishments
Links
Total cost
€ 2 000 000,00

Beneficiaries (1)