Advanced Visual and Geometric Computing for 3D Capture, Display, and Fabrication

Project Information

EVOCATION

Grant agreement ID: 813170

DOI

10.3030/813170

Project closed

EC signature date 17 August 2018

Start date 1 October 2018

End date 31 May 2023

Funded under

• EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions

Total cost

€ 3 639 335,04

EU contribution

€ 3 639 335,04

Coordinated by

UNIVERSITAET ROSTOCK
Germany

Periodic Reporting for period 2 - EVOCATION (Advanced Visual and Geometric Computing for 3D Capture, Display, and Fabrication)

Reporting period: 2020-10-01 to 2023-05-31

Summary of the context and overall objectives of the project

3D data is everywhere, from our phones to our cars to our homes. And the market for 3D sensors and displays is booming. The Advanced Visual and Geometric Computing for 3D Capture, Display, and Fabrication (EVOCATION) project is training a new generation of experts to meet the challenges and opportunities of this growing field.

EVOCATION was a European-wide doctoral program that trained researchers in the latest advances in 3D capture, display, and fabrication. The consortium (i) developed new ways to capture 3D data from large collections of objects, even those with complex materials and shapes. (ii) It created interactive visualization tools that allow us to explore and understand large amounts of 3D data. (iii) EVOCATION extended the capabilities of 3D printing technologies to create objects with new and improved properties, and (iv) developed new display systems that provide a more immersive and realistic experience of 3D data.

EVOCATION successfully addressed the following emerging research topics:

1. Innovation in visual and geometric acquisition and processing: How to enable scalable and cost-effective high-fidelity mass-digitization of shape and appearance of large collections of 3D objects with complex materials going beyond the manual acquisition of single objects to the automated multi-modal acquisition of large collections.

2. Innovation in interactive data-intensive visualization: How to explore large amounts of acquired data in an interactive manner, efficiently considering the variable quality and noise of captured data through the integration of statistical methods, to improve understanding and performance.

3. Innovation in computational fabrication: How to extend the reproduction capabilities of current 3D printing technologies and processes by exploring better computational design approaches able to represent and predict visual and physical properties of real-world materials in an accurate and reliable manner.

4. Innovation in display systems: How to improve visual replication and understanding of 3D data and associated information through novel high-bandwidth display environments, including high-density ubiquitous displays, large high-resolution displays (LHDs), light field displays, and multi-display environments.

Work performed from the beginning of the project to the end of the period covered by the report and main results achieved so far

The EVOCATION project, spearheaded by Prof. Dr. Oliver Staadt at the University of Rostock, Germany, embarked on an ambitious journey from October 1st, 2018, to May 31, 2023. This initiative encountered unforeseen hurdles due to the global COVID-19 pandemic and subsequent travel restrictions. Despite these challenges, EVOCATION emerged triumphant, achieving remarkable milestones by successfully delivering all project components while navigating through a landscape reshaped by the pandemic. The project's administrative prowess adapted to the adversity, orchestrating the project kick-off, five workshops, and four summer schools, demonstrating resilience and determination throughout.

Comprising four scientific themes, EVOCATION delved into groundbreaking research:

1. Shape and material capture: Pioneering novel techniques for object and environment digitization, EVOCATION revolutionized the digitization landscape by focusing on two crucial aspects. First, it honed techniques for the scalable digitization of complex objects, catering to a diverse array of material properties. Second, it fine-tuned indoor capture methodologies using mobile devices integrating laser scanning and photography. These advancements significantly bolstered visualization research and facilitated the seamless integration of telepresence applications into various domains.

2. Scalable interactive visualization: EVOCATION endeavored to elevate 3D model depictions across multiple devices, aiming beyond mere visual replication. In doing so, it addressed the complexities of presenting multimodal data with varying noise and accuracy, while also tackling the intricacies of web distribution for models embedded with complex optical properties. Additionally, the project undertook a comprehensive study to refine communication methods for conveying geometric, conceptual, and semantic information associated with 3D models.

3. Optical printer models and automated mold generation: A cornerstone of EVOCATION's innovation was the development of cutting-edge models predicting spectral reflectance and translucency. These models became pivotal in achieving accurate color and translucency prints. Furthermore, the project introduced an automated mold assembly generation system and innovative methods for designing bending-active structures. These breakthroughs significantly expanded the scope of 3D metamaterial concepts, potentially revolutionizing standard casting techniques in medium- to large-scale manufacturing.

4. Display systems: Through pioneering advancements in photorealistic rendering using foveated rendering, EVOCATION catapulted efficiency in rendering pixel-rich displays without compromising visual quality in real-time applications.

EVOCATION celebrated its achievements by showcasing three pioneering pilots: Cultural Heritage Capture and Replication, Indoor Mapping for AEC, and Immersive Tele-Collaboration, documented and accessible through their dedicated YouTube channel.

In total, the project yielded 56 publications across esteemed scientific journals and international conferences. These contributions represent groundbreaking advancements in shape and material capture, visualization techniques, optical printing, and display systems, promising transformative applications across diverse industries while substantially enriching scientific discourse.

Progress beyond the state of the art and expected potential impact (including the socio-economic impact and the wider societal implications of the project so far)

EVOCATION has achieved significant milestones in technology across four key scientific themes. Notably, advancements in shape and material capture introduced novel techniques for digitizing intricate objects and refining indoor capture methods through mobile devices, setting new benchmarks for visualization research and enabling real-time telepresence applications. Enhancements in scalable interactive visualization of complex data aimed to improve 3D model depictions across devices and effectively communicate detailed information. The project's impacts extend beyond technology, encompassing socio-economic implications across industries like manufacturing and cultural preservation. Innovations in material capture, visualization, and printing techniques promise streamlined manufacturing processes, enhanced cultural heritage preservation, and revolutionary collaborative work environments.

Moreover, broader societal implications are evident. EVOCATION's advancements in visualization and communication methods for complex data models have potential applications in education, improving comprehension of intricate information, and fostering accessibility in various sectors. By revolutionizing color printing techniques for accuracy, the project's influence may extend to design and artistic fields reliant on precise color reproduction.

In essence, EVOCATION's groundbreaking research transcends technological frontiers, promising substantial socio-economic growth, cultural preservation, and societal accessibility and understanding in diverse domains by project completion.

Logo