SR - the next generation display technology that empowers users to naturally and intuitively work, play and communicate in 3D - without wearables

Información del proyecto

Simulated Reality

Identificador del acuerdo de subvención: 190183722

DOI

10.3030/190183722

Proyecto finalizado el 21 Junio 2024

Fecha de la firma de la CE 7 Abril 2023

Fecha de inicio 1 Enero 2023

Fecha de finalización 31 Diciembre 2024

Financiado con arreglo a

• The European Innovation Council (EIC)

Coste total

€ 3 507 500,00

Aportación de la UE

€ 2 450 000,00

Coordinado por

DIMENCO HOLDING BV
Netherlands

Periodic Reporting for period 2 - Simulated Reality (SR - the next generation display technology that empowers users to naturally and intuitively work, play and communicate in 3D - without wearables)

Período documentado: 2024-01-01 hasta 2024-12-31

Resumen del contexto y de los objetivos generales del proyecto

Dimenco embarked on an ambitious project to develop Simulated Reality (SR) technology, a groundbreaking advancement in spatial computing. SR integrates lenticular light-field displays, computer vision, integrated sensors, and image processing algorithms to create immersive 3D experiences without wearables.

Starting in January 2023, our primary objective was to enable seamless, touchless interaction with digital objects, providing a natural user experience. We successfully developed the MVP version of our technology, demonstrating significant progress within a short timeframe.

A major milestone was our collaboration with Acer, resulting in the first laptop featuring Simulated Reality. This partnership marked a significant validation of our efforts, showcasing our technology's practical application in a consumer product.

We explored various potential applications for SR. In design and engineering, we developed prototypes highlighting the benefits of immersive 3D modeling. In gaming, we created demo versions of games that leveraged SR for a more engaging experience. Additionally, we initiated research into the online conferencing market, aiming to transform virtual meetings with realistic and interactive environments.

Despite the promising advancements, the project was halted in August 2023 when Dimenco lost its SME status, a condition for participating in the EIC Program. However, the knowledge and technological advancements gained have laid a strong foundation.

In conclusion, the EIC Accelerator project enabled Dimenco to achieve significant strides in Simulated Reality technology, reaching key milestones and validating our innovations, especially in the field of OLED displays. The progress made has set the stage for continued growth and exploration in spatial computing.

Trabajo realizado desde el comienzo del proyecto hasta el final del período abarcado por el informe y los principales resultados hasta la fecha

Crosstalk in 3D Displays Individual process steps have been investigated in order to improve the crosstalk. Laser technology was used to precisely adjust the thickness of Indium Tin Oxide patterns, we have tested negative shape lenses and optimized reactive mesogen concentration and process conditions for photoalignment materials.

OLED Compatible Lenses Many design iterations were needed to come to an OLED compatible design. The OLED specific design can deal with the large black area between the small subpixels and the double blue sub-pixel. Further it was needed to develop thinner glass and major changes were implemented to the weaving and the calibration algorithms. Reference Designs: Created models for Acer (27-inch), Onsor (14-inch 2K2 laptop), and Dell (14-inch FHD portable monitor). These projects demonstrated successful integration of 3D technology into various formats and streamlined the mass production process.

Development of a New Reference Camera Module Specifications from existing cameras were analyzed, leading to updated reference camera specifications. These were shared with OEM partners for their development efforts.

Latency Measurement and Optimization A new setup using a light source and photodiode was developed to measure system latency accurately. This setup helped identify low-latency components for future products and improved latency compensation for high-frequency displays.

Calibration System Enhancements Calibration processes were improved in terms of cycle time, accuracy, and robustness.

Lowering System Requirements Efforts to reduce system requirements included optimizing camera performance, reducing power consumption, and expanding camera compatibility. Improving SDK for Developers Support for DirectX 12 textures, enhanced the software stability, and simplified processes for supporting new display types were implemented to lower entry barriers for developers and improve overall performance.

Avances que van más allá del estado de la técnica e impacto potencial esperado (incluida la repercusión socioeconómica y las implicaciones sociales más amplias del proyecto hasta la fecha)

To advance Simulated Reality (SR) technology, we focused on optimizing algorithm efficiency on CPU and GPU cores, reducing system load and enhancing performance. Our calibration software now handles all factory error conditions, ensuring reliable production and maintenance.

First steps to predict an ear position detection and spatial audio data distribution, improving the immersive audio experience were made. To aid developers, we created comprehensive resources, including documentation, examples, libraries, and samples for SR application development. We developed methods to route data streams for multiple screens, increasing SR technology's versatility. Additionally, integrating parts of the SR platform into the operating system, such as weaving functions, simplifies development and enhances usability.

Furthermore, our research achieved significant advancements with OLED technology. We developed innovative techniques to integrate SR with OLED displays, enhancing image quality and reducing latency. This integration ensures that SR applications benefit from OLED's superior colour accuracy and contrast, delivering a more vibrant and immersive visual experience. Our efforts also included optimizing power consumption to make OLED displays more efficient when running SR applications. These OLED-specific achievements further solidify our commitment to pushing the boundaries of Simulated Reality technology.

Measurement setup of a lens where the lens is not bonded to the OLED, but vacuum is used for optical

3D Audio positions audio objects at specific points around the user. Rather than from certain direct

3D dimensional measurement of a lens surface.

Title page of a crosstalk measurement report