Skip to main content
Aller à la page d’accueil de la Commission européenne (s’ouvre dans une nouvelle fenêtre)
français français
CORDIS - Résultats de la recherche de l’UE
CORDIS

Seamless mixing of virtual & real-world objects in VR & AR

Periodic Reporting for period 2 - LIGHTFIELD (Seamless mixing of virtual & real-world objects in VR & AR)

Période du rapport: 2021-04-01 au 2023-06-30

Virtual and augmented reality (VR/AR) technology is expected to be a significant leap forward, poised to unveil novel applications and technologies designed to enhance various aspects of daily life, ranging from cooking to intricate neurosurgical procedures. Nevertheless, the widespread adoption of VR/AR headsets and glasses remains elusive at present. This is primarily attributable to the prevailing issue of visual discomfort and eye strain experienced by users. The human visual system necessitates the alteration of focus when engaging with objects situated at varying distances to perceive depth accurately. Regrettably, current devices, which rely upon flat screen technologies, are incapable of providing this essential visual function. The resultant incongruity between binocular depth and focus, commonly referred to as the "vergence-accommodation conflict," precipitates distressing symptoms such as eye strain, discomfort, and even nausea among users. Although a problem within the domain of VR, this issue manifests as a formidable impediment within AR settings wherein physical objects coexist with virtual elements.

CREAL has developed a unique solution with its patented light-field display technology. This technology generates three-dimensional images that resemble holograms, closely mimicking how we naturally perceive depth with optical accuracy. By addressing the discomfort and eye strain issues commonly associated with existing headsets, CREAL's innovation enhances user immersion and enables a more seamless integration between the virtual and real environments.

CREAL's focus is on creating a specialized three-dimensional light-field display designed for VR/AR headsets and future glasses. However, this display necessitates distinct control/driving that differ significantly from those employed in traditional screens. To ensure optimal performance and the right form factor, a customized display driver is essential. Such driver, developed on an application-specific integrated circuit (ASIC), constitutes the primary objective of the LIGHTFIELD project, which has garnered support through the EIC Accelerator Pilot grant.
Throughout the course of the project, we achieved a series of significant technical and business milestones, demonstrating our dedication and progress.

On the technical front, a noteworthy accomplishment was the successful creation of a VR headset prototype (MS1), integrating cutting-edge FPGA-based electronics/driver. This FPGA driver encompasses key functionalities including data communication, light field image processing, and low-level display control. While we were unable to fully realize MS2, which involves developing a compact AR headset prototype featuring electronics based on ASIC chip, this setback was attributed to unforeseen chip production delays at the foundry. Notably, we are resolute in our commitment to our goals and remain optimistic about achieving this milestone by early 2024.

In terms of business development, the challenges posed by the COVID-19 pandemic, which restricted in-person interactions, impacted but did not impede our progress. We continued to diligently work and successfully established new partnerships with various R&D groups within both industry and academia in vision care, VR and AR domains. This period allowed us to gather invaluable feedback concerning the performance and application of the light-field headsets we've developed. Simultaneously, we took the opportunity to refine our go-to-market strategy, meticulously updating our entire business plan and investor materials, essential for our upcoming Series B investment round.

Our communication efforts were not overlooked either. We proactively raised awareness about the prevalent issue we are addressing – the "VAC" (Visual Accommodation Conflict) and its impact on VR/AR experiences. Additionally, we highlighted the distinctive advantages of our solution through a variety of informative materials and engaging lectures. This strategy aimed to ensure that our innovation and its benefits were clearly conveyed to a wider audience.

In summary, our project journey has been marked by notable achievements on both the technical and business fronts. Despite challenges, our unwavering commitment, adaptability, and dedication to our goals have positioned us for success as we continue to forge ahead.
CREAL is driven by a compelling mission to overcome the pivotal obstacle hindering the broad acceptance of virtual and augmented reality. Our mission revolves around the development of cutting-edge near-eye light-field technology. CREAL’s overarching aim is to furnish the foundational technology underpinning the forthcoming wave of immersive wearable VR/AR devices, as well as intelligent eyewear. This, in turn, will unlock a realm of diverse applications for both everyday life and professional settings, ushering in an era of unprecedented possibilities.

Over the next 3 to 5 years, our project could create a significant impact. By advancing near-eye light-field technology, we could revolutionize how we experience virtual and augmented reality. This means more comfortable and engaging interactions, boosting the adoption of VR/AR across industries. Additionally, our tech integrated into wearable devices could reshape healthcare, education, and industry practices. Smart glasses with our tech could redefine daily life, offering seamless access to information and changing how we interact with digital content. As our technology gains ground, it could spark innovation, collaboration, and cost reduction, making immersive experiences accessible to more people. In short, we're poised to reshape the way we perceive and engage with both the digital and physical worlds.
AR light-field headset prototype
VR light-field headset prototype
Design of the new display module for AR glasses
Visualization of every-day life use case for AR glasses
Future AR glasses
Compete VR headset prototype (code name Zorya v3) with FPGA-based electronics
VR light-field headset prototype using FPGA development board
Mon livret 0 0