A new photonic standard component for3D sensing

Informazioni relative al progetto

K-IND

ID dell’accordo di sovvenzione: 954933

DOI

10.3030/954933

Progetto chiuso

Data della firma CE 10 Giugno 2020

Data di avvio 1 Luglio 2020

Data di completamento 31 Gennaio 2023

Finanziato da

• INDUSTRIAL LEADERSHIP - Innovation In SMEs

Costo totale

€ 2 229 375,00

Contributo UE

€ 1 560 562,50

Coordinato da

K LENS GMBH
Germany

Periodic Reporting for period 2 - K-IND (A new photonic standard component for3D sensing)

Periodo di rendicontazione: 2021-07-01 al 2023-01-31

Sintesi del contesto e degli obiettivi generali del progetto

Automation of industrial production promises cost savings, quality assurance and the avoidance of inhumane working conditions in industrial production plants. But despite technological developments over the past 40 years, many industrial tasks remain, where the automation industry is still struggling. Modern sensor technologies, in particular photonic machine vision sensors, offer solution potential. And while traditional vision sensors only provide 2D information, several approaches have been developed to record 3D. But even with state of the art 3D sensors, the human eye cannot be replaced in many cases due to the complexity of products, materials, lighting conditions and shortcomings of existing technology making automation impossible.

Our patented light-field lens technology addresses such flaws. It is small, video-capable, compatible with existing technology, robust even in complex lighting conditions and precise. The hardware is a new optical component (the K|Lens) which can be used with any standard camera and any main lens turning the system automatically into a 3D system.

The software is based on latest research results in the areas of computer vision and machine learning.

Lavoro eseguito dall’inizio del progetto fino alla fine del periodo coperto dalla relazione e principali risultati finora ottenuti

As a result of the project we want to develop within 2 years a first portfolio of solutions comprising both hardware (optical components) and the related software and prove the value of the technology in first POC customer projects.

After year 1, the hardware is mostly specified and first versions are transferred into production. The software has been developed to the extent that it can be tested with customers in the field. It comprises both classical mathematical approaches as well as modern machine learning concepts (CNNs).

The development is accompanied by continuous evaluation tests with interested partners. Overall, more than 20 feasibility studies, mostly with manufacturing companies have been performed showing generally positive results. This market validation is now extended towards system integrators and camera makers to leverage the commercialization strategy.

The use cases "bin picking" and quality control of small parts, for example in the electronics industry, still show the highest potential.

A particularly strong market demand can be perceived by our well balanced 3D solution between cost and quality.

Progressi oltre lo stato dell’arte e potenziale impatto previsto (incluso l’impatto socioeconomico e le implicazioni sociali più ampie del progetto fino ad ora)

What we have been able to show is that with a multi view approach, in particular complex surfaces like glass or (semi)-transparent plastic packaging can be properly detected by 3D algorithms. Similarly, for small and complex structures a complete 3D visualization of the interior life has been shown which has not been available before.
Until the end of the project, the hardware software solution will be tested intensively in the field, so that market validation is completely obtained.

K Lens test on conveyor for electronic parts