A new photonic standard component for3D sensing

Project Information

K-IND

Grant agreement ID: 954933

DOI

10.3030/954933

Project closed

EC signature date 10 June 2020

Start date 1 July 2020

End date 31 January 2023

Funded under

• INDUSTRIAL LEADERSHIP - Innovation In SMEs

Total cost

€ 2 229 375,00

EU contribution

€ 1 560 562,50

Coordinated by

K LENS GMBH
Germany

Periodic Reporting for period 2 - K-IND (A new photonic standard component for3D sensing)

Reporting period: 2021-07-01 to 2023-01-31

Summary of the context and overall objectives of the project

Automation of industrial production promises cost savings, quality assurance and the avoidance of inhumane working conditions in industrial production plants. But despite technological developments over the past 40 years, many industrial tasks remain, where the automation industry is still struggling. Modern sensor technologies, in particular photonic machine vision sensors, offer solution potential. And while traditional vision sensors only provide 2D information, several approaches have been developed to record 3D. But even with state of the art 3D sensors, the human eye cannot be replaced in many cases due to the complexity of products, materials, lighting conditions and shortcomings of existing technology making automation impossible.

Our patented light-field lens technology addresses such flaws. It is small, video-capable, compatible with existing technology, robust even in complex lighting conditions and precise. The hardware is a new optical component (the K|Lens) which can be used with any standard camera and any main lens turning the system automatically into a 3D system.

The software is based on latest research results in the areas of computer vision and machine learning.

Work performed from the beginning of the project to the end of the period covered by the report and main results achieved so far

As a result of the project we want to develop within 2 years a first portfolio of solutions comprising both hardware (optical components) and the related software and prove the value of the technology in first POC customer projects.

After year 1, the hardware is mostly specified and first versions are transferred into production. The software has been developed to the extent that it can be tested with customers in the field. It comprises both classical mathematical approaches as well as modern machine learning concepts (CNNs).

The development is accompanied by continuous evaluation tests with interested partners. Overall, more than 20 feasibility studies, mostly with manufacturing companies have been performed showing generally positive results. This market validation is now extended towards system integrators and camera makers to leverage the commercialization strategy.

The use cases "bin picking" and quality control of small parts, for example in the electronics industry, still show the highest potential.

A particularly strong market demand can be perceived by our well balanced 3D solution between cost and quality.

Progress beyond the state of the art and expected potential impact (including the socio-economic impact and the wider societal implications of the project so far)

What we have been able to show is that with a multi view approach, in particular complex surfaces like glass or (semi)-transparent plastic packaging can be properly detected by 3D algorithms. Similarly, for small and complex structures a complete 3D visualization of the interior life has been shown which has not been available before.
Until the end of the project, the hardware software solution will be tested intensively in the field, so that market validation is completely obtained.

K Lens test on conveyor for electronic parts