A new photonic standard component for3D sensing

Información del proyecto

K-IND

Identificador del acuerdo de subvención: 954933

DOI

10.3030/954933

Proyecto cerrado

Fecha de la firma de la CE 10 Junio 2020

Fecha de inicio 1 Julio 2020

Fecha de finalización 31 Enero 2023

Financiado con arreglo a

• INDUSTRIAL LEADERSHIP - Innovation In SMEs

Coste total

€ 2 229 375,00

Aportación de la UE

€ 1 560 562,50

Coordinado por

K LENS GMBH
Germany

Periodic Reporting for period 2 - K-IND (A new photonic standard component for3D sensing)

Período documentado: 2021-07-01 hasta 2023-01-31

Resumen del contexto y de los objetivos generales del proyecto

Automation of industrial production promises cost savings, quality assurance and the avoidance of inhumane working conditions in industrial production plants. But despite technological developments over the past 40 years, many industrial tasks remain, where the automation industry is still struggling. Modern sensor technologies, in particular photonic machine vision sensors, offer solution potential. And while traditional vision sensors only provide 2D information, several approaches have been developed to record 3D. But even with state of the art 3D sensors, the human eye cannot be replaced in many cases due to the complexity of products, materials, lighting conditions and shortcomings of existing technology making automation impossible.

Our patented light-field lens technology addresses such flaws. It is small, video-capable, compatible with existing technology, robust even in complex lighting conditions and precise. The hardware is a new optical component (the K|Lens) which can be used with any standard camera and any main lens turning the system automatically into a 3D system.

The software is based on latest research results in the areas of computer vision and machine learning.

Trabajo realizado desde el comienzo del proyecto hasta el final del período abarcado por el informe y los principales resultados hasta la fecha

As a result of the project we want to develop within 2 years a first portfolio of solutions comprising both hardware (optical components) and the related software and prove the value of the technology in first POC customer projects.

After year 1, the hardware is mostly specified and first versions are transferred into production. The software has been developed to the extent that it can be tested with customers in the field. It comprises both classical mathematical approaches as well as modern machine learning concepts (CNNs).

The development is accompanied by continuous evaluation tests with interested partners. Overall, more than 20 feasibility studies, mostly with manufacturing companies have been performed showing generally positive results. This market validation is now extended towards system integrators and camera makers to leverage the commercialization strategy.

The use cases "bin picking" and quality control of small parts, for example in the electronics industry, still show the highest potential.

A particularly strong market demand can be perceived by our well balanced 3D solution between cost and quality.

Avances que van más allá del estado de la técnica e impacto potencial esperado (incluida la repercusión socioeconómica y las implicaciones sociales más amplias del proyecto hasta la fecha)

What we have been able to show is that with a multi view approach, in particular complex surfaces like glass or (semi)-transparent plastic packaging can be properly detected by 3D algorithms. Similarly, for small and complex structures a complete 3D visualization of the interior life has been shown which has not been available before.
Until the end of the project, the hardware software solution will be tested intensively in the field, so that market validation is completely obtained.

K Lens test on conveyor for electronic parts