Periodic Reporting for period 1 - HyperImage (A universal spectral imaging sensor platform for industry, agriculture and autonomous driving)
Reporting period: 2023-12-01 to 2025-06-30
The HyperImage project will be the first initiative to develop a universal, fast, modular and cost-effective spectral image sensing technology platform suitable for both short- and long-range imaging applications. To achieve that, HyperImage will make use of innovative photonic components including electrically tunable liquid lenses, pixel shifters, fast steering mirrors, and configurable SMD style IR micro-emitter arrays. HyperImage will integrate these components into innovative, high-performance multi- and hyperspectral snapshot and line scan cameras. AI machine learning algorithms will translate spectral image data into relevant functional products properties and detect and classify objects for more accurate decision making e.g. in autonomous driving. The technology platform will be complemented with a cloud-based spectral image analysis platform and reference data repository that enables users to continuously improve image analysis accuracy and prediction models. The HyperImage technology platform will be validated in four industrial use cases: (1) quality control in manufacturing of high power electronics; (2) crop growth monitoring for fully automated vertical farming of salads, herbs and microgreens; (3) spectral image based vision and navigation in off-road autonomous driving; (4) light-weight, high-resolution hyperspectral vision system for unmanned geo-surveillance drones. Based on that, HyperImage will provide European Industry a universal, efficient and reliable solution for object recognition, detailed product and material analysis and reliable quality control in manufacturing. HyperImage solution will lead to strong benefits for the applications such as 10-20% increase yield and reduced cost in manufacturing and vertical farming, 20% fuel saving and up to 40% increased operation speed in autonomous offroad driving; and up to 10% drone weight reduction (25 kg MTOW class) yielding 50% increased flight time through space for a larger battery.
The momentane description of the work reflecting the main results and achievements for the period between M1 and M19 (corresponding to the current project plan). It was summarized and detailized the requirement for the HSI-Systems for all four use cases planned in the project. This step was crutial for the following design of activities and acts parallel to the work plan reflected in the GA as a foundation for the following research and engineering activities. It was developed and tested the key optical and software (infrastructural) components for the continuation of the projects, which are building the instrumental framework for the following activities and implementations of the use-cases oriented demonstrators. The mentioned instruments covering the illumination light generation tools (Thermal IR-Emitter on the wafer level and as a lightsource integratable in the industrial demonstrator; two Pattens); the light manipulation instruments such as a gravity compensated liquid lense and baeam shifter; it was performed the integration of this instruments in the HIS-Camerasystems; designed and realized the multispectral cameras for the precisely preselected spectral bands; designed realized and implemented the cloud-platform with flexible inftrastructure for storing, visualization and analysis of HSI-Images, the flexible structure of the data handling platform is design extension-friendly and can be equipped with addition analytical tool in modern and sustainable way. It was developed and tested the structure of an ZIP-Based data containing file-format and corresponding compression routines with the focus on in-line and high performance data analysis scenarios. Parallel was created multiple reference data for verification and test of effectivity of developed data handling approaches. The detailed information regarding the technical implementation details is reflected in the corresponding deliverables and technical report.
The current description of the work reflects the main results and achievements for the period between M1 and M19, corresponding to the current project plan. During this phase, the requirements for the HSI systems across all four use cases planned in the project were summarized and specified in detail. This step was crucial for shaping the subsequent design activities and runs parallel to the work plan outlined in the Grant Agreement, serving as the foundation for future research and engineering tasks.
Key optical and software (infrastructure-related) components required for the continuation of the project were developed and tested. These form the instrumental framework for upcoming activities and the implementation of use-case–oriented demonstrators. The developed instruments include:
Illumination tools: Thermal IR emitters realized at wafer level and as light sources integrable into industrial demonstrators (two patterns).
Light manipulation components: A gravity-compensated liquid lens and a beam shifter.
Integration steps: These components were integrated into HIS and multispectral camera systems.
Multispectral imaging systems: Cameras for preselected spectral bands were designed and realized.
Cloud-based infrastructure: A flexible platform was developed and implemented for storage, visualization, and analysis of HSI images. The modular structure supports sustainable extension with additional analytical tools.
Data handling solutions: A ZIP-based file format with compression routines tailored for in-line and high-performance analysis scenarios was developed and validated.
In parallel, multiple reference datasets were created to verify and test the effectiveness of the developed data handling approaches. Detailed technical specifications and implementation information are provided in the corresponding deliverables and technical report.
The current description of the work reflects the main results and achievements for the period between M1 and M19, corresponding to the current project plan. During this phase, the requirements for the HSI systems across all four use cases planned in the project were summarized and specified in detail. This step was crucial for shaping the subsequent design activities and runs parallel to the work plan outlined in the Grant Agreement, serving as the foundation for future research and engineering tasks.
Key optical and software (infrastructure-related) components required for the continuation of the project were developed and tested. These form the instrumental framework for upcoming activities and the implementation of use-case–oriented demonstrators. The developed instruments include:
Illumination tools: Thermal IR emitters realized at wafer level and as light sources integrable into industrial demonstrators (two patterns).
Light manipulation components: A gravity-compensated liquid lens and a beam shifter.
Integration steps: These components were integrated into HIS and multispectral camera systems.
Multispectral imaging systems: Cameras for preselected spectral bands were designed and realized.
Cloud-based infrastructure: A flexible platform was developed and implemented for storage, visualization, and analysis of HSI images. The modular structure supports sustainable extension with additional analytical tools.
Data handling solutions: A ZIP-based file format with compression routines tailored for in-line and high-performance analysis scenarios was developed and validated.
In parallel, multiple reference datasets were created to verify and test the effectiveness of the developed data handling approaches. Detailed technical specifications and implementation information are provided in the corresponding deliverables and technical report.
Highly integrated MEMS-Based IR-Emitter (4KMEMS); Gravity-Compensated-Liquid-Lenses