Periodic Reporting for period 2 - VG360 (Reliable, digital and non-contact precision measurement system for remote structural health monitoring of any structure)
Okres sprawozdawczy: 2021-04-01 do 2023-03-31
The monitoring of structures is one of the ultimate challenges to engineering companies today. Ageing, internal and external factors such as steel corrosion, concrete carbonation, earthquakes, strong rain or wind, degrade the integrity of the structures over time. Any indication of abnormal behaviour may also threaten the safety of the structure. A collapse or closure of critical structure can lead to chaos, significant financial losses, and, in some cases, heavy casualties. Since the year 2000, over 5,000 people have been killed globally in the collapse of civil structures such as bridges, dams and buildings. In addition, frequent catastrophic failures of offshore wind turbines lead to loss of renewable generating capacity and high maintenance costs. A low-cost monitoring system is required which can detect and avoid structural deterioration and prevent these catastrophic failures from occurring.
Imetrum has developed a prototype monitoring solution called “VG360,” which is a non-contact, full field digital measurement system for remote health monitoring of any type of structure. It is composed of a digital camera connected to a commercial Robotic Total Station (RTS), computer, and intelligent field software. The software is based on Imetrum’s proprietary algorithms for pattern recognition and Digital Imaging Correlation (DIC) for robust image tracking.
VG360 is a time and cost effective measurement system, significantly reducing the cost of installation and maintenance. It is a non-contacting measurement tool, enabling precise and safe measurement in hard to get spaces and preserving the architectural heritage.
The purpose of this project is to convert the VG360 prototype into an industrially robust monitoring system. To achieve this, we are taking the PC-based software and hardware elements of the VG360 and repackaging them using Nvidia Jetson AI processors into forms which are compact, low weight and inexpensive. These are being combined with Internet of Things (IoT) connectivity and functionality to create a low-cost product which is suitable for widespread application across the world.
Imetrum has developed a prototype monitoring solution called “VG360,” which is a non-contact, full field digital measurement system for remote health monitoring of any type of structure. It is composed of a digital camera connected to a commercial Robotic Total Station (RTS), computer, and intelligent field software. The software is based on Imetrum’s proprietary algorithms for pattern recognition and Digital Imaging Correlation (DIC) for robust image tracking.
VG360 is a time and cost effective measurement system, significantly reducing the cost of installation and maintenance. It is a non-contacting measurement tool, enabling precise and safe measurement in hard to get spaces and preserving the architectural heritage.
The purpose of this project is to convert the VG360 prototype into an industrially robust monitoring system. To achieve this, we are taking the PC-based software and hardware elements of the VG360 and repackaging them using Nvidia Jetson AI processors into forms which are compact, low weight and inexpensive. These are being combined with Internet of Things (IoT) connectivity and functionality to create a low-cost product which is suitable for widespread application across the world.
During the first year of the project, we successfully converted the PC based operating system and hardware into an Nvidia Jetson based solution, which is lower cost, higher performance and more compact than before. This has been mounted onto a Topcon GT Series total station and is now being tested at application sites in the UK.
WP1: Hardware upgrade and implementation of new features: Initial analysis of data generated through testing led to a definition of the modifications to VG360 required to enable a real-world manageable product form to be implemented. The primary requirements are to reduce the size and weight of the equipment, implement 24V operation suitable for powering using local renewable sources (solar panels and wind generators), and implement wireless comms via 4G and/or 5G connectivity. The Nvidia Jetson processor was integrated into the Total Station, along with 4G and Bluetooth connections, all operating on a 24V power bus. This significantly reduced the bulk and increased the portability of the unit, making it suitable for mounting alongside structures in the field. Primary software functions were converted and integrated into the Topcon Operating System, enabling the Nvidia processor to automatically control the orientation, focus and adjustment of the lens. The automation algorithms are now able to integrate the image coordinate system with that of the Total Station, enabling remote operation via the IoT connection to be achieved. Work is continuing with Topcon in the UK and The Netherlands to produce an integrated technical specification, functional description and bill of materials. Functionality testing has been performed in the company’s Engineering Laboratory and through a series of filed trials at sites within the UK. It is planned to expand these tests further beyond the end of the project.
WP2: Industrialisation and Scale-up: As a result of Covid it became necessary to alter our manufacturing plan. Our original manufacturing partner Topcon had restructured its global organisation during Covid and are no longer manufacturing their Total Stations in Europe. Following an extensive search for an alternative partner we have formed a manufacturing agreement with Tinius Olsen a sub-contract manufacturer in the UK.
WP3: Demonstration and validation: Covid lockdown and travel restrictions limited our ability to undertake the field trials we had planned in the Netherlands, but we were able to conduct field testing at a site close to the Imetrum Headquarters in Bristol, UK. Alongside this we were able to undertake shorter duration monitoring of buildings and civil structures in the UK with the equipment being mounted alongside Imetrum’s existing fixed monitoring heads so that we could gather comparative data on the SH360s performance. These trials will continue beyond the end of the project.
WP4: Commercialisation and communication plan: This work was inhibited during the project as many of our customers and sales agents were impacted by Covid and their staff were furloughed. However, as a result of an introduction during an EIC meeting organised through this programme, we have begun discussions with KPN in The Netherlands towards integrating their connectivity with Imetrum’s SH360 with a view to jointly commercialising our new capability. It is intended to continue this work following the end of lockdown.
Under WP4, Task 4.3 IPR Management, the US patents for VG360 / SH360 have been progressed: US patent 10,598,485 granted on 24th March 2020 and US Continuation Application filed and “Intention to Grant” issued on 21st January 2021.
WP5: Management: An integrated project / programme management structure has been implemented, based on Agile principles. The Risk Table has been sustained and updated as the project has progressed. Only one significant new risk has been identified: the impact of Covid-19 on delays and hiring plan. To adjust for the delay caused by it, we requested an extension to the project of twelve months. This allowed time for the travel restrictions to be lifted and the testing side of the project to continue.
WP1: Hardware upgrade and implementation of new features: Initial analysis of data generated through testing led to a definition of the modifications to VG360 required to enable a real-world manageable product form to be implemented. The primary requirements are to reduce the size and weight of the equipment, implement 24V operation suitable for powering using local renewable sources (solar panels and wind generators), and implement wireless comms via 4G and/or 5G connectivity. The Nvidia Jetson processor was integrated into the Total Station, along with 4G and Bluetooth connections, all operating on a 24V power bus. This significantly reduced the bulk and increased the portability of the unit, making it suitable for mounting alongside structures in the field. Primary software functions were converted and integrated into the Topcon Operating System, enabling the Nvidia processor to automatically control the orientation, focus and adjustment of the lens. The automation algorithms are now able to integrate the image coordinate system with that of the Total Station, enabling remote operation via the IoT connection to be achieved. Work is continuing with Topcon in the UK and The Netherlands to produce an integrated technical specification, functional description and bill of materials. Functionality testing has been performed in the company’s Engineering Laboratory and through a series of filed trials at sites within the UK. It is planned to expand these tests further beyond the end of the project.
WP2: Industrialisation and Scale-up: As a result of Covid it became necessary to alter our manufacturing plan. Our original manufacturing partner Topcon had restructured its global organisation during Covid and are no longer manufacturing their Total Stations in Europe. Following an extensive search for an alternative partner we have formed a manufacturing agreement with Tinius Olsen a sub-contract manufacturer in the UK.
WP3: Demonstration and validation: Covid lockdown and travel restrictions limited our ability to undertake the field trials we had planned in the Netherlands, but we were able to conduct field testing at a site close to the Imetrum Headquarters in Bristol, UK. Alongside this we were able to undertake shorter duration monitoring of buildings and civil structures in the UK with the equipment being mounted alongside Imetrum’s existing fixed monitoring heads so that we could gather comparative data on the SH360s performance. These trials will continue beyond the end of the project.
WP4: Commercialisation and communication plan: This work was inhibited during the project as many of our customers and sales agents were impacted by Covid and their staff were furloughed. However, as a result of an introduction during an EIC meeting organised through this programme, we have begun discussions with KPN in The Netherlands towards integrating their connectivity with Imetrum’s SH360 with a view to jointly commercialising our new capability. It is intended to continue this work following the end of lockdown.
Under WP4, Task 4.3 IPR Management, the US patents for VG360 / SH360 have been progressed: US patent 10,598,485 granted on 24th March 2020 and US Continuation Application filed and “Intention to Grant” issued on 21st January 2021.
WP5: Management: An integrated project / programme management structure has been implemented, based on Agile principles. The Risk Table has been sustained and updated as the project has progressed. Only one significant new risk has been identified: the impact of Covid-19 on delays and hiring plan. To adjust for the delay caused by it, we requested an extension to the project of twelve months. This allowed time for the travel restrictions to be lifted and the testing side of the project to continue.
The decision to move towards embedded Nvidia Jetson processors has significant additional benefits for the project. This results in a lower cost, higher performance, integrated product whose higher-power embedded processor is more suited to the implementation of AI functionality, most especially Machine Learning functions for situation analysis and prediction. As a result of this, Imetrum has commenced a parallel development project under the Innovate UK Knowledge Transfer Partnership (KTP) to develop Artificial Intelligence algorithms for failure prediction and correction within civil structures. The integration of this with SH360 will enable toe automation of structural diagnostic functions, resulting in safer buildings in the future with lower upkeep and maintenance costs. We are very excited by the safety and social-economic improvements this will provide.