Advanced integrated obstacle and track intrusion detection system for smart automation of rail transport

Project Information

SMART2

Grant agreement ID: 881784

DOI

10.3030/881784

Project closed

EC signature date 29 November 2019

Start date 1 December 2019

End date 30 November 2022

Funded under

• SOCIETAL CHALLENGES - Smart, Green And Integrated Transport

Total cost

€ 1 708 737,50

EU contribution

€ 1 499 528,75

Coordinated by

UNIVERSITAET BREMEN
Germany

Periodic Reporting for period 2 - SMART2 (Advanced integrated obstacle and track intrusion detection system for smart automation of rail transport)

Reporting period: 2021-06-01 to 2022-11-30

Summary of the context and overall objectives of the project

SMART2 project built on the results achieved in previous Shift2Rail project SMART by advancement, innovation and implementation of SMART2 on-board long-range all-weather obstacle detection (OD) and track intrusion detection (TID) sub-system. The SMART2 on-board sub-system is complemented with two new sub-systems to build a holistic OD&TID system. These new sub-systems are advanced SMART2 trackside (TS) and UAV (drone)-based OD&TID systems. All three sub-systems are integrated into a holistic OD&TID system via interfaces to Decision Support System (DSS). A holistic approach to autonomous obstacle detection for railways enables increased detection area including areas behind a curve, slope, tunnels and other elements blocking the train’s view on the rail tracks, in addition to a straight rail-tracks OD. The data recorded by the sensors of each of three OD&TID sub-systems are processed to inform DSS about possible obstacles and track intrusions in their fields of view. DSS integrates information coming from three OD&TID sub-systems and makes final decision on OD&TID that could be used for different purposes such as future decision on train control. SMART2 platform is flexible and open for interfacing additional OD&TID modules based on future technologies.

SMART2 project developed a working prototype of the holistic OD&TID that was evaluated in different real-world railway use-case scenarios (TRL 6/7) demonstrating the benefit of having three OD&TID sub-systems, on-board, trackside and UAV-based. By development of this advanced innovative solution for OD&TID system, SMART2 contributes to competitiveness, efficiency, and operational reliability of railway traffic through the OD and TID automation necessary for Grade of Automation (GoA) 3/4 operation.

The integrated holistic SMART2 OD&TID system was tested in two dynamic field tests conducted respectively in June 2022 and August 2022 in operational railway environment on a test site in Serbia. The June 2022 field tests served for functional testing of individual components as well as of fully integrated system. The August 2022 field tests served for the final evaluation of SMART2 holistic OD&TID system. Analysis of the achieved results of the evaluation conducted in relevant railway environment leads to conclusion that SMART2 OD&TID system detect objects and potential obstacles in a complementary manner using all three sub-systems enlarging so the detection distance range significantly. The total length of the covered evaluation test track was almost 5 km, which proves that SMART2 demonstrator can detect obstacles at a range greater than 2 km, which was one of the main requirements for the SMART2 project as such long-range obstacle detection is specific for obstacle detection in railways and it is crucial for railway safety.

Work performed from the beginning of the project to the end of the period covered by the report and main results achieved so far

The main results achieved in the first reporting period involve definition of requirements (technical and RAMS-related) for OD&TID in railways, and the definition and analysis of potential use cases for OD&TID systems in railway operations. Also, the definition of high-level specifications of OD&TID sub-systems and interfaces, with respect to identified key requirements, was completed in the first reporting period. Starting from the defined requirements and specifications, the sensors of OD&TID sub-systems were selected/developed. All sensors of the on-board OD&TID sub-system were integrated into the custom made sensor housing to enable easy mount and dismount onto/from different test vehicles (locomotives).

The main results achieved in the second reporting period involve further improvement of each of three OD&TID sub-systems to meet the functional and technical requirements for SMART2 demonstrator defined in the 1st reporting period, and their final integration into the holistic OD&TID system. The integrated holistic SMART2 OD&TID system was tested in two dynamic field tests conducted respectively in June 2022 and August 2022 in operational railway environment on a test site in Serbia achiving so TRL6/7. In addition to final development, implementation, and evaluation of SMART2 holistic OD&TID demonstrator, following on from the assessment of the initial set of requirements (reported in SMART2 deliverable D1.2) a new set of lower complexity requirements for future OD&TID systems has been proposed.

Progress beyond the state of the art and expected potential impact (including the socio-economic impact and the wider societal implications of the project so far)

SMART2 progressed beyond the state of the art in several aspects.
-The SMART2 approach was to review and assess the relevant requirements for OD in railways, including existing ones (in regulation or related to current technologies), as well as those relating to emerging technologies (as being defined in past and ongoing R&D projects).
-The SMART2 researched, developed and implemented the first holistic approach to autonomous obstacle detection in railways including novel use of drones in obstacle detection. The holistic approach of SMART2 and using of knowledge and expertise from previous project SMART enabled the increased range and detection area. Extension of the dataset generated in SMART through the extensive field tests (static and dynamic) performed in SMART2 provided the basis for know-how of ideal set-up of holistic OD&TID system. The testing of SMART2 prototype in real environment on challenging track sections (gorges, small radius curves, existing vegetation, etc.) supported further generation of knowledge and experiences of how ideal system setup should be obtained. The generated dataset also contained the map of the track with position and type of all infrastructure elements which can be used to improve the results generated by algorithms for OD&TID if needed.
-The acquisition of data from multiple sources (stationary TS/airborne and on-board systems) enabled the detection of possible threats for the whole track regardless of existence/non-existence of direct visibility of the obstacle/intrusion by the train. Inclusions of multiple sources of data also led to less fault positives.
-The addition of active change of cameras’ directions for rail track tracking allowed the on-board OD&TID system to increase detection range and to address the curves. The SWIR technology in combination with thermal vision enabled the system to increase detection in challenging weather and illumination conditions.

The SMART2 project delivered an integrated solution for OD&TID in railways that responds to specific requirement of freight use cases (Shift2Rail IP5), as well as to general requirements identified by Technology Demonstrators in Shift2Rail IP2, which apply to all railway segments. The potential impact of SMART2 on railways is hugely significant, in so far as it forms a key contribution to the route to implementation of autonomously operated trains through the implementation of the outcomes of the Shift2Rail on the European rail network in the future. The social impact of SMART2 is as a key element in the autonomous operation of trains which will increase rail transport capacity with minimal environmental impact; this will increase the competitiveness of the rail freight, producing economic and societal benefits, and environmental benefits through modal shift from road.

Vision of SMART2 holistic system for OD&TID with on-board, trackside and drone-based sub-system