Real Life Environment with Pilot State Monitoring Systems

Projektinformationen

REPS

ID Finanzhilfevereinbarung: 101008005

DOI

10.3030/101008005

Projekt abgeschlossen

EK-Unterschriftsdatum 2 Dezember 2020

Startdatum 1 Januar 2021

Enddatum 30 Juni 2023

Finanziert unter

• SOCIETAL CHALLENGES - Smart, Green And Integrated Transport

Gesamtkosten

€ 941 037,50

EU-Beitrag

€ 799 475,00

Koordiniert durch

TECHNISCHE UNIVERSITAET BRAUNSCHWEIG
Germany

Periodic Reporting for period 2 - REPS (Real Life Environment with Pilot State Monitoring Systems)

Berichtszeitraum: 2022-01-01 bis 2023-06-30

Zusammenfassung vom Kontext und den Gesamtzielen des Projekts

The project "REPS - Real Life Environment with Pilot State Monitoring Systems" aims to test and evaluate Pilot State Monitoring (PSM) technology in a real environment. That means the PSM technology being developed by Honeywell within the CleanSky2 program will be installed in real aircraft cockpits and tested during daily operations. The collected data will be assessed and evaluated. The final outcome will be a report about the acceptability of the PSM technology by cockpit crews and an early version of a "concept of operations" for such a PSM system.

Arbeit, die ab Beginn des Projekts bis zum Ende des durch den Bericht erfassten Berichtszeitraums geleistet wurde, und die wichtigsten bis dahin erzielten Ergebnisse

The first quarter of period one deeply focused on the administrative tasks the consortium itself is committed to. In parallel, meetings were held to be up to date with the development of the PSM. The main task was to elaborate non-disturbing locations for cameras in the cockpit, which was done via a workshop and tests in the cockpit-simulator (similar to an Airbus A320) of TU Braunschweig. Additionally, negotiations with an airline were held, shifting the attention to the certification/qualification for such devices. Up to this point, it was not only intended to install multiple devices into the cockpit but also it was assumed that current devices (cameras, illuminators, an exponator and the computing unit) are approved to be installed in an airliners cockpit. The definition of high-level specifications and requirements needed at this point was performed. For later usage of the possible outcome, a method paper was published on the AHFE-Conference. New arising questions afterwards lead to the decision to qualify the devices in the frame of the project for their usage in real aircraft cockpits. In the course of the final design phase and the parallel discussion towards a qualification, different cameras were considered to be installed. Finally, a camera has been identified and chosen, with which the qualification process will be performed now. This additional, and for the REPS consortium unforeseen, process led to massive delays in the project schedule.
To secure the project plan, a second airline was approached to support the trial activities after the successful qualification of the devices.

Fortschritte, die über den aktuellen Stand der Technik hinausgehen und voraussichtliche potenzielle Auswirkungen (einschließlich der bis dato erzielten sozioökonomischen Auswirkungen und weiter gefassten gesellschaftlichen Auswirkungen des Projekts)

The next steps of the project will contain elements with respect to qualification, but aims to accelerate the project towards installation. Therefore, some installation and usability tests with the final setup will be performed in a real aircraft cockpit and in a full motion simulator. This step will include Deep Blue’s acceptance analysis baseline. With the end of the qualification phase, the PSM will finally be installed into different cockpits of the two airlines. Testing the installation process and the handling shall be done by that time. From then the PSM is collecting data for later processing. Short questionnaires from pilots after the flight will be evaluated to make a statement regarding the acceptance of using the PSM in real environment. The final step, after evaluation of the results, will contain concepts of operation and fields of possible application.

The final goal is, that a PSM will help pilots to master their increasingly complex working environment. Additionally to the work they have to perform, they have to be constantly attentive and supervising the cockpit - even when not in charge. To counteract errors due to the workload plus continuous cognitive demand as early as possible, the PSM shall be capable of recognizing distinctive pilots’ state, i.e. drowsiness. By that, pilots can be alerted early and appropriate countermeasures can be initiated. This kind of alert-system is new to the operational commercial aircraft environment. It will be a major milestone to bring these devices into real aircraft cockpit during regular daily operations.

psm-overview.png