Project description DEENESFRITPL Improved human-machine interaction for pilots Groundbreaking advancements in electronics, automation, computing and aircraft technology have created significant competition in the air transport sector. All these breakthroughs have also led to an overload of information that pilots are required to handle during flight. In this context, the EU-funded PEGGASUS project has built on the advances in computing technology to introduce a novel smart vision system, bringing together eye gaze tracking and hand gesture recognition technologies that could be implemented in cockpits to improve human-machine interaction. Using cameras with near-infrared sensors, AI, and computer vision, the PEGGASUS system will be able to ensure the pilots receive the information they need when they need it. Show the project objective Hide the project objective Objective As the capabilities of cockpit systems increase, the way in which the pilots interact with them evolves. At the same time, flight management concepts and tools continue to increase in complexity, as well as flight and non-flight data streams, which consequently challenges the pilots’ abilities to cope with the information they need to be aware of, and exerts pressure on their cognitive states.In in framework of the development of new Human System Interfaces carried out in WP1.2.4 the Clean Sky 2 SYSTEMS ITD, the PEGGASUS project proposes an approach to bring innovative smart vision systems to cockpits. The system we propose to develop is a crew interface and monitoring system implementing eye gaze, face, and gesture tracking technologies to bring new functionalities to Human-Machine Interfaces in the cockpit. It consists in a set of NIR-sensitive cameras powered by Computer Vision and Machine Learning algorithms running on a central processing unit. Three prototypes will be developed from a standalone lab prototype, to a TRL5 model integrated in the topic leader’s “cockpit demonstrator”. The system design shall be compliant with aircraft cockpit installation, the operational environment and pre-certification requirements. The requirements defined at the beginning of the project with the topic leader’s inputs, will be verified after its successful integration into the “cockpit demonstrator” avionics.PEGGASUS brings together partners able to cover the complete value chain of innovative product development: SERMA Engineering (FR), an OEM for aeronautical equipment, CSEM (CH) an RTD with proven experience in innovative technologies for aeronautics, ETHZ (CH) represented by the Geogaze lab that conducts cutting edge research with eye tracking technology, particularly for the use in aviation training, and Swiss (CH), an airline and potential end user who will provide expertise in crew interfaces and monitoring. Fields of science natural sciencescomputer and information sciencessoftwareengineering and technologyelectrical engineering, electronic engineering, information engineeringelectronic engineeringsensorsoptical sensorsnatural sciencescomputer and information sciencesartificial intelligencecomputer visionengineering and technologymechanical engineeringvehicle engineeringaerospace engineeringaeronautical engineeringnatural sciencescomputer and information sciencesartificial intelligencemachine learning Programme(s) H2020-EU.3.4. - SOCIETAL CHALLENGES - Smart, Green And Integrated Transport Main Programme H2020-EU.3.4.5.6. - ITD Systems Topic(s) JTI-CS2-2017-CfP07-SYS-01-07 - Development of a system for pilot eye gaze and gesture tracking in the cockpit environment Call for proposal H2020-CS2-CFP07-2017-02 See other projects for this call Funding Scheme CS2-IA - Innovation action Coordinator CSEM CENTRE SUISSE D'ELECTRONIQUE ET DE MICROTECHNIQUE SA - RECHERCHE ET DEVELOPPEMENT Net EU contribution € 562 185,58 Address RUE JAQUET DROZ 1 2000 Neuchatel Switzerland See on map Region Schweiz/Suisse/Svizzera Espace Mittelland Neuchâtel Activity type Research Organisations Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 562 185,58 Participants (4) Sort alphabetically Sort by Net EU contribution Expand all Collapse all SERMA INGENIERIE France Net EU contribution € 130 736,59 Address RUE DE L AUSSONELLE AU VILLAGE 31700 Cornebarrieu See on map Region Occitanie Midi-Pyrénées Haute-Garonne Activity type Private for-profit entities (excluding Higher or Secondary Education Establishments) Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 186 766,55 EIDGENOESSISCHE TECHNISCHE HOCHSCHULE ZUERICH Switzerland Net EU contribution € 218 683,98 Address Raemistrasse 101 8092 Zuerich See on map Region Schweiz/Suisse/Svizzera Zürich Zürich Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 218 683,98 SWISS INTERNATIONAL AIR LINES AG Switzerland Net EU contribution € 36 592,60 Address MALZGASSE 15 4052 Basel See on map Region Schweiz/Suisse/Svizzera Nordwestschweiz Basel-Stadt Activity type Private for-profit entities (excluding Higher or Secondary Education Establishments) Links Contact the organisation Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 56 025,14 Third-party Legal entity other than a subcontractor which is affiliated or legally linked to a participant. The entity carries out work under the conditions laid down in the Grant Agreement, supplies goods or provides services for the action, but did not sign the Grant Agreement. A third party abides by the rules applicable to its related participant under the Grant Agreement with regard to eligibility of costs and control of expenditure. DEUTSCHE LUFTHANSA AKTIENGESELLSCHAFT Germany Net EU contribution € 2 625,00 Address VENLOER STRASSE 151-153 50672 Koln See on map Region Nordrhein-Westfalen Köln Köln, Kreisfreie Stadt Activity type Private for-profit entities (excluding Higher or Secondary Education Establishments) Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 3 750,00
