Project description DEENESFRITPL Speech-to-text solution in the air Safety is the highest priority for the aviation industry. Continuous advances in technology make it easier to keep crews and passengers safe. One such development is automatic speech recognition technology that can reduce air-traffic controllers’ workload and minimise human error. However, voice recognition that turns speech to text remains limited due to difficulties in distinguishing controllers’ accents and deviations from standard terminology. The EU-funded HAAWAII project will study and develop a reliable, error-resilient and adaptable solution that automatically transcribes voice commands issues by both air-controllers and pilots. The project will use an extensive collection of data to develop a new set of models for complex environments of Icelandic en route and London TMA, focusing on strengthening speech recognition models. Show the project objective Hide the project objective Objective Advanced automation support developed in Wave 1 of SESAR IR includes using of automatic speech recognition (ASR) to reduce the amount of manual data inputs by air-traffic controllers. Evaluation of controllers’ feedback has been subdued due to the limited recognition performance of the commercial of the shell ASR engines that were used, even in laboratory conditions. The reasons for the unsatisfactory conclusions include e.g. inability to distinguish controllers’ accents, deviations from standard phraseology and limited real-time recognition performance. Past exploratory research funded project MALORCA, however, has shown (on restricted use-cases) that satisfactory performance can be reached with novel data-driven machine learning approaches. Based on the results of MALORCA HAAWAII project aims to research and develop a reliable, error resilient and adaptable solution to automatically transcribe voice commands issued by both air-traffic controllers and pilots. The project will build on very large collection of data, organized with a minimum expert effort to develop a new set of models for complex environments of Icelandic en-route and London TMA. HAAWAII aims to perform proof-of-concept trials in challenging environments, i.e. to be directly connected with real-life data from ops room. As pilot read-back error detection is the main application, HAAWAII aims to significantly enhance the validity of the speech recognition models. The proposed work goes far beyond the work planned for the Wave 2 IR programme and will improve both safety and reduce controllers’ workload. The digitization of controller and pilot voice utterances can be used for a wide variety of safety and performance related benefits including, but not limiting to pre-fill entries into electronic flight strips and CPDLC messages. Another application demonstrated during proof-of-concept will be to objectively estimate controllers’ workload utilising digitized voice recordings of the complex London TMA. Fields of science social sciencessociologyindustrial relationsautomationnatural sciencescomputer and information sciencesartificial intelligencemachine learning Keywords Artificial Intelligence Machine Learning Automatic Speech Recognition Readback Error Detection Programme(s) H2020-EU.3.4. - SOCIETAL CHALLENGES - Smart, Green And Integrated Transport Main Programme H2020-EU.3.4.7. - SESAR JU Topic(s) SESAR-ER4-18-2019 - Automation and CWP Call for proposal H2020-SESAR-2019-2 See other projects for this call Funding Scheme RIA - Research and Innovation action Coordinator DEUTSCHES ZENTRUM FUR LUFT - UND RAUMFAHRT EV Net EU contribution € 520 000,00 Address LINDER HOHE 51147 Koln Germany See on map Region Nordrhein-Westfalen Köln Köln, Kreisfreie Stadt Activity type Research Organisations Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 520 000,00 Participants (6) Sort alphabetically Sort by Net EU contribution Expand all Collapse all VYSOKE UCENI TECHNICKE V BRNE Czechia Net EU contribution € 300 000,00 Address ANTONINSKA 548/1 601 90 Brno Stred See on map Region Česko Jihovýchod Jihomoravský kraj Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 300 000,00 FONDATION DE L'INSTITUT DE RECHERCHE IDIAP Switzerland Net EU contribution € 360 000,00 Address RUE MARCONI 19 1920 Martigny See on map Region Schweiz/Suisse/Svizzera Région lémanique Valais / Wallis Activity type Research Organisations Links Contact the organisation Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 360 000,00 AUSTRO CONTROL OSTERREICHISCHE GESELLSCHAFT FUR ZIVILLUFTFAHRT MBH Austria Net EU contribution € 100 000,00 Address SCHNIRCHGASSE 17 1030 Wien See on map Region Ostösterreich Wien Wien Activity type Private for-profit entities (excluding Higher or Secondary Education Establishments) Links Contact the organisation Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 100 000,00 ISAVIA ANS EHF Iceland Net EU contribution € 260 000,00 Address REYKJAVIKURFLUGVELLI 102 102 Reykjavik See on map Region Ísland Ísland Höfuðborgarsvæði Activity type Private for-profit entities (excluding Higher or Secondary Education Establishments) Links Contact the organisation Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 260 000,00 NATS (EN ROUTE) PUBLIC LIMITED COMPANY United Kingdom Net EU contribution € 260 000,00 Address 4000 PARKWAY WHITELEY PO15 7FL Fareham See on map Region South East (England) Hampshire and Isle of Wight Central Hampshire Activity type Private for-profit entities (excluding Higher or Secondary Education Establishments) Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 260 000,00 HRVATSKA KONTROLA ZRACNE PLOVIDBE DOO Croatia Net EU contribution € 25 000,00 Address RUDOLFA FIZIRA 2 10410 Velika Gorica See on map Region Hrvatska Sjeverna Hrvatska Zagrebačka županija Activity type Private for-profit entities (excluding Higher or Secondary Education Establishments) Links Contact the organisation Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 25 000,00