Advertisement

Adaptation of Assistant Based Speech Recognition to New Domains and Its Acceptance by Air Traffic Controllers

  • Matthias KleinertEmail author
  • Hartmut Helmke
  • Gerald Siol
  • Heiko Ehr
  • Dietrich Klakow
  • Mittul Singh
  • Petr Motlicek
  • Christian Kern
  • Aneta Cerna
  • Petr Hlousek
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 903)

Abstract

In air traffic control rooms, paper flight strips are more and more replaced by digital solutions. The digital systems, however, increase the workload for air traffic controllers: For instance, each voice-command must be manually inserted into the system by the controller. Recently the AcListant® project has validated that Assistant Based Speech Recognition (ABSR) can replace the manual inputs by automatically recognized voice commands. Adaptation of ABSR to different environments, however, has shown to be expensive. The Horizon 2020 funded project MALORCA (MAchine Learning Of Speech Recognition Models for Controller Assistance), proposed a more effective adaptation solution integrating a machine learning framework. As a first showcase, ABSR was automatically adapted with radar data and voice recordings for Prague and Vienna. The system reaches command recognition error rates of 0.6% (Prague) resp. 3.2% (Vienna). This paper describes the feedback trials with controllers from Vienna and Prague.

Keywords

Machine learning Assistant based speech recognition Automatic speech recognition Air traffic controller 

References

  1. 1.
    The project AcListant® (Active Listening Assistant) http://www.aclistant.de
  2. 2.
    Helmke, H., Ohneiser, O., Mühlhausen, T., Wies, M.: Reducing controller workload with automatic speech recognition. In: IEEE/AIAA 35th Digital Avionics Systems Conference (DASC). Sacramento, California (2016)Google Scholar
  3. 3.
    Helmke, H., Ohneiser, O., Buxbaum, J., Kern, C.: Increasing ATM efficiency with assistant-based speech recognition. In: 12th USA/Europe Air Traffic Management Research and Development Seminar (ATM2017). Seattle, Washington (2017)Google Scholar
  4. 4.
    Kleinert, M., Helmke, H., Siol, G., Ehr, H., Cerna, A., Kern, C., Klakow, D., Motlicek, P. et al.: Semi-supervised Adaptation of Assistant Based Speech Recognition Models for different Approach Areas. In: IEEE/AIAA 37th Digital Avionics Systems Conference (DASC). London, England (2018)Google Scholar
  5. 5.
    Kleinert, M., Helmke, H., Ehr. H., Kern, C., Klakow, D., Motlicek, P., Singh, M., Siol, G.: Building Blocks of Assistant Based Speech Recognition for Air Traffic Management Applications. In: 8th SESAR Innovation Days, Salzburg, 2018, to be publishedGoogle Scholar
  6. 6.
    Nguyen, V.N., Holone, H.: Possibilities, challenges and the state of the art of automatic speech recognition in Air Traffic Control. Int. J. Comput. Inf. Eng. 9(8), 1940–1949 (2015)Google Scholar
  7. 7.
    Chen, S., Kopald, H.D., Chong, R., Wei, Y., Levonian, Z: Read back error detection using automatic speech recognition. In: 12th USA/ Europe Air Traffic Management Research and Development Seminar (ATM2017), Seattle, WA, USA (2017)Google Scholar
  8. 8.
    AIRBUS Air Traffic Control Challenge Workshop: https://www.irit.fr/recherches/SAMOVA/pagechallenge-airbus-atc-workshop.html (2018)
  9. 9.
    Shore, T., Faubel, F., Helmke, H., Klakow, D.: Knowledge-based word lattice rescoring in a dynamic context. In: Interspeech 2012, Sep. 2012, Portland, Oregon (2012) Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Matthias Kleinert
    • 1
    Email author
  • Hartmut Helmke
    • 1
  • Gerald Siol
    • 1
  • Heiko Ehr
    • 1
  • Dietrich Klakow
    • 2
  • Mittul Singh
    • 2
  • Petr Motlicek
    • 3
  • Christian Kern
    • 4
  • Aneta Cerna
    • 5
  • Petr Hlousek
    • 5
  1. 1.Institute of Flight GuidanceGerman Aerospace Center (DLR)BraunschweigGermany
  2. 2.Spoken Language Systems Group (LSV)Saarland UniversitySaarbrückenGermany
  3. 3.Idiap Research InstituteMartignySwitzerland
  4. 4.Austro ControlViennaAustria
  5. 5.Air Navigation Services of the Czech RepublicJenecCzech Republic

Personalised recommendations