Advertisement

Effects of Background Noise and Visual Training on 3D Audio

  • Christian A. NiermannEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10904)

Abstract

Spatial audio or 3D audio as an information channel is increasingly used in various domains. Compared to the multitude of synthetic visual systems and 3D representations, audio interfaces are underrepresented in modern aircraft cockpits. Civil commercial aircraft rarely use spatial audio as a supplementary directional information source. Although, different research approaches deal with the benefits of spatial audio. In 3D audio simulator trials, pilots express concern over distractions from background noise and possibly mandatory training requirements. To resolve this, the author developed and tested a 3D audio system to support pilots in future cockpits, called Spatial Pilot Audio Assistance (SPAACE).

The experiment took place at the German Aerospace Center’s Apron and Tower Simulator. The developed system creates a three-dimensional audio environment based on normal non-spatial audio. The 27 participants heard the sound through an off-the-shelf aviation-like stereo headset. The main subject of investigation was to evaluate if air traffic control background noise affects spatial perception. The non-normally distributed location error with background noise (\(Mdn=6.70^\circ \)) happened to be lower than the location error without air traffic control background noise (\(Mdn=7.48^\circ \)). The evaluation the effect of visual feedback-based training was the second part of the experiment. In comparing the training session with the no-training session, the location error with training (\(Mdn=6.51^\circ \)) is only moderately lower than the location error without training (\(Mdn=7.96^\circ \)).

The results show that humans can perceive the SPAACE audio with high precision, even with distracting background noise as in a busy cockpit environment. The effect of training was not as high as expected, primarily due to the already precise localization baseline without training.

Keywords

SPAACE Disturbance Aircraft Spatial audio Cockpit Human machine interface 

References

  1. 1.
    Veltman, J.A., Oving, A.B., Bronkhorst, A.W.: 3-D audio in the fighter cockpit improves task performance. Int. J. Aviat. Psychol. 14(3), 239–256 (2004). ISSN 1050-8414CrossRefGoogle Scholar
  2. 2.
    Jovanovic, M., Starcevic, D., Obrenovic, Z.: Designing aircraft cockpit displays: borrowing from multimodal user interfaces. In: Gavrilova, M.L., Tan, C.J.K. (eds.) Transactions on Computational Science III. LNCS, vol. 5300, pp. 55–65. Springer, Heidelberg (2009).  https://doi.org/10.1007/978-3-642-00212-0_3. ISBN 978-3-642-00211-3CrossRefGoogle Scholar
  3. 3.
    EASA: European Plan for Aviation Safety (EPAS). 2017–2021. 2017. 107 pp. https://www.easa.europa.eu/system/files/dfu/EPAS_2017-2021.pdf. Accessed 09 Sept 2017
  4. 4.
    Riggs, S.L., et al.: Multimodal information presentation in support of NextGen operations. Int. J. Aerosp. Psychol. 27(1–2), 29–43 (2017).  https://doi.org/10.1080/10508414.2017.1365608. ISSN 2472-1840CrossRefGoogle Scholar
  5. 5.
    Parker, S.P.A., et al.: Effects of supplementing head-down displays with 3-D audio during visual target acquisition. Int. J. Aviat. Psychol. 14, 277–295 (2004). ISSN 1050-8414CrossRefGoogle Scholar
  6. 6.
    Oving, A.B., Veltman, J.A., Bronkhorst, A.W.: Effectiveness of 3-D audio for warnings in the cockpit. Int. J. Aviat. Psychol. 14(3), 257–276 (2004). ISSN 1050–8414CrossRefGoogle Scholar
  7. 7.
    Spence, C., Ho, C.: Tactile and multisensory spatial warning signals for drivers. IEEE Trans. Haptics 1, 121–129 (2008)CrossRefGoogle Scholar
  8. 8.
    Koteskey, R.W., Wu, S.-C., Battiste, V.: Enhanced audio for NextGen flight decks. In: Landry, S.J. (ed.) Advances in Human Aspects of Aviation. Advances in Human Factors and Ergonomics Series. CRC Press, Boca Raton (2012). ISBN 978-1-439-87117-1Google Scholar
  9. 9.
    Begault, D.R., Pittman, M.T.: Three-dimensional audio versus head-down traffic alert and collision avoidance system displays. Int. J. Aviat. Psychol. 6(1), 79–93 (1996). ISSN 1050-8414CrossRefGoogle Scholar
  10. 10.
    Simpson, B.D., et al.: In-flight navigation using head-coupled and aircraft-coupled spatial audio cues. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 51, no. 19, pp. 1341–1344 (2007).  https://doi.org/10.1177/154193120705101914. ISSN 1071–1813CrossRefGoogle Scholar
  11. 11.
    Haas, E.C.: Can 3-D auditory warnings enhance helicopter cockpit safety? In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 42, no. 15, pp. 1117–1121 (1998).  https://doi.org/10.1177/154193129804201513. ISSN 1071–1813CrossRefGoogle Scholar
  12. 12.
    Niermann, C.A.: Can spatial audio support pilots? 3D-audio for future pilot-assistance systems. In: 2015 IEEE/AIAA 34th Digital Avionics Systems Conference (DASC) (2015).  https://doi.org/10.1109/DASC.2015.7311401. http://ieeexplore.ieee.org/iel7/7301991/7311321/07311401.pdf?arnumber=7311401
  13. 13.
    Niermann, C.A.: Potential of 3D audio as human-computer interface in future aircraft. In: Harris, D. (ed.) EPCE 2016. LNCS (LNAI), vol. 9736, pp. 429–438. Springer, Cham (2016).  https://doi.org/10.1007/978-3-319-40030-3_42. ISBN 978-3-319-40029-7CrossRefGoogle Scholar
  14. 14.
    Niermann, C.A.: Can 3D-audio improve state-of-the-art pilot-assistance systems? In: International Council of the Aeronautical Sciences (2016)Google Scholar
  15. 15.
    Perrott, D.R., et al.: Aurally aided visual search under virtual and free field listening conditions. Hum. Factors 38(4), 702–716 (1996). ISSN 0018-7208CrossRefGoogle Scholar
  16. 16.
    Flanagan, P., et al.: Aurally and visually guided visual search in a virtual environment. Hum. Factors 40(3), 461–468 (1998). ISSN 0018-7208CrossRefGoogle Scholar
  17. 17.
    Nelson, W.T., et al.: Monitoring the simultaneous presentation of spatialized speech signals in a virtual environment. In: Proceedings of the 1998 IMAGE Conference, Scottsdale, AZ, pp. 159–166 (1998)Google Scholar
  18. 18.
    Wickens, C.D.: Multiple resources and performance prediction. Theor. Issues Ergon. Sci. 3(2), 159–177 (2002).  https://doi.org/10.1080/14639220210123806. ISSN 1463-922XCrossRefGoogle Scholar
  19. 19.
    Lower, M.C., Bagshaw, M.: Noise levels and communications on the flight decks of civil aircraft. In: The 1996 International Congress on Noise Control Engineering. Proceedings of Internoise 1996, Liverpool, pp. 349–352 (1996)Google Scholar
  20. 20.
    Simon, F., et al.: Activities of European research laboratories regarding helicopter internal noise. AerospaceLab (2014).  https://doi.org/10.12762/2014.AL07-04
  21. 21.
    Kenneth, W., et al.: Efficient and effective use of low-cost 3D audio systems. In: International Conference on Auditory Display, Kyoto, Japan (2002)Google Scholar
  22. 22.
    Majdak, P., Goupell, M.J., Laback, B.: 3-D localization of virtual sound sources: effects of visual environment, pointing method, and training. Atten. Percept. Psychophys. 72(2), 454–469 (2010).  https://doi.org/10.3758/APP.72.2.45. ISSN 1943-393XCrossRefGoogle Scholar
  23. 23.
    Bronkhorst, A.W.: Localization of real and virtual sound sources. J. Acoust. Soc. Am. 98(5), 2542–2553 (1995)CrossRefGoogle Scholar
  24. 24.
    Antunano, M.J., Spanyers, J.P.: Hearing and noise in aviation. Medical facts for pilots (AM-400-98/3 2002)Google Scholar
  25. 25.
    Godfroy-Cooper, M., et al.: 3D-sonification for obstacle avoidance in brownout conditions. In: AHS International Forum 73rd Annual Forum & Technology Display (2017)Google Scholar
  26. 26.
    Ericson, M.A., Brungart, D.S., Simpson, B.D.: Factors that inuence intelligibility in multitalker speech displays. Int. J. Aviat. Psychol. 14(3), 313–334 (2004).  https://doi.org/10.1207/s15327108ijap1403_6. ISSN 1050-8414CrossRefGoogle Scholar
  27. 27.
    Zahorik, P.: Localization accuracy in 3D sound displays: the role of visual feedback training. In: ARL’s 5th Federated Laboratory Annual Symposium 2001, pp. 17–22 (2001)Google Scholar
  28. 28.
    Commission Regulation (EU) No 1178/2011 laying down technical requirements and administrative procedures related to civil aviation aircrew pursuant to Regulation (EC) No 216/2008 of the European Parliament and of the Council. Official Journal. L 311. 2011. 193 pp. Accessed 15 Apr 2017Google Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.German Aerospace Center (DLR)Institute of Flight GuidanceBraunschweigGermany

Personalised recommendations