Skip to main content
SpringerLink
Log in
Book cover

International Conference on Dependability and Complex Systems

DepCoS-RELCOMEX 2019: Engineering in Dependability of Computer Systems and Networks pp 215–224Cite as

Registration and Analysis of a Pilot’s Attention Using a Mobile Eyetracking System

  • Conference paper
  • First Online:

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 987))

Abstract

This paper presents the next stage of research into the registration and analysis of a pilot’s attention during the take-off and landing procedures. This is a continuation of the research, which the authors conducted using the static SensoMotoric Instruments (SMI) Red500 eyetracker on a group of pilots applying for a pilot’s license. Because static eyetracking introduces a series of restrictions on the properties of the observed scene, a system using Tobii Glasses Pro mobile eye tracker was proposed. Using the mobile system and a training simulator, a measurement stand was prepared for the flight of the aircraft configured as follows: Seneca II airplane with a three-point hidden chassis, location: EPRZ airport - Rzeszów Jasionka. An aviation task was prepared, which was carried out by participants in the experiment. A Tobii project was developed to define several Area of Interests (AOI) for key instruments in the cockpit of the used aircraft. It was observed that for the implementation of an exemplary task, there is no possibility of smoothly modifying coordinates of areas of interest of AOI in subsequent frames of the recorded video stream. Authors designed in the Matlab environment, the Smart Trainer application for a smooth analysis of attention using the characteristic points tracking mechanism. A fuzzy AOI contour is proposed using a modified form of the Butterworth 2D filter for individual instruments, which allows more effective registration of fixations. During the measurement it is possible to observe fixation histograms for a defined set of instruments.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Aeronautical Information Regulation And Control: AIRAC 1607-EPRZ Airport (2016)

    Google Scholar 

  2. Cessna Aircraft Company, Pilot’s Operating Handbook for Cessna 172 N Skyhawk, Kansas (1978)

    Google Scholar 

  3. Duchowski, A.T.: Eye Tracking Methodology: Theory and Practice. Springer, London (2007)

    MATH  Google Scholar 

  4. Ellis, K.K.E.: Eye tracking metrics for workload estimation in flight deck operations. MS (Master of Science) thesis, University of Iowa (2009)

    Google Scholar 

  5. Gomolka, Z., Twarog, B., Zeslawska, E.: Cognitive investigation on pilot attention during take-offs and landings using flight simulator. In: ICAISC 2017, vol. 10246 (2017)

    Chapter  Google Scholar 

  6. Glaholt, M.G.: Eye tracking in the cockpit: a review of the relationships between eye movements and the aviators cognitive state. Defence Research and Development Canada (2014)

    Google Scholar 

  7. Przybyło, J., Kańtoch, E., Augustyniak, P.: Eyetracking-based assessment of affect-related decay of human performance in visual tasks. Future Gener. Comput. Syst. 92, 504–515 (2019). ISSN 0167–739X

    Article  Google Scholar 

  8. Mokatren, M., Kuflik, T., Shimshoni, I.: Exploring the potential of a mobile eye tracker as an intuitive indoor pointing device: a case study in cultural heritage. Future Gener. Comput. Syst. 81, 528–541 (2018). ISSN 0167–739X

    Article  Google Scholar 

  9. Orlosky, J., Toyama, T., Sonntag, D., Kiyokawa, K.: Using eye-gaze and visualization to augment memory: a framework for improving context recognition and recall. In: Streitz, N., Markopoulos, P. (eds.) Proceedings of the 16th International Conference on Human-Computer Interaction. LNCS, vol. 8530, pp. 282–291. Springer (2014)

    Google Scholar 

  10. Pawlak, A., Gomółka, P., Kordos, D., Gomółka, Z.: Badanie mózgu pilota podczas lotów na symulatorze. Mechanika, 89 (2/17) (2017). https://doi.org/10.7862/rm.2017.18

  11. DeFanti, T.A., Dawe, G., Sandin, D.J., Schulze, J.P., Otto, P., Girado, J., Kuester, F., Smarr, L., Rao, R.: The StarCAVE, a third-generation CAVE and virtual reality OptIPortal. Future Gener. Comput. Syst. 25(2), 169–178 (2009)

    Article  Google Scholar 

  12. Seppelt, B.D., Lee, J.D.: Keeping the driver in the loop: dynamic feedback to support appropriate use of imperfect vehicle control automation. Int. J. Hum.-Comput. Stud. 125, 66–80 (2019)

    Article  Google Scholar 

  13. Causse, M., Lancelot, F., Maillant, J., Behrend, J., Cousy, M., Schneider, N.: Encoding decisions and expertise in the operator’s eyes: using eye-tracking as input for system adaptation. Int. J. Hum.-Comput. Stud. 125, 55–65 (2019)

    Article  Google Scholar 

  14. Thomas, P.R.: Performance, characteristics, and error rates of cursor control devices for aircraft cockpit interaction. Int. J. Hum.-Comput. Stud. 109, 41–53 (2018)

    Article  Google Scholar 

  15. Bouzekri, E., Canny, A., Fayollas, C., Martinie, C., Palanque, P., Barboni, E., Deleris, Y., Gris, C.: Engineering issues related to the development of a recommender system in a critical context: application to interactive cockpits. Int. J. Hum.-Comput. Stud. 121, 122–141 (2019)

    Article  Google Scholar 

  16. Gomolka, Z., Twarog, B., Zeslawska, E., Gomolka, P.: Cognitive perception of scenes of complex in the process of research eye-tracking studies. Elektronika 10, 5–9 (2018)

    Google Scholar 

  17. Gomolka, Z., Twarog, B., Krutys, P.: Prediction mechanism for the face tracking algorithm. Przeglad Elektrotechniczny 89(7), 202–205 (2013)

    Google Scholar 

  18. Krutys, P., Gomolka, Z., Twarog, B., Zeslawska, E.: Synchronization of the vector state estimation methods with unmeasurable coordinates for intelligent water quality monitoring systems in the river. J. Hydrol. (2019) https://doi.org/10.1016/j.jhydrol.2019.02.038. ISSN 0022-1694

    Article  Google Scholar 

Download references

Acknowledgment

The research and experiments were conducted in the Laboratory of Cognitive Science Research, Computer Graphics and Digital Image Processing Laboratory and Real Time Diagnostic Systems Laboratory at the Centre for Innovation and Transfer of Natural Sciences and Engineering Knowledge, University of Rzeszow as a result of EU project “Academic Centre of Innovation and Technical-Natural Knowledge Transfer” based on “Regional Operational Program for Subcarpathian Voivodship for years 2007-2013” Project No. UDA-RPPK.01.03.00-18-001/10-00.

Author information

Authors and Affiliations

  1. Faculty of Mathematics and Natural Sciences, University of Rzeszow, ul. Pigonia 1, 35-959, Rzeszow, Poland

    Zbigniew Gomolka & Boguslaw Twarog

  2. Faculty of Applied Informatics, Department of Applied Information, University of Information Technology and Management in Rzeszow, ul. Sucharskiego 2, 35-225, Rzeszow, Poland

    Ewa Zeslawska

  3. Rzeszow University of Technology, al. Powstańców Warszawy 8, 35-959, Rzeszów, Poland

    Damian Kordos

Authors
  1. Zbigniew Gomolka
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Boguslaw Twarog
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ewa Zeslawska
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Damian Kordos
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zbigniew Gomolka .

Editor information

Editors and Affiliations

  1. Wrocław University of Science and Technology, Wroclaw, Poland

    Wojciech Zamojski

  2. Wrocław University of Science and Technology, Wroclaw, Poland

    Jacek Mazurkiewicz

  3. Wrocław University of Science and Technology, Wroclaw, Poland

    Jarosław Sugier

  4. Wrocław University of Science and Technology, Wroclaw, Poland

    Tomasz Walkowiak

  5. Systems Research Institute, Polish Academy of Sciences, Warsaw, Poland

    Janusz Kacprzyk

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Gomolka, Z., Twarog, B., Zeslawska, E., Kordos, D. (2020). Registration and Analysis of a Pilot’s Attention Using a Mobile Eyetracking System. In: Zamojski, W., Mazurkiewicz, J., Sugier, J., Walkowiak, T., Kacprzyk, J. (eds) Engineering in Dependability of Computer Systems and Networks. DepCoS-RELCOMEX 2019. Advances in Intelligent Systems and Computing, vol 987. Springer, Cham. https://doi.org/10.1007/978-3-030-19501-4_21

Download citation

Publish with us

Policies and ethics

Search

Navigation