Skip to main content

The Application of Improved Grasshopper Optimization Algorithm to Flight Delay Prediction–Based on Spark

  • Conference paper
  • First Online:
Complex, Intelligent and Software Intensive Systems (CISIS 2021)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 278))

Included in the following conference series:

Abstract

Flight delay prediction can improve the quality of airline services, help air traffic control agencies to develop more accurate flight plans. This paper proposes a distributed and improved grasshopper optimization algorithm based on Spark to optimize the classification model of random forest parameters (SPGOA-RF) for flight delay prediction. The SPGOA-RF uses the method of adaptive chaotic descent which based on Logistic mapping and Sigmoid curve to enhance the randomness of the grasshopper optimization algorithm, thereby improve the early exploration and later optimization capabilities of the algorithm and accelerate the speed of convergence. The improved grasshopper optimization algorithm is used to adjust the random forest parameters to obtain a better performance classification model. In addition, the Spark platform is used to implement a distributed grasshopper optimization algorithm training model to effectively improve its operating efficiency. The results of simulation experiment prove that in comparison to the unoptimized algorithm, the SPGOA-RF flight delay prediction accuracy rate could achieve to 89.17%.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Niu, B., Dai, Z., Zhuo, X.: Coopetition effect of promised delivery time sensitive demand on air cargo carriers’ big data investment and demand signal sharing decisions. Transp. Res. Part E: Logist. Transp. Rev. 123, 29–44 (2019)

    Article  Google Scholar 

  2. Anderson, S.W., Baggett, L.S., Widener, S.K.: The impact of service operations failures on customer satisfaction: evidence on how failures and their source affect what matters to customers. Manuf. Serv. Oper. Manag. 11(1), 52–69 (2009)

    Article  Google Scholar 

  3. Tu, Y., Ball, M.O., Jank, W.S.: Estimating flight departure delay distributions—a statistical approach with long-term trend and short-term pattern. J. Am. Stat. Assoc. 103(481), 112–125 (2008)

    Article  MathSciNet  Google Scholar 

  4. Kafle, N., Zou, B.: Modeling flight delay propagation: a new analytical-econometric approach. Trans. Res. Part B: Methodol. 93, 520–542 (2016)

    Article  Google Scholar 

  5. Sternberg, A., Soares, J., Carvalho, D., Ogasawara, E.: A review on flight delay prediction. arXiv preprint arXiv:1703.06118 (2017)

  6. Kim, Y.J., Choi, S., Briceno, S., et al.: A deep learning approach to flight delay prediction. In: 2016 IEEE/AIAA 35th Digital Avionics Systems Conference (DASC), Sacramento, CA, pp. 1–6. IEEE (2016)

    Google Scholar 

  7. Nigam, R., Govinda, K.: Cloud based flight delay prediction using logistic regression. In: 2017 International Conference on Intelligent Sustainable Systems (ICISS), Palladam, pp. 662–667. IEEE (2017)

    Google Scholar 

  8. Yu, B., Guo, Z., Asian, S., Wang, H., Chen, G.: Flight delay prediction for commercial air transport: a deep learning approach. Transp. Res. Part E: Logist. Transp. Rev. 125, 203–221 (2019)

    Article  Google Scholar 

  9. Ding, Y.: Predicting flight delay based on multiple linear regression. In: IOP Conference Series: Earth and Environmental Science, Zhuhai, China, pp. 1–7 (2017)

    Google Scholar 

  10. Saremi, S., Mirjalili, S., Lewis, A.: Grasshopper optimization algorithm: theory and application. Adv. Eng. Softw. 105, 30–47 (2017)

    Article  Google Scholar 

  11. Arora, S., Anand, P.: Chaotic grasshopper optimization algorithm for global optimization. Neural Comput. Appl. 31(8), 4385–4405 (2018). https://doi.org/10.1007/s00521-018-3343-2

    Article  Google Scholar 

  12. Armbrust, M., Xin, R.S., Lian, C., et al.: Spark SQL: relational data processing in spark. In: Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data, New York, USA, pp. 1383–1394 (2015)

    Google Scholar 

  13. Liaw, A., Wiener, M.: Classification and regression by random Forest. R News 2(3), 18–22 (2002)

    Google Scholar 

  14. Dua, D., Graff, C.: UCI Machine Learning Repository. http://archive.ics.uci.edu/ml

Download references

Acknowledgments

This research is supported by National Natural Science Foundation of China under grant number 61602162, 61772180.

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Chen, H., Tu, S., Xu, H. (2021). The Application of Improved Grasshopper Optimization Algorithm to Flight Delay Prediction–Based on Spark. In: Barolli, L., Yim, K., Enokido, T. (eds) Complex, Intelligent and Software Intensive Systems. CISIS 2021. Lecture Notes in Networks and Systems, vol 278. Springer, Cham. https://doi.org/10.1007/978-3-030-79725-6_8

Download citation

Publish with us

Policies and ethics