Abstract
Mobility is one of the major dimensions of smart city design and development. Transportation analysis and prediction play important parts in mobility research and development. Recent years have seen many new types of transportation data emerging, such as social media and Global Positioning System (GPS) data. These data contains hidden knowledge, which can be used in many applications to improve city operations; road traffic prediction is one aspect of this. Researchers have traditionally used single traffic flow prediction methods, which work well only under specific conditions. Some work has emerged in recent years on combining these methods into various hybrid methods. However, this work is in its infancy, and further investigations are required. More importantly, these hybrid methods have mostly been developed on stand-alone, nondistributed platforms, limiting the data and problem sizes that can be addressed, as well as the accuracy that can be achieved. This chapter gives a review of traffic flow prediction and modeling methods and discusses the limitations of each method. A review of the various types of transportation traffic data sources is provided. Notable big data analysis tools, including the Apache Spark platform, are described. Finally, we describe a hybrid method for road traffic prediction and provide a tutorial on the process of hybrid traffic flow prediction. The hybrid method is based on the autoregressive integrated moving average (ARIMA) and support vector machine (SVM) methods.
Keywords
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Büscher, M., Coulton, P., Efstratiou, C., Gellersen, H., Hemment, D., Mehmood, R., Sangiorgi, D.: Intelligent mobility systems: some socio-technical challenges and opportunities. In: Communications Infrastructure. Systems and Applications in Europe, Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST 16. pp. 140–152 (2009)
Suma, S., Mehmood, R., Albugami, N., Katib, I., Albeshri, A.: Enabling next generation logistics and planning for smarter societies. In: Procedia Computer Science. pp. 1122–1127 (2017)
Suma, S., Mehmood, R., Albeshri, A.: Automatic event detection in smart cities using big data analytics. In: International Conference on Smart Cities, Infrastructure, Technologies and Applications (SCITA 2017): Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, Volume 224. pp. 111–122. Springer, Cham (2018)
Alomari, E., Mehmood, R.: Analysis of tweets in Arabic language for detection of road traffic conditions. In: Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, Volume 224. pp. 98–110. Springer, Cham (2018)
Ayres, G., Mehmood, R., Mitchell, K., Race, N.J.P.: Localization to enhance security and services in Wi-Fi networks under privacy constraints. In: Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, Volume 16. pp. 175–188. Springer (2009)
Ayres, G., Mehmood, R.: LocPriS: a security and privacy preserving location based services development framework. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), LNAI, Volume 6279, Part 4. pp. 566–575. Springer (2010)
Elmirghani, J.M.H., Badic, B., Li, Y., Liu, R., Mehmood, R., Wang, C., Xing, W., Garcia Zuazola, I.J., Jones, S.: IRIS: an intelligent radio-fibre telematics system. In: Proceedings of the 13th ITS World Congress, London, 8–12 October (2006)
Ayres, G., Mehmood, R.: On discovering road traffic information using virtual reality simulations. In: 11th International Conference on Computer Modelling and Simulation, UKSim 2009. pp. 411–416 (2009)
Mehmood, R.: Towards understanding intercity traffic interdependencies. In: 14th World Congress on Intelligent Transport Systems, ITS 2007. pp. 1793–1799. ITS America, Beijing (2007)
Mehmood, R., Nekovee, M.: Vehicular ad hoc and grid networks: discussion, design and evaluation. In: 14th World Congress on Intelligent Transport Systems, ITS 2007. pp. 1555–1562. ITS America, Beijing (2007)
Gillani, S., Shahzad, F., Qayyum, A., Mehmood, R.: A survey on security in vehicular ad hoc networks. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). pp. 59–74 (2013)
Alvi, A., Greaves, D., Mehmood, R.: Intra-vehicular verification and control: a two-pronged approach. In: 7th IEEE International Symposium on Communication Systems, Networks and Digital Signal Processing, CSNDSP 2010. pp. 401–405 (2010)
Schlingensiepen, J., Nemtanu, F., Mehmood, R., McCluskey, L.: Autonomic transport management systems—enabler for smart cities, personalized medicine, participation and industry Grid/Industry 4.0. In: Intelligent Transportation Systems—Problems and Perspectives, Volume 32 of the series Studies in Systems, Decision and Control. pp. 3–35. Springer (2016)
Schlingensiepen, J., Mehmood, R., Nemtanu, F.C.: Framework for an autonomic transport system in smart cities. Cybern. Inf. Technol. 15, 50–62 (2015)
Schlingensiepen, J., Mehmood, R., Nemtanu, F.C., Niculescu, M.: Increasing sustainability of road transport in European cities and metropolitan areas by facilitating autonomic road transport systems (ARTS). In: Wellnitz, J., Subic, A., Trufin, R. (eds.) Sustainable Automotive Technologies 2013 Proceedings of the 5th International Conference ICSAT 2013, pp. 201–210. Springer, Ingolstadt (2014)
Alam, F., Mehmood, R., Katib, I.: D2TFRS: an object recognition method for autonomous vehicles based on RGB and spatial values of pixels. In: Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, Volume 224. pp. 155–168. Springer, Cham (2018)
Alazawi, Z., Altowaijri, S., Mehmood, R., Abdljabar, M.B.: Intelligent disaster management system based on cloud-enabled vehicular networks. In: 2011 11th International Conference on ITS Telecommunications, ITST 2011. pp. 361–368. IEEE (2011)
Alazawi, Z., Abdljabar, M.B., Altowaijri, S., Vegni, A.M., Mehmood, R.: ICDMS: an intelligent cloud based disaster management system for vehicular networks. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), LNCS, Volume 7266. pp. 40–56. Springer, Vilnius (2012)
Alazawi, Z., Alani, O., Abdljabar, M.B., Altowaijri, S., Mehmood, R.: A smart disaster management system for future cities. In: Proceedings of the 2014 ACM International Workshop on Wireless and Mobile Technologies for Smart Cities—WiMobCity ’14. pp. 1–10. ACM, New York (2014)
Alazawi, Z., Alani, O., Abdljabar, M.B., Mehmood, R.: An intelligent disaster management system based evacuation strategies. In: 2014 9th International Symposium on Communication Systems, Networks and Digital Signal Processing, CSNDSP 2014. pp. 673–678 (2014)
Alazawi, Z., Alani, O., Abdljabar, M.B., Mehmood, R.: Transportation evacuation strategies based on VANET disaster management system. Procedia Econ. Financ. 18, 352–360 (2014)
Aqib, M., Mehmood, R., Albeshri, A., Alzahrani, A.: Disaster management in smart cities by forecasting traffic plan using deep learning and GPUs. In: Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, Volume 224. pp. 139–154 (2018)
Mehmood, R., Meriton, R., Graham, G., Hennelly, P., Kumar, M.: Exploring the influence of big data on city transport operations: a Markovian approach. Int. J. Oper. Prod. Manag. 37, 75–104 (2017)
Mehmood, R., Lu, J.A.: Computational Markovian analysis of large systems. J. Manuf. Technol. Manag. 22, 804–817 (2011)
Mehmood, R., Graham, G.: Big data logistics: a health-care transport capacity sharing model. In: Procedia Computer Science. pp. 1107–1114 (2015)
Arfat, Y., Mehmood, R., Albeshri, A.: Parallel shortest path graph computations of United States road network data on Apache Spark. In: Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, Volume 224. pp. 323–336. Springer, Cham (2018)
Arfat, Y., Aqib, M., Mehmood, R., Albeshri, A., Katib, I., Albogami, N., Alzahrani, A.: Enabling smarter societies through mobile big data fogs and clouds. Procedia Computer Science 109: 1128–1133 (2017)
Mehmood, R., Bhaduri, B., Katib, I., Chlamtac, I. eds: Smart Societies, Infrastructure, Technologies and Applications, Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering (LNICST), Volume 224. Springer, Cham (2018)
Petalas, Y.G., Ammari, A., Georgakis, P., Nwagboso, C.: A big data architecture for traffic forecasting using multi-source information. Presented at the (2017)
Via, C.E., Hall, P., Tech, V., States, U., Author, C.: Transport-domain applications of widely used data sources in the smart transportation: a survey Sina Dabiri. 1–52 (2018)
Hadi Hosseini, S., Hadi Hosseini, S., Rahimi-kian, A.: Traffic flow prediction using MI algorithm and considering noisy and data loss conditions: an application to Minnesota traffic flow prediction. 26, 393–403 (2014)
Gandewar, R., Phakatkar, A.: Classification approach for big data driven traffic flow prediction using apache spark. Int. Res. J. Eng. Technol. 4(9), 2395–2356 (2017)
Zhang, R., Shu, Y., Yang, Z., Cheng, P., Chen, J.: Hybrid traffic speed modeling and prediction using real-world data. In: 2015 IEEE International Congress on Big Data (BigData Congress), New York, pp. 230–237 (2015)
C.P.IJ. van Hinsbergen, J.W.C. van Lint, F.M.S.: Short term traffic prediction models deliverable DIIF-1a
Coifman, B.: Vehicle level evaluation of loop detectors and the remote traffic microwave sensor. J. Transp. Eng. 132, 213–226 (2006)
Hu, J.H.J., Cao, W.C.W., Luo, J.L.J., Yu, X.Y.X.: Dynamic modeling of urban population travel behavior based on data fusion of mobile phone positioning data and FCD. 2009 17th Int. Conf. Geoinformatics. 1–5 (2009)
Abidin, A.F., Kolberg, M., Hussain, A.: Integrating Twitter traffic information with Kalman filter models for public transportation vehicle arrival time prediction. In: Big-Data Analytics and Cloud Computing. pp. 67–82. Springer, Cham (2015)
Yan, D., Zhou, J., Zhao, Y., Wu, B.: Short-term subway passenger flow prediction based on ARIMA. Presented at the December (2018)
Gandewar, R.R., Phakatkar, A.G., Student, M.E.: Survey on classification and prediction approaches in traffic flow. Int. J. Innov. Res. Comput. Commun. Eng. 5, (2017)
Wang, Y., Li, L., Xu, X.: A piecewise hybrid of ARIMA and SVMs for short-term traffic flow prediction. In: International Conference on Neural Information Processing. pp. 493–502. Springer, Cham (2017)
Vasantha Kumar, S., Vanajakshi, L.: Short-term traffic flow prediction using seasonal ARIMA model with limited input data. Eur. Transp. Res. Rev. 21 (2015)
Ma, X., Tao, Z., Wang, Y., Yu, H., Wang, Y.: Long short-term memory neural network for traffic speed prediction using remote microwave sensor data. Transp. Res. Part C Emerg. Technol. 54, 187–197 (2015)
Yin, C., Lin, Y., Yang, C.: A classification and predication framework for taxi-hailing based on big data. In: International Conference on Intelligent Computing ICIC 2017: Intelligent Computing Methodologies. p. pp 747–758. Springer (2017)
Florido, E., Castaño, O., Troncoso, A., Martínez-Álvarez, F.: Data mining for predicting traffic congestion and its application to Spanish data. In: 10th International Conference on Soft Computing Models in Industrial and Environmental Applications. pp 341–351. Springer, Cham (2015)
Park, D., Rilett, L.R.: Forecasting freeway link travel times with a multilayer feedforward neural network. Comput. Civ. Infrastruct. Eng. 14, 357–367 (1999)
Pamuła, T.: CCIS 329—Traffic flow analysis based on the real data using neural networks. In: CCIS. pp. 364–371. Springer, Berlin (2012)
Ban, X., Guo, C., Li, G., Ban, X., Guo, C, Guo, C., Li, G.: Application of extreme learning machine on large scale traffic congestion prediction high-speed. In: Proceedings in Adaptation, Learning and Optimization. pp. 293–305. Springer, Cham (2016)
Deshpande, M., Bajaj, P.R.: Performance analysis of support vector machine for traffic flow prediction. In: 2016 International Conference on Global Trends in Signal Processing, Information Computing and Communication (ICGTSPICC). pp. 126–129. IEEE (2016)
Zhou, X., Wang, W., Yu, L., Zhou, X., Yu, Á.L., Wang, W., Lu, W.: Traffic flow analysis and prediction based on GPS data of floating cars. In: Lecture Notes in Electrical Engineering. pp. 497–508. Springer, Berlin (2012)
Li, Y., Huang, C., Jiang, J.: Research of bus arrival prediction model based on GPS and SVM. In: 2018 Chinese Control And Decision Conference (CCDC). pp. 575–579. IEEE (2018)
Hu, W., Yan, L., Liu, K., Wang, H.: A short-term traffic flow forecasting method based on the hybrid PSO-SVR. Neural. Process. Lett. 43, 155–172 (2016)
Shoro, A.G., Soomro, T.R.: Big data analysis: Ap spark perspective. Glob. J. Comput. Sci. Technol. 15, 7–14 (2015)
Meng, M., Shao, C.-F., Wong, Y.-D., Wang, B.-B., Li, H.-X.: A two-stage short-term traffic flow prediction method based on AVL and AKNN techniques. J. Cent. South Univ. 22, 779–786 (2015)
Xie, J., Choi, Y.-K.: Hybrid traffic prediction scheme for intelligent transportation systems based on historical and real-time data. Int. J. Distrib. Sens. Networks. 13, 1–11 (2017)
Li, K.-L., Zhai, C.-J., Xu, J.-M.: Short-term traffic flow prediction using a methodology based on ARIMA and RBF-ANN. In: 2017 Chinese Automation Congress (CAC). pp. 2804–2807. IEEE (2017)
Prathilothamai, M., Sree Lakshmi, A.M., Viswanthan, D.: Cost effective road traffic prediction model using apache spark. Indian J. Sci. Technol. 9, (2016). https://doi.org/10.17485/ijst/2016/v9i17/87334
Castro, P.S.., Zhang, D.., Li, S: Urban traffic modelling and prediction using large scale taxi GPS traces. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). pp. 57–72. Springer, Berlin (2012)
Wang, Y., Cao, J., Li, W., Gu, T., Shi, W.: Exploring traffic congestion correlation from multiple data sources. Pervasive Mob. Comput. 41, 470–483 (2017)
Usama, M., Liu, M., Chen, M.: Job schedulers for big data processing in Hadoop environment: testing real-life schedule with benchmark programs. Digit. Commun. Networks. 3(4), 260–273 (2017)
Deng, Z., Bai, Y.: Floating car data processing model based on Hadoop-GIS tools. In: 2016 Fifth International Conference on Agro-Geoinformatics (Agro-Geoinformatics). pp. 1–4. IEEE (2016)
Karau, H., Konwinski, A., Wendell, P., Zaharia, M.: Learning spark: lightning-fast big data analysis. (2015)
Zeng, D., Xu, J., Gu, J., Liu, L., Xu, G.: Short term traffic flow prediction using hybrid ARIMA and ANN models. In: 2008 Workshop on Power Electronics and Intelligent Transportation System. pp. 621–625. IEEE (2008)
Yang, Y., Lu, H.: Short-term traffic flow combined forecasting model based on SVM. In: 2010 International Conference on Computational and Information Sciences. pp. 262–265. IEEE (2010)
Acknowledgements
The work carried out in this chapter is supported by the High Performance Computing (HPC) Center at the King Abdulaziz University, Jeddah.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Alsolami, B., Mehmood, R., Albeshri, A. (2020). Hybrid Statistical and Machine Learning Methods for Road Traffic Prediction: A Review and Tutorial. In: Mehmood, R., See, S., Katib, I., Chlamtac, I. (eds) Smart Infrastructure and Applications. EAI/Springer Innovations in Communication and Computing. Springer, Cham. https://doi.org/10.1007/978-3-030-13705-2_5
Download citation
DOI: https://doi.org/10.1007/978-3-030-13705-2_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-13704-5
Online ISBN: 978-3-030-13705-2
eBook Packages: EngineeringEngineering (R0)