Layerwise Recurrent Autoencoder for Real-World Traffic Flow Forecasting

  • Junhui Zhao
  • Tianqi Zhu
  • Ruidong Zhao
  • Peize ZhaoEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11936)


Accurate spatio-temporal traffic forecasting is a fundamental task for wide applications in city management, transportation area and financial domain. There are many factors that make this significant task also challenging, like: (1) maze-like road network makes the spatial dependency complex; (2) the relationship between traffic flow and time brings non-linear temporal problem; (3) with the larger road network, the difficulty of flow forecasting grows. The prevalent and state-of-the-art methods have mainly been discussed on datasets covering relatively small districts and short time span. To forecast the traffic flow across a wider area and overcome the mentioned challenges, Layerwise Recurrent Autoencoder (LRA) is designed and proposed, in which a three-layer stacked autoencoder (SAE) architecture is used to obtain temporal traffic correlations in three different time scales and for each output of different time scales, a dedicate neural network is used for prediction. The convolutional neural networks (CNN) model is also employed to extract spatial traffic information within the road map for more accurate prediction. To the best of our knowledge, there is no effective method for traffic flow prediction which concerns traffic of city group and LRA is the first one. The experiment is completed on a large real-world traffic dataset to show the performance of the proposed. In the end, evaluations show that our model outperforms the state-of-the-art baselines by 6%–15%.


Traffic forecasting Neural networks Stacked autoencoder 


  1. 1.
    Abadi, M., et al.: Tensorflow: a system for large-scale machine learning. In: OSDI, vol. 16, pp. 265–283 (2016)Google Scholar
  2. 2.
    Atwood, J., Towsley, D.: Diffusion-convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1993–2001 (2016)Google Scholar
  3. 3.
    Box, G.E., Jenkins, G.M.: Time Series Analysis: Forecasting and Control. Wiley, Hoboken (1970)zbMATHGoogle Scholar
  4. 4.
    Box, G.E., Jenkins, G.M., Reinsel, G.C., Ljung, G.M.: Time Series Analysis: Forecasting and Control. Wiley, Hoboken (2015)zbMATHGoogle Scholar
  5. 5.
    Cascetta, E.: Transportation Systems Engineering: Theory and Methods, vol. 49. Springer, Heidelberg (2013)zbMATHGoogle Scholar
  6. 6.
    Cheng, X., Zhang, R., Zhou, J., Xu, W.: Deeptransport: Learning spatial-temporal dependency for traffic condition forecasting. arXiv preprint arXiv:1709.09585 (2017)
  7. 7.
    Defferrard, M., Bresson, X., Vandergheynst, P.: Convolutional neural networks on graphs with fast localized spectral filtering. In: Advances in Neural Information Processing Systems, pp. 3844–3852 (2016)Google Scholar
  8. 8.
    Deng, D., Shahabi, C., Demiryurek, U., Zhu, L., Yu, R., Liu, Y.: Latent space model for road networks to predict time-varying traffic. In: Proceedings of the 22nd ACM SIGKDD, pp. 1525–1534. ACM (2016)Google Scholar
  9. 9.
    Drew, D.R.: Traffic flow theory and control. Technical report (1968)Google Scholar
  10. 10.
    Gers, F.A., Schraudolph, N.N., Schmidhuber, J.: Learning precise timing with LSTM recurrent networks. J. Mach. Learn. Res. 3(Aug), 115–143 (2002)MathSciNetzbMATHGoogle Scholar
  11. 11.
    Hammond, D.K., Vandergheynst, P., Gribonva, R.: Wavelets on graphs via spectral graph theory. Appl. Comput. Harmon. Anal. 30(2), 129–150 (2011)MathSciNetCrossRefGoogle Scholar
  12. 12.
    Ilies, I., Jaeger, H., Kosuchinas, O., Rincon, M., Sakenas, V., Vaskevicius, N.: Stepping forward through echoes of the past: forecasting with echo state networks. Technical report (2007)Google Scholar
  13. 13.
    Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: International Conference on Learning Representations (ICLR) (2017)Google Scholar
  14. 14.
    Laptev, N., Yosinski, J., Li, L.E., Smyl, S.: Time-series extreme event forecasting with neural networks at uber. In: International Conference on Machine Learning, vol. 34, pp. 1–5 (2017)Google Scholar
  15. 15.
    Lee, S., Fambro, D.: Application of subset autoregressive integrated moving average model for short-term freeway traffic volume forecasting. Transp. Res. Rec.: J. Transp. Res. Board 1678, 179–188 (1999)CrossRefGoogle Scholar
  16. 16.
    Li, Y., Yu, R., Shahabi, C., Liu, Y.: Diffusion convolutional recurrent neural network: Data-driven traffic forecasting. In: International Conference on Learning Representations (ICLR) (2018)Google Scholar
  17. 17.
    Lippi, M., Bertini, M., Frasconi, P.: Short-term traffic flow forecasting: an experimental comparison of time-series analysis and supervised learning. IEEE Trans. Intell. Transp. Syst. 14(2), 871–882 (2013)CrossRefGoogle Scholar
  18. 18.
    Lv, Y., Duan, Y., Kang, W., Li, Z., Wang, F.Y., et al.: Traffic flow prediction with big data: A deep learning approach. IEEE Trans. Intell. Transp. Syst. 16(2), 865–873 (2015)Google Scholar
  19. 19.
    Ma, X., Dai, Z., He, Z., Ma, J., Wang, Y., Wang, Y.: Learning traffic as images: a deep convolutional neural network for large-scale transportation network speed prediction. Sensors 17(3), 818 (2017)CrossRefGoogle Scholar
  20. 20.
    Moorthy, C., Ratcliffe, B.: Short term traffic forecasting using time series methods. Transp. Plann. Technol. 12(1), 45–56 (1988)CrossRefGoogle Scholar
  21. 21.
    Seo, Y., Defferrard, M., Vandergheynst, P., Bresson, X.: Structured sequence modeling with graph convolutional recurrent networks. arXiv preprint arXiv:1612.07659 (2016)
  22. 22.
    Sun, S., Zhang, C., Yu, G.: A bayesian network approach to traffic flow forecasting. IEEE Trans. Intell. Transp. Syst. 7(1), 124–132 (2006)CrossRefGoogle Scholar
  23. 23.
    Williams, B.M., Hoel, L.A.: Modeling and forecasting vehicular traffic flow as a seasonal arima process: Theoretical basis and empirical results. J. Transp. Eng. 129(6), 664–672 (2003)CrossRefGoogle Scholar
  24. 24.
    Williams, B.M., Hoel, L.A.: Space-time modeling of traffic flow. Comput. Geosci. 31(2), 119–133 (2005)CrossRefGoogle Scholar
  25. 25.
    Yu, H.F., Rao, N., Dhillon, I.S.: Temporal regularized matrix factorization for high-dimensional time series prediction. In: Advances in Neural Information Processing Systems, pp. 847–855 (2016)Google Scholar
  26. 26.
    Yu, R., Li, Y., Shahabi, C., Demiryurek, U., Liu, Y.: Deep learning: a generic approach for extreme condition traffic forecasting. In: Proceedings of the 2017 SIAM International Conference on Data Mining (SDM), pp. 777–785 (2017)CrossRefGoogle Scholar
  27. 27.
    Zhang, J., Zheng, Y., Qi, D.: Deep spatio-temporal residual networks for citywide crowd flows prediction. In: AAAI, pp. 1655–1661 (2017)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Junhui Zhao
    • 1
  • Tianqi Zhu
    • 1
  • Ruidong Zhao
    • 1
  • Peize Zhao
    • 1
    Email author
  1. 1.Beijing University of Posts and TelecommunicationsBeijingChina

Personalised recommendations