Advertisement

A Comparison of Extreme Gradient Boosting and Convolutional Neural Network-Long Short-Term Memory for Service Demand Forecasting

  • Manop PhankokkruadEmail author
  • Sirirat Wacharawichanant
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 1074)

Abstract

The accurate demand forecasting gives powerful insights on amount of the available resources should be allocated for the operation and can improve the effectiveness of the management to assure the completeness of the services. This work studied to forecast the number of patients, that applied for service demand forecasting. We proposed the comparison between XGBoost model and CNN-LSTM model for service demand forecasting. We created the XGBoost model and configured the optimal parameters by using grid search optimization techniques. In the same way, the CNN-LSTM model was constructed and adjusted the layers in the network structure. Later, the model has configured the optimal parameters obtained from the grid search optimization techniques. Both models were applied to two different datasets for forecasting the number of patients in the future. The results indicated that two models had skillful, and made the reliable forecasting in two datasets. This work evaluated and measured the model performance by calculating RMSE, and sMAPE, which was acceptable in all case study. The CNN-LSTM model gave better efficiency forecasting than XGBoost model. In contrast, XGBoost model operated faster, took a lower performing time, and lower CPU consumption than the CNN-LSTM model.

References

  1. 1.
    Xinxiang, Z., Bo, Z., Huijuan, F.: A comparison study of outpatient visits forecasting effect between ARIMA with seasonal index and SARIMA. In: 2017 International Conference on Progress in Informatics and Computing (PIC), pp. 362–366, December 2017Google Scholar
  2. 2.
    Qingkui, C., Junhu, R.: Study on the demand forecasting of hospital stocks based on data mining and BP neural networks. In: 2009 International Conference on Electronic Commerce and Business Intelligence, pp. 284–289, June 2009Google Scholar
  3. 3.
    Friedman, J.H.: Greedy function approximation: a gradient boosting machine. Ann. Stat. 29(5), 1189–1232 (2000)MathSciNetCrossRefGoogle Scholar
  4. 4.
    Freund, Y., Schapire, R.E.: A decision-theoretic generalization of on-line learning and an application to boosting. J. Comput. Syst. Sci. 55(1), 119–139 (1997)MathSciNetCrossRefGoogle Scholar
  5. 5.
    Chen, T., Guestrin, C.: XGBoost: a scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2016, pp. 785–794. ACM, New York (2016)Google Scholar
  6. 6.
    Breiman, L.: Arcing the edge. Statistics Department, University of California at Berkeley, Technical report (1997)Google Scholar
  7. 7.
    Pedamonti, D.: Comparison of non-linear activation functions for deep neural networks on MNIST classification task. CoRR abs/1804.02763 (2018)Google Scholar
  8. 8.
    Klambauer, G., Unterthiner, T., Mayr, A., Hochreiter, S.: Self-normalizing neural networks. CoRR abs/1706.02515 (2017)Google Scholar
  9. 9.
    Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)CrossRefGoogle Scholar
  10. 10.
    Styan, G.P.: Hadamard products and multivariate statistical analysis. Linear Algebra Appl. 6, 217–240 (1973)MathSciNetCrossRefGoogle Scholar
  11. 11.
    Hyndman, R.J., Koehler, A.B.: Another look at measures of forecast accuracy. Int. J. Forecast. 22(4), 679–688 (2006)CrossRefGoogle Scholar
  12. 12.
    Granderson, J., Price, P.N., Jump, D., Addy, N., Sohn, M.D.: Automated measurement and verification: performance of public domain whole-building electric baseline models. Appl. Energy 144, 106–113 (2015)CrossRefGoogle Scholar
  13. 13.
    Hastie, T., Montanari, A., Rosset, S., Tibshirani, R.J.: Surprises in high-dimensional ridgeless least squares interpolation. CoRR abs/1903.08560 (2019)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Faculty of Information TechnologyKing Mongkut’s Institute of Technology LadkrabangBangkokThailand
  2. 2.Department of Chemical Engineering, Faculty of Engineering and Industrial TechnologySilpakorn UniversityNakhon PathomThailand

Personalised recommendations