Application and comparison of several machine learning algorithms and their integration models in regression problems

  • Jui-Chan Huang
  • Kuo-Min KoEmail author
  • Ming-Hung Shu
  • Bi-Min Hsu
ATCI 2019


With the rapid development of machine learning technology, as a regression problem that helps people to find the law from the massive data to achieve the prediction effect, more and more people pay attention. Data prediction has become an important part of people’s daily life. Currently, the technology is widely used in many fields such as weather forecasting, medical diagnosis and financial forecasting. Therefore, the research of machine learning algorithms in regression problems is a research hotspot in the field of machine learning in recent years. However, real-world regression problems often have very complex internal and external factors, and various machine learning algorithms have different effects on scalability and predictive performance. In order to better study the application effect of machine learning algorithm in regression problem, this paper mainly adopts three common machine learning algorithms: BP neural network, extreme learning machine and support vector machine. Then, by comparing the effects of the single model and integrated model of these machine learning algorithms in the application of regression problems, the advantages and disadvantages of each machine learning algorithm are studied. Finally, the performance of each machine learning algorithm in regression prediction is verified by simulation experiments on four different data sets. The results show that the research on several machine learning algorithms and their integration models has certain feasibility and rationality.


Machine learning Regression problem BP neural network Extreme learning machine Support vector machine 


Compliance with ethical standards

Conflict of interest

We declare that we have no financial and personal relationships with other people or organizations that can inappropriately influence our work, and there is no professional or other personal interest of any nature or kind in any product, service and/or company that could be construed as influencing the position presented in, or the review of, the manuscript entitled.


  1. 1.
    Wu S, Wang L, Wu Z (2004) Prediction of port container throughput using improved grey model. Water Transp Manag 26(11):14–16Google Scholar
  2. 2.
    Wei F, Huang J (2010) Predictability of statistical downscaling of summer precipitation in eastern China. Acta Trop Meteorol 26(4):483–490Google Scholar
  3. 3.
    Zhang M, Zhang Y (2006) Container throughput forecast of Qingdao Port based on cubic exponential smoothing method. J Trop Meteorol Contain 07:37–39Google Scholar
  4. 4.
    Guo J, Huang W, Willians B (2014) Two adaptive Kalman filter approach for stochastic short-term traffic flow rate prediction and uncertainty quantification. Transp Res Part C Emerg Technol 43:50–64CrossRefGoogle Scholar
  5. 5.
    Xue JN, Shi ZK (2014) Short-time traffic flow prediction based on chaos time series theory. J Transp Syst Eng Inf Technol 8(5):68–72Google Scholar
  6. 6.
    Viana DR, Sansigolo CA (2016) Monthly and seasonal rainfall forecasting in Southern Brazil using multiple discriminant analysis. Weather Forecast 31(6):1947–1960CrossRefGoogle Scholar
  7. 7.
    Baser F, Demirhan F (2017) A fuzzy regression with support vector machine approach to the estimation of horizontal global solar radiation. Energy 123:229–240CrossRefGoogle Scholar
  8. 8.
    Jingjing H, Xiaolei H, Changyou Z (2016) Proactive service selection based on acquaintance model and LS-SVM. Neurocomputing 211:60–65CrossRefGoogle Scholar
  9. 9.
    Friedman JH (2001) Greedy function approximation: a gradient boosting machine. Ann Stat 29(5):1189–1232MathSciNetCrossRefGoogle Scholar
  10. 10.
    Duan J, Ding C, Lu Y et al (2017) Short-term passenger flow forecasting method for rail transit sites considering dynamic volatility. J Traffic Inf Saf 35(05):68–75Google Scholar
  11. 11.
    Ma X, Ding C, Luan S et al (2017) Prioritizing influential factors for freeway incident clearance time prediction using the gradient boosting decision trees method. IEEE Trans Intel Transp Syst 99:1–8Google Scholar
  12. 12.
    Makridakis S, Winkler RL (1983) Averages of forecasts-some empirical results. Manag Sci 29(9):987–996CrossRefGoogle Scholar
  13. 13.
    Granger CWJ, Ramanathan R (1984) Improved methods of combining. J Forecast 3:197–204CrossRefGoogle Scholar
  14. 14.
    Diebold FX, Pauly P (1987) Structural change and the combination forecast. J Forecast 6:21–40CrossRefGoogle Scholar
  15. 15.
    Fu G, Tang X, Zeng Y (1995) Research on generalized recursive variance reciprocal combination forecasting method. J Univ Electron Sci Technol China 24(2):211–217Google Scholar
  16. 16.
    Chen H (2001) Research on combined prediction model based on prediction validity. Prediction 20(3):72–73Google Scholar
  17. 17.
    Chen H, Hou D (2003) Combined forecasting model based on standard deviation for predictive validity. J Syst Eng 15(3):203–210MathSciNetGoogle Scholar
  18. 18.
    Jingrong D, Xiusi Y (1999) Research on nonlinear combination forecasting method based on fuzzy logic system. J Manag Sci 3:28–33Google Scholar
  19. 19.
    Dong J (2000) Research on nonlinear combination forecasting method based on wavelet network. J Syst Eng 4:383–388Google Scholar
  20. 20.
    Cao Y, Zhang D (2004) Nonlinear intelligent combination forecasting model and its application. J China Univ Min Technol 4:428–432Google Scholar
  21. 21.
    Liu C, Zhang Q (2007) Dynamic prediction of container throughput based on time series BP neural network. Water Transp Eng 1:4–7Google Scholar
  22. 22.
    Zhen Y, Hao M, Lu B et al (2015) Research on medium and long-term precipitation prediction model based on random forest. Hydropower Sci 6:6–10Google Scholar
  23. 23.
    Stoll S, Abbot-Smith K, Lieven E (2010) Lexically restricted utterances in Russian, German, and English child-directed speech. Cognit Sci 33(1):75–103CrossRefGoogle Scholar
  24. 24.
    Wu H, Liu G (2016) Forecast of Ningbo Port container sea-rail combined transportation based on grey RBF combined model. J Ningbo Univ (Nat Sci Ed) 29(4):123–127Google Scholar
  25. 25.
    Wen P, Wang T (2016) Research on container throughput prediction of Nantong port by combined model. China Bus Rev 8:138–141Google Scholar
  26. 26.
    Zhu Y (2016) Artificial intelligence revolution “combustion promoter”: machine learning. Sci Technol Rev 34(7):64–66Google Scholar
  27. 27.
    Ibrahim AO, Shamsuddin SM, Abraham A et al (2019) Adaptive memetic method of multi-objective genetic evolutionary algorithm for backpropagation neural network. Neural Comput Appl 4:1–18Google Scholar
  28. 28.
    Geng G, Luo X, Xiao Y (2005) Statistical learning theory and support vector machine. China Sci Technol Inf 12:178Google Scholar
  29. 29.
    Tan L, Liu H, Tan L (2014) Prediction and analysis of shanghai composite index based on extreme learning machine. J North China Univ Sci Technol 4:57–60Google Scholar
  30. 30.
    Xing X (2019) Ocean Mammalian sound recognition based on feature fusion. Rev Cient 29(3):653–664Google Scholar

Copyright information

© Springer-Verlag London Ltd., part of Springer Nature 2019

Authors and Affiliations

  • Jui-Chan Huang
    • 1
  • Kuo-Min Ko
    • 1
    Email author
  • Ming-Hung Shu
    • 2
    • 4
  • Bi-Min Hsu
    • 3
  1. 1.Yango UniversityFuzhouChina
  2. 2.Department of Industrial Engineering and ManagementNational Kaohsiung University of Science and TechnologyKaohsiung CityTaiwan
  3. 3.Department of Industrial Engineering and ManagementCheng Shiu UniversityKaohsiung CityTaiwan
  4. 4.Department of Healthcare Administration and Medical InformaticsKaohsiung Medical UniversityKaohsiung CityTaiwan

Personalised recommendations