Abstract
In the Big Data era, large volumes of data are continuously and rapidly generated from sensor networks, social network, the Internet, etc. Learning knowledge from streaming Big Data is an important task since it can support online decision making. Prediction is one of the useful learning task but a fixed model usually does not work well because of the data distribution change over time. In this paper, we propose a streaming data prediction method based on evolving Bayesian network. The Bayesian network model is inferred based on Gaussian mixture model and EM algorithm. To support evolving model structure and parameters based on streaming data, an evolving hill-climbing algorithm is proposed which is based on incremental calculation of score metric when new data is arrived. The experimental evaluations show that this method is effective and it outperforms other popular methods for streaming data prediction.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
PeMS project, https://pems.eecs.berkeley.edu/.
References
Huang, W., Song, G., Hong, H., et al.: Deep architecture for traffic flow prediction - deep belief networks with multitask learning. IEEE Trans. Intell. Transp. Syst. 15(5), 2191–2201 (2014)
Zhu, S., Cheng, L., Chu, Z.: A Bayesian network model for traffic flow estimation using prior link flows. J. Southeast Univ. (English edn.) 29(3), 322–327 (2013)
Angelov, P.: Autonomous Learning Systems: From Data Streams to Knowledge in Real-time. Wiley Press (2013)
Li, T.: PICKT: a solution for big data analysis. In: Proceeding of the 10th International Conference on Rough Sets and Knowledge Technology, Tianjin, China, pp. 15–25 (2015)
Yevgeniy, B., Olena, V., Iryna, P., et al.: Fast learning algorithm for deep evolving GMDH-SVM neural network in data stream mining tasks. In: Proceeding of the IEEE First International Conference on Data Stream Mining & Processing, Lviv, Ukraine, pp. 257–262 (2016)
Shtarkov, Y.M.: Universal sequential coding of single messages. Probl. Inf. Transm. 23(3), 3–17 (1987)
Heckerman, D., Geiger, D., Chickering, D.M.: Learning bayesian networks: the combination of knowledge and statistical data. Mach. Learn. 20(3), 197–243 (1995)
Pascale, A., Nicoli, M.: Adaptive Bayesian network for traffic flow prediction. In: Proceeding of the Statistical Signal Processing Workshop (SSP), pp. 177–180. IEEE (2011)
Robinson, J.W., Hartemink, A.J.: Learning non-stationary dynamic Bayesian networks. J. Mach. Learn. Res. 11, 3647–3680 (2010)
Yue, K., Fang, Q., Wang, X., et al.: A parallel and incremental approach for data-intensive learning of Bayesian networks. IEEE Trans. Cybern. 45(12), 2890–2904 (2015)
Acharya, S., Lee, B.: Causal network construction over event streams. Inf. Sci. 261, 32–51 (2014)
Bishop, C.: Pattern Recognition and Machine Learning, 2nd edn. Springer, New York (2010)
Tsamardinos, I., Brown, L.E., Aliferis, C.F.: The max-min hill-climbing Bayesian network structure learning algorithm. Mach. Learn. 65(1), 31–78 (2006)
Behrisch, M., Bieker, L., Erdmann, J., et al.: Sumo - simulation of urban mobility: an overview. In: Proceeding of the Third International Conference on Advances in System Simulation (SIMUL 2011), Barcelona, Spain, 23 October 23, pp. 63–68 (2011)
Acknowledgments
This work is supported by the National Natural Science Foundation of China (No.61371116).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Wang, Y., Chen, G., Wang, Z. (2017). A Streaming Data Prediction Method Based on Evolving Bayesian Network. In: Chen, L., Jensen, C., Shahabi, C., Yang, X., Lian, X. (eds) Web and Big Data. APWeb-WAIM 2017. Lecture Notes in Computer Science(), vol 10367. Springer, Cham. https://doi.org/10.1007/978-3-319-63564-4_24
Download citation
DOI: https://doi.org/10.1007/978-3-319-63564-4_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-63563-7
Online ISBN: 978-3-319-63564-4
eBook Packages: Computer ScienceComputer Science (R0)