Abstract
The paper is a continuation of the works [1,2,3,4] where has been shown how the technologies of machine learning and online analytical processing (OLAP) could be used in conjunction with the numerical model of convective cloud for forecasting dangerous convective phenomena such as thunderstorm, heavy rainfall and hail. We study specifically the possibility of making predictions via a hybrid approach that combines the predictive numerical model of convective cloud with the modern methods of big data processing. We overview the existing examples of using of machine learning tools for weather forecasting and discuss the range of their applicability.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Petrov, D.A., Stankova, E.N.: Use of consolidation technology for meteorological data processing. In: Murgante, B., Misra, S., Rocha, A.M.A.C., Torre, C., Rocha, J.G., Falcão, M.I., Taniar, D., Apduhan, B.O., Gervasi, O. (eds.) ICCSA 2014. LNCS, vol. 8579, pp. 440–451. Springer, Cham (2014). doi:10.1007/978-3-319-09144-0_30
Petrov, D.A., Stankova, E.N.: Integrated information system for verification of the models of convective clouds. In: Gervasi, O., Murgante, B., Misra, S., Gavrilova, M.L., Rocha, A.M.A.C., Torre, C., Taniar, D., Apduhan, B.O. (eds.) ICCSA 2015. LNCS, vol. 9158, pp. 321–330. Springer, Cham (2015). doi:10.1007/978-3-319-21410-8_25
Stankova, E.N., Petrov, D.A.: Complex information system for organization of the input data of models of convective clouds. Appl. Math. Comput. Sci. Control Process. 10(3), 83–95 (2015). Vestnik of Saint-Petersburg University. (in Russian)
Stankova, E.N., Balakshiy, A.V., Petrov, D.A., Shorov, A.V., Korkhov, V.V.: Using technologies of OLAP and machine learning for validation of the numerical models of convective clouds. In: Gervasi, O., Murgante, B., Misra, S., Rocha, A.M.A.C., Torre, C., Taniar, D., Apduhan, B.O., Stankova, E., Wang, S. (eds.) ICCSA 2016. LNCS, vol. 9788, pp. 463–472. Springer, Cham (2016). doi:10.1007/978-3-319-42111-7_36
Grover, A., Kapoor, A., Horvitz, E.: A Deep Hybrid Model for Weather Forecasting (2015). http://research.microsoft.com/en-us/um/people/horvitz/weather_hybrid_representation.pdf. Accessed 13 Aug 2016
Meteum technology. https://yandex.ru/pogoda/meteum. Accessed 17 Jan 2017. (in Russian)
The Weather Company Launches ‘Deep Thunder’ - the World’s Most Advanced Hyper-Local Weather Forecasting Model for Businesses https://www-03.ibm.com/press/us/en/pressrelease/49954.wss. Accessed 15 June 2016
Using Amazon Machine Learning to Predict the Weather. https://arnesund.com/2015/05/31/using-amazon-machine-learning-to-predict-the-weather/. Accessed 20 Feb 2017
Tutorial: Using Amazon ML to Predict Responses to a Marketing Offer. http://docs.aws.amazon.com/machine-learning/latest/dg/tutorial.html. Accessed 10 Mar 2017
How Yandex predicts the weather. https://yandex.ru/company/technologies/meteum/. Accessed 17 Jan 2017. (in Russian)
Weather Research and Forecasting Model. http://www.wrf-model.org/index.php. Accessed 7 Mar 2017
Matrixnet. https://yandex.ru/company/technologies/matrixnet/. Accessed 26 Nov 2016. (in Russian)
Grover, A., Kapoor, A., Horvitz, E.: A Deep Hybrid Model for Weather Forecasting (2015). http://research.microsoft.com/en-us/um/people/horvitz/weather_hybrid_representation.pdf. Accessed 13 Aug 2016
Hastie, T., Tibshirani, R., Friedman, J.: The elements of Statistical Learning (2009). http://statweb.stanford.edu/~tibs/ElemStatLearn/. Accessed 15 Feb 2015
Mitchell, T.: Machine Learning. Springer, Berlin (2009)
Codd, E.: Providing OLAP (on-line analytical processing) to user-analysts: an IT mandate, Technical report, E.F. Codd and Associates (1993)
Raba, N., Stankova, E.: Research of influence of compensating descending flow on cloud’s life cycle by means of 1.5-dimensional model with 2 cylinders. Proc. MGO 559, 192–209 (2009). (in Russian)
Raba, N., Stankova, E., Ampilova, N.: On investigation of parallelization effectiveness with the help of multi-core processors. Procedia Comput. Sci. 1(1), 2757–2762 (2010)
Raba, N., Stankova, E.: On the possibilities of multi-core processor use for real-time forecast of dangerous convective phenomena. In: Taniar, D., Gervasi, O., Murgante, B., Pardede, E., Apduhan, Bernady O. (eds.) ICCSA 2010. LNCS, vol. 6017, pp. 130–138. Springer, Heidelberg (2010). doi:10.1007/978-3-642-12165-4_11
Raba, N.O., Stankova, E.N.: On the Problem of Numerical Modeling of Dangerous Convective Phenomena: Possibilities of Real-Time Forecast with the Help of Multi-core Processors. In: Murgante, B., Gervasi, O., Iglesias, A., Taniar, D., Apduhan, Bernady O. (eds.) ICCSA 2011. LNCS, vol. 6786, pp. 633–642. Springer, Heidelberg (2011). doi:10.1007/978-3-642-21934-4_51
Raba, N.O., Stankova, E.N.: On the effectiveness of using the GPU for numerical solution of stochastic collection equation. In: Murgante, B., Misra, S., Carlini, M., Torre, Carmelo M., Nguyen, H.-Q., Taniar, D., Apduhan, Bernady O., Gervasi, O. (eds.) ICCSA 2013. LNCS, vol. 7975, pp. 248–258. Springer, Heidelberg (2013). doi:10.1007/978-3-642-39640-3_18
Scikit-learn: Machine Learning in Python. http://scikit-learn.org/
Jedox. http://www.jedox.com/. Accessed 21 Nov 2015
Gankevich, I., Korkhov, V., Balyan, S., Gaiduchok, V., Gushchanskiy, D., Tipikin, Y., Degtyarev, A., Bogdanov, A.: Constructing virtual private supercomputer using virtualization and cloud technologies. In: Murgante, B., Misra, S., Rocha, Ana Maria A.C., Torre, C., Rocha, J.G., Falcão, M.I., Taniar, D., Apduhan, Bernady O., Gervasi, O. (eds.) ICCSA 2014. LNCS, vol. 8584, pp. 341–354. Springer, Cham (2014). doi:10.1007/978-3-319-09153-2_26
Gankevich, I., Gaiduchok, V., Gushchanskiy, D., Tipikin, Y., Korkhov, V., Degtyarev, A., Bogdanov, A., Zolotarev, V.: Virtual private supercomputer: design and evaluation. In: Computer Science and Information Technologies (CSIT), pp 1–6. IEEE Conference Publications (2013). doi:10.1109/CSITechnol.2013.6710358
Acknowledgment
This research was sponsored by the Russian Foundation for Basic Research under the projects: No. 16-07-01113.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Stankova, E.N., Grechko, I.A., Kachalkina, Y.N., Khvatkov, E.V. (2017). Hybrid Approach Combining Model-Based Method with the Technology of Machine Learning for Forecasting of Dangerous Weather Phenomena. In: Gervasi, O., et al. Computational Science and Its Applications – ICCSA 2017. ICCSA 2017. Lecture Notes in Computer Science(), vol 10408. Springer, Cham. https://doi.org/10.1007/978-3-319-62404-4_37
Download citation
DOI: https://doi.org/10.1007/978-3-319-62404-4_37
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-62403-7
Online ISBN: 978-3-319-62404-4
eBook Packages: Computer ScienceComputer Science (R0)