Predictive Analytics in Future Power Systems: A Panorama and State-Of-The-Art of Deep Learning Applications

  • Sakshi MishraEmail author
  • Andrew Glaws
  • Praveen Palanisamy
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 1123)


The challenges surrounding the optimal operation of power systems are growing in various dimensions, due in part to increasingly distributed energy resources and a progression towards large-scale transportation electrification. Currently, the increasing uncertainties associated with both renewable energy generation and demand are largely being managed by increasing operational reserves—potentially at the cost of suboptimal economic conditions—in order to maintain the reliability of the system. This chapter looks at the big picture role of forecasting in power systems from generation to consumption and provides a comprehensive review of traditional approaches for forecasting generation and load in various contexts. This chapter then takes a deep dive into the state-of-the-art machine learning and deep learning approaches for power systems forecasting. Furthermore, a case study of multi-time-horizon solar irradiance forecasting using deep learning is discussed in detail. Smart grids form the backbone of the future interdependent networks. For addressing the challenges associated with the operations of smart grid, development and wide adoption of machine learning and deep learning algorithms capable of producing better forecasting accuracies is urgently needed. Along with exploring the implementation and benefits of these approaches, this chapter also considers the strengths and limitations of deep learning algorithms for power systems forecasting applications. This chapter, thus, provides a panoramic view of state-of-the-art of predictive analytics in power systems in the context of future smart grid operations.


Smart grid Deep learning Predictive analytic Machine learning Time series Energy forecast Power systems 



The authors wish to thank Kate Anderson and Adam Warren (National Renewable Energy Laboratory) for the encouragement to pursue this research work. The authors would also like to thank Manajit Sengupta and Ryan King (National Renewable Energy Laboratory) for providing useful suggestions to refine the manuscript. This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors. The views expressed in the article do not necessarily represent the views of the DOE or the U.S. Government.


  1. 1.
    M. Shahidhpour, H. Yamin, Z. Li, Market Operations in Electric Power Systems: Forecasting, Scheduling, and Risk Management (Wiley-IEEE Press, Hoboken, 2002)CrossRefGoogle Scholar
  2. 2.
    Federal Energy Regulatory Commission, Order no. 1000 - Transmission planning and cost allocation, 21 July 2011. (Online). Accessed 27 June 2019
  3. 3.
    I. Penn, P. Eavis, J. Glanz, How PG&E ignored fire risks in favor of profits, New York Times, 2019Google Scholar
  4. 4.
    H. Chen, Y. Zhang, H. Ngan, Power System Planning, in Power System Optimization: Large-Scale Complex Systems Approaches (Wiley, Singapore, 2016), pp. 76–130Google Scholar
  5. 5.
    A.S. Malik, C. Kuba, Power generation expansion planning including large scale wind integration: a case study of Oman. J. Wind Energy 2013, 1 (2013)CrossRefGoogle Scholar
  6. 6.
    M. Child, C. Kemfert, D. Bogdanov, C. Breyer, Flexible electricity generation, grid exchange and storage for the transition to a 100% renewable energy system in Europe. Renew. Energy 139, 80–101 (2019)CrossRefGoogle Scholar
  7. 7.
    I.F. Abdin, E. Zio, An integrated framework for operational flexibility assessment in multi-period power system planning with renewable energy production. Appl. Energy 222, 898–914 (2018)CrossRefGoogle Scholar
  8. 8.
    O.J. Guerra, D.A. Tejada, G.V. Reklaitis, An optimization framework for the integrated planning of generation and transmission expansion in interconnected power systems. Appl. Energy 170, 1–21 (2016)CrossRefGoogle Scholar
  9. 9.
    H. Kim, S. Lee, S. Han, W. Kim, K. Ok, S. Cho, Integrated generation and transmission expansion planning using generalized Bender’s decomposition method, in IEEE International Conference on Computational Intelligence & Communication Technology, Ghaziabad, India, 2015Google Scholar
  10. 10.
    S. Hasanvand, M. Nayeripour, H. Fallahzadeh-Abarghouei, A new distribution power system planning approach for distributed generations with respect to reliability assessment. J. Renewable Sustainable Energy 8, 045501 (2016)CrossRefGoogle Scholar
  11. 11.
    B. Singh, C. Pal, V. Mukherjee, P. Tiwari, M.K. Yadav, Distributed generation planning from power system performances viewpoints: a taxonomical survey. Renew. Sust. Energ. Rev. 75, 1472–1492 (2017)CrossRefGoogle Scholar
  12. 12.
    M.R. AlRashidi, K.M. EL-Naggar, Long term electric load forecasting based on particle swarm optimization. Appl. Energy 87(1), 320–326 (2010)CrossRefGoogle Scholar
  13. 13.
    A. Poghosyan, D.V. Greetham, S. Haben, T. Lee, Long term individual load forecast under different electrical vehicles uptake scenarios. Appl. Energy 157(1), 699–709 (2015)CrossRefGoogle Scholar
  14. 14.
    M. Zhao, W. Liu, J. Su, L. Zhao, X. Dong, W. Liu, Medium and long term load forecasting method for distribution network with high penetration DGs, in 2014 China International Conference on Electricity Distribution (CICED), Shenzhen, China, 2014Google Scholar
  15. 15.
    E. Vaahedi, Practical power system operation (Wiley, Hoboken, 2014)CrossRefGoogle Scholar
  16. 16.
    M. Matos, R. Bessa, A. Botterud, Z. Zhou, Forecasting and setting power system operating reserves, in Renewable Energy Forecasting - From Models to Applications, ed. by G. Kariniotakis (Woodhead Publishing Elsevier, Duxford, 2017), pp. 279–308CrossRefGoogle Scholar
  17. 17.
    R. Weron, Electricity price forecasting: a review of the state-of-the-art with a look into the future. Int. J. Forecast. 30, 1030–1081 (2014)CrossRefGoogle Scholar
  18. 18.
    N. Mazzi, P. Pinson, Wind power in electricity markets and the value of forecasting, in Renewable Energy Forecasting - From Models to Applications, Woodhead Publishing Series in Energy (Woodhead Publishing Elsevier, Duxford, 2017), pp. 259–278CrossRefGoogle Scholar
  19. 19.
    C. Frohlich, J. Lean, Total Solar Irradiance (TSI) composite database, National Oceanic and Atmospheric Administration (Online). Accessed July 2019
  20. 20.
    C. Voyant, G. Notton, S. Kalogirou, M.-L. Nivet, C. Paoli, F. Motte, A. Fouilloy, Machine learning methods for solar radiation forecasting: a review. Renew. Energy 105, 569–582 (2017)CrossRefGoogle Scholar
  21. 21.
    R.G. Brown, Exponential smoothing for predicting demand. Oper. Res. 5(1), 145 (1957)CrossRefGoogle Scholar
  22. 22.
    C.C. Holt, Forecasting Seasonals and Trends by Exponentially Weighted Moving Averages (Office of Naval Research, Arlington, 1957)Google Scholar
  23. 23.
    P.R. Winters, Forecasting sales by exponentially weighted moving averages. Manag. Sci. 6(3), 324–342 (1960)MathSciNetzbMATHCrossRefGoogle Scholar
  24. 24.
    W.R. Christiaanse, Short-term load forecasting using general exponential smoothing. IEEE Trans. Power Syst. PAS-90(2), 900–911 (1971)CrossRefGoogle Scholar
  25. 25.
    J.W. Taylor, L.M. de Menezes, P.E. McSharry, A comparison of univariate methods for forecasting electricity demand up to a day ahead. Int. J. Forecast. 22, 1–16 (2006)CrossRefGoogle Scholar
  26. 26.
    J.W. Taylor, P.E. McSharry, Short-term load forecasting methods: an evaluation based on European data. IEEE Trans. Power Syst. 22(4), 2213–2219 (2007)CrossRefGoogle Scholar
  27. 27.
    T.N. Goh, K.J. Tan, Stochastic modeling and forecasting of solar radiation data. Sol. Energy 19, 755–757 (1977)CrossRefGoogle Scholar
  28. 28.
    S. Vemuri, W.L. Huang, D.J. Nelson, On-line algorithms for forecasting hourly loads of an electric utility. IEEE Trans. Power Syst. PAS-100(9), 3775–3784 (1981)CrossRefGoogle Scholar
  29. 29.
    G. Reikard, Predicting solar radiation at high resolutions: a comparison of time series forecasts. Sol. Energy 83(3), 342–349 (2009)CrossRefGoogle Scholar
  30. 30.
    A. Moreno-Munoz, J. J. G. de la Rosa, R. Posadillo, F. Bellido, Very short term forecasting of solar radiation, in 2008 33rd IEEE Photovoltaic Specialists Conference, 2008Google Scholar
  31. 31.
    J. Contreras, R. Espinola, F.J. Nogales, A.J. Conejo, ARIMA models to predict next-day electricity prices. IEEE Trans. Power Syst. 18(3), 1014–1020 (2003)CrossRefGoogle Scholar
  32. 32.
    N. Amjady, Short-term hourly load forecasting using time-series modeling with peak load estimation capability. IEEE Trans. Power Syst. 16(3), 498–505 (2001)CrossRefGoogle Scholar
  33. 33.
    G.E.P. Box, G.M. Jenkins, Time Series Analysis: Forecasting and Control (Prentice Hall, Englewood Cliffs, 1994)zbMATHGoogle Scholar
  34. 34.
    H. Amini, A. Kargarian, O. Karabasoglu, ARIMA-based decoupled time series forecasting of electric vehicle charging demand for stochastic power system operation. Electr. Power Syst. Res. 140, 379–390 (2016)CrossRefGoogle Scholar
  35. 35.
    T. Hastie, R. Tibshirani, J. Friedman, The Elements of Statistical Learning (Springer, New York, 2001)zbMATHCrossRefGoogle Scholar
  36. 36.
    N.K. Ahmed, A.F. Atiya, N.E. Gayar, H. El-Shishiny, An empirical comparison of machine learning models for time series forecasting. Econ. Rev. 29(5–6), 594–621 (2010)MathSciNetCrossRefGoogle Scholar
  37. 37.
    R.H. Inman, H.T.C. Pedro, C.F.M. Coimbra, Solar forecasting methods for renewable energy integration. Prog. Energy Combust. Sci. 39(6), 535–576 (2013)CrossRefGoogle Scholar
  38. 38.
    V. Vapnik, The Nature of Statistical Learning Theory (Springer, New York, 1995)zbMATHCrossRefGoogle Scholar
  39. 39.
    N. Cristianini, J. Shawe-Taylor, An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods (Cambridge University Press, Cambridge, 2000)zbMATHCrossRefGoogle Scholar
  40. 40.
    E. Ceperic, V. Ceperic, A. Baric, A strategy for short-term load forecasting by support vector regression machines. IEEE Trans. Power Syst. 28(4), 4356–4364 (2013)CrossRefGoogle Scholar
  41. 41.
    J. Dhillon, S.A. Rahman, S.U. Ahmad, M.D.J. Hossain, Peak electricity load forecasting using online support vector regression, in IEEE Canadian Conference on Electrical and Computer Engineering, 2016Google Scholar
  42. 42.
    J. Jose, V. Margaret, K.U. Rao, Impact of demand response contracts on short-term load forecasting in smart grid using SVR optimized by GA, in Innovations in Power and Advanced Computing Technologies, 2017Google Scholar
  43. 43.
    E.E. Elattat, J. Goulermas, Q.H. Wu, Electric load forecasting based on locally weighted support vector regression. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 40(4), 438–447 (2010)CrossRefGoogle Scholar
  44. 44.
    L. Ghelardoni, A. Ghio, D. Anguita, Energy load forecasting using empirical mode decomposition and support vector regression. IEEE Trans. Smart Grid 4(1), 549–556 (2013)CrossRefGoogle Scholar
  45. 45.
    C.E. Rasmussen, C.K.I. Williams, Gaussian Processes for Machine Learning (The MIT Press, Cambridge, 2006)zbMATHGoogle Scholar
  46. 46.
    H. Mori, M. Ohmi, Probabilistic short-term load forecasting with Gaussian processes, in Proceedings of the 13th International Conference on Intelligent Systems Application to Power Systems, 2005Google Scholar
  47. 47.
    A. Rohani, M. Taki, M. Abdollahpour, A novel soft computing model (Gaussian process regression with K-fold cross validation) for daily and monthly solar radiation forecasting (part: I). Renew. Energy 115, 411–422 (2018)CrossRefGoogle Scholar
  48. 48.
    N. Chen, Z. Qian, I.T. Nabney, X. Meng, Wind power forecasts using Gaussian processes and numerical weather prediction. IEEE Trans. Power Syst. 29(2), 656–665 (2014)CrossRefGoogle Scholar
  49. 49.
    S. Salcedo-Sanz, C. Casanova-Mateo, J. Munoz-Mari, G. Camps-Valls, Prediction of daily global solar irradiation using temporal Gaussian processes. IEEE Geosci. Remote Sens. Lett. 11(11), 1936–1940 (2014)CrossRefGoogle Scholar
  50. 50.
    A. Ulbig, T. Borsche, G. Andersson, Impact of low rotational inertia on power system stability and operation. IFAC Proc. Vol. 47(3), 7290–7297 (2014)CrossRefGoogle Scholar
  51. 51.
    E. Bitar, P.P. Khargonekar, K. Poolla, Systems and control opportunities in the integration of renewable energy into the smart grid. IFAC Proc. Vol. 44(1), 4927–4932 (2011)CrossRefGoogle Scholar
  52. 52.
    K. Hornik, M. Stinchombe, H. White, Multilayer feedforward networks are universal approximators. Neural Netw. 2(5), 359–366 (1989)zbMATHCrossRefGoogle Scholar
  53. 53.
    Y. LeCun, Y. Bengio, G. Hilton, Deep learning. Nature 521, 436–444 (2015)CrossRefGoogle Scholar
  54. 54.
    A. Graves, Supervised sequence labelling with recurrent neural networks (Springer-Verlag, Berlin, 2012)zbMATHCrossRefGoogle Scholar
  55. 55.
    S. Mishra, P. Palanisamy, An integrated multi-time-scale modeling for solar irradiance forecasting using deep learning, arXiv:1905.02616, 2019Google Scholar
  56. 56.
    A.v.d. Oord, S. Dieleman, H. Zen, K. Simonyan, O. Vinyals, A. Graves, N. Kalchbrenner, A. Senior, K. Kavukcuoglu, WaveNet: a generative model for raw audio, in DeepMind, 2016Google Scholar
  57. 57.
    A. Borovykh, S. Bohte, C.W. Oosterlee, Conditional time series forecasting with convolutional neural networks, arXiv:1703.04691, 2018Google Scholar
  58. 58.
    D.L. Marino, K. Amarasinghe, M. Manic, Building energy load forecasting using deep neural networks, in IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society, Florence, Italy, 2016Google Scholar
  59. 59.
    W. Kong, Z.Y. Dong, Y. Jia, D.J. Hill, Y. Xu, Y. Zhang, Short-term residential load forecasting based on LSTM recurrent neural network. IEEE Trans. Smart Grid 10(1), 841–851 (2019)CrossRefGoogle Scholar
  60. 60.
    H. Shi, M. Xu, R. Li, Deep learning for household load forecasting - a novel pooling deep RNN. IEEE Trans. Smart Grid 9(5), 5271–5280 (2018)CrossRefGoogle Scholar
  61. 61.
    Z. Yu, Z. Niu, W. Tang, Q. Wu, Deep learning for daily peak load forecasting–a novel gated recurrent neural network combining dynamic time warping. IEEE Access 7, 17184–17194 (2019)CrossRefGoogle Scholar
  62. 62.
    X. Dong, L. Qian, L. Huang, Short-term load forecasting in smart grid: a combined CNN and K-means clustering approach, in 2017 IEEE International Conference on Big Data and Smart Computing, Jeju, South Korea, 2017Google Scholar
  63. 63.
    H. Shao, X. Deng, Y. Jiang, A novel deep learning approach for short-term wind power forecasting based on infinite feature selection and recurrent neural network. J. Renewable Sustainable Energy 10, 043303 (2018)CrossRefGoogle Scholar
  64. 64.
    C.-J. Huang, P.-H. Kuo, A short-term wind speed forecasting model by using artificial neural networks with stochastic optimization for renewable energy systems. Energies 11, 2777 (2018)CrossRefGoogle Scholar
  65. 65.
    Y.-Y. Hong, C.L.P.P. Rioflorido, A hybrid deep learning-based neural network for 24-h ahead wind power forecasting. Appl. Energy 250, 530–539 (2019)CrossRefGoogle Scholar
  66. 66.
    D. Diaz-Vico, A. Torres-Barran, A. Omari, J.R. Dorronsoro, Deep neural networks for wind and solar energy prediction. Neural Process. Lett. 46, 829 (2017)CrossRefGoogle Scholar
  67. 67.
    T.A. Siddiqui, S. Bharadwaj, S. Kalyanaraman, A deep learning approach to solar-irradiance forecasting in sky-videos, in 2019 IEEE Winter Conference on Applications of Computer Visions (WACV), Waikoloa Village, HI, USA, 2019Google Scholar
  68. 68.
    A. Gensler, J. Henze, B. Sick, N. Raabe, Deep learning for solar power forecasting - an approach using AutoEncoder and LSTM neural networks, in IEEE International Conference on Systems, Man, and Cybernetics (SMC), Budapest, Hungary, 2016Google Scholar
  69. 69.
    A. Alzahrani, P. Shamsi, C. Dagli, M. Ferdowsi, Solar irradiance forecasting using deep neural networks. Proc. Comput. Sci. 114, 304–313 (2017)CrossRefGoogle Scholar
  70. 70.
    S. Mishra, P. Palanisamy, Multi-time-horizon solar forecasting using recurrent neural network, in 2018 IEEE Energy Conversion Congress and Exposition (ECCE), Portland, OR, 2018Google Scholar
  71. 71.
    W. Zhang, F. Cheema, D. Srinivasan, Forecasting of electricity prices using deep learning networks, in 2018 IEEE PES Asia-Pacific Power and Energy Engineering Conference (APPEEC), Kota Kinabalu, Malaysia, 2018Google Scholar
  72. 72.
    R.A. Chinnathambi, S.J. Plathottam, T. Hossen, A.S. Nair, P. Ranganathan, Deep neural networks (DNN) for day-ahead electricity price markets, in 2018 IEEE Electrical Power and Energy Conference (EPEC), Toronto, ON, Canada, 2018Google Scholar
  73. 73.
    J. Lago, F.D. Ridder, B.D. Schutter, Forecasting spot electricity prices: deep learning approaches and empirical comparison of traditional algorithms. Appl. Energy 221, 386–405 (2018)CrossRefGoogle Scholar
  74. 74.
    A. Brusaferri, M. Matteucci, P. Portlani, A. Vitali, Bayesian deep learning based method for probabilistic forecast of day-ahead electricity prices. Appl. Energy 250, 1158–1175 (2019)CrossRefGoogle Scholar
  75. 75.
    S. Atef, A.B. Eltawil, A comparative study using deep learning and support vector regression for electricity price forecasting in smart grids, in 2019 IEEE 6th International Conference on Industrial Engineering and Applications (ICIEA), Tokyo, Japan, 2019Google Scholar
  76. 76.
    K.L. Lopez, C. Gagne, M.-A. Gardner, Demand-side management using deep learning for smart charging of electric vehicles. IEEE Trans. Smart Grid 10(3), 2683–2691 (2019)CrossRefGoogle Scholar
  77. 77.
    R.E. Bird, R.L. Hulstrom, Simplified Clear Sky Model for Direct and Diffuse Insolation on Horizontal Surfaces (Solar Energy Research Institute, Golden, CO, 1981) CrossRefGoogle Scholar
  78. 78.
    A. Dobbs, T. Elgindy, B.-M. Hodge, A. Florita, J. Novacheck, Short-Term Solar Forecasting Performance of Popular Machine Learning Algorithms (National Renewable Energy Laboratory, Golden, CO, 2017)Google Scholar
  79. 79.
    G. Li, J. Shi, J. Zhou, Bayesian adaptive combination of short-term wind speed forecasts from neural network models. Renew. Energy 36(1), 352–359 (2011)CrossRefGoogle Scholar
  80. 80.
    N. Bassamzadeh, R. Ghanem, Multiscale stochastic prediction of electricity demand in smart grids using Bayesian networks. Appl. Energy 193, 369–380 (2017)CrossRefGoogle Scholar
  81. 81.
    Z. Fengming, L. Shufang, G. Zhimin, W. Bo, T. Shiming, P. Mingming, Anomaly detection in smart grid based on encoder-decoder framework with recurrent neural network. J. China Univ. Posts Telecommun. 24(6), 67–73 (2017)CrossRefGoogle Scholar
  82. 82.
    L. Banjanovic-Mehmedovic, A. Hajdarevic, M. Kantardzic, F. Mehmedovic, I. Dzananovic, Neural network-based data-driven modelling of anomaly detection in thermal power plant. J. Control Meas. Electron. Comput. Commun. 58(1), 69 (2017)Google Scholar
  83. 83.
    C. Zhang, D. Song, Y. Chen, X. Feng, C. Lumezanu, W. Cheng, J. Ni, B. Zong, H. Chen, N.V. Chawla, A deep neural network for unsupervised anomaly detection and diagnosis in multivariate time series data, in Proceedings of the AAAI Conference on Artificial Intelligences, 2019Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Sakshi Mishra
    • 1
    Email author
  • Andrew Glaws
    • 2
  • Praveen Palanisamy
    • 3
  1. 1.Integrated Applications Center, National Renewable Energy LaboratoryGoldenUSA
  2. 2.Computational Science Center, National Renewable Energy LaboratoryGoldenUSA
  3. 3.Perception Planning and Decision Systems, General MotorsWarrenUSA

Personalised recommendations