Skip to main content

Probabilistic Energy Forecasting Based on Self-organizing Inductive Modeling

  • Conference paper
  • First Online:

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 871))

Abstract

Self-organizing inductive modeling represented by the Group Method of Data Handling (GMDH) as an early implementation of Deep Learning is a proven and powerful data-driven modeling technology for solving ill-posed modeling problems as found in energy forecasting and other complex systems. It develops optimal complex predictive models, systematically, from sets of high-dimensional noisy input data. The paper describes the implementation of a rolling twelve weeks self-organizing modeling and probabilistic ex ante forecasting, exemplarily, for the Global Energy Forecasting Competition 2014 (GEFCom 2014) electricity price and wind power generation forecasting tracks using the KnowledgeMiner INSIGHTS inductive modeling tool out-of-the-box. The self-organized non-linear models are available analytically in explicit notation and can be exported to Excel, Python, or Objective-C source code for further analysis or model deployment. Based on the pinball loss function they show an overall performance gain of 67.3% for electricity price forecasting and 47.5% for wind power generation forecasting relative to corresponding benchmark measures.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • European Union: A Framework Strategy for a Resilient Energy Union with a Forward-Looking Climate Change Policy (2015). http://eur-lex.europa.eu/legal-content/EN/TXT/?uri=COM:2015:80:FIN

  • Farlow, S.J., (ed.) Self-organizing Methods in Modeling. GMDH Type Algorithm. Marcel Dekker, New York (1984). ISBN 0-8247-7161-3

    Google Scholar 

  • Hong, T., Pinson, P., Fan, S., Zareipour, H., Troccoli, A., Hyndman, R.J.: Probabilistic energy forecasting: global energy forecasting competition 2014 and beyond. Int. J. Forecast. 32, 896–913 (2016)

    Article  Google Scholar 

  • Ivakhnenko, A.G.: Group method of data handling as a rival of stochastic approximation method. Sov. Autom. Control. 3, 58–72 (1968)

    Google Scholar 

  • Ivakhnenko, A.G., Stepashko, V.S.: Pomechoustojcivost’ modelirovanija (Noise-immunity of modeling). Naukova dumka, Kiev (1985). (In Russian)

    Google Scholar 

  • KnowledgeMiner Software: INSIGHTS - Self-organizing modeling and forecasting tool, v6.1.3 (2018 A). https://www.knowledgeminer.eu. Last Accessed 05 May 2018

  • KnowledgeMiner Software: OCKHAM – Global Sensitivity Analysis tool, v2.0.1 (2018 B). https://www.knowledgeminer.eu/ockham. Last Accessed 02 May 2018

  • Kondo, T., Ueno, J.: Feedback GMDH-type neural network self-selecting optimum neural network architecture and its application to 3-dimensional medical image recognition of the lungs. In: Proceedings of II International Workshop on Inductive Modelling, Czech Technical University, Prague, pp. 63–70 (2007)

    Google Scholar 

  • Kordik, P.: Fully automated knowledge extraction using group of adaptive model evolution. Ph.D. thesis, Department of Computer Science and Computers, FEE, CTU in Prague (2006)

    Google Scholar 

  • Lambert, R., Lemke, F., Kucherenko, S., Song, S., Shah, N.: Global sensitivity analysis using sparse high dimensional model representations generated by the group method of data handling technique. J. Math. Comput. Simul. 128, 42–54 (2016)

    Article  MathSciNet  Google Scholar 

  • Madala, H.R., Ivakhnenko, A.G.: Inductive Learning Algorithms for Complex Systems Modelling. CRC Press Inc., Boca Raton, Ann Arbor, London, Tokyo (1994). ISBN 0-8493-4438-7

    Google Scholar 

  • Müller, J.-A., Lemke, F.: Self-organizing Data Mining. Libri, Hamburg (2000). ISBN: 3-89811-861-4

    Google Scholar 

  • Schmidhuber, J.: Deep learning in neural networks: an overview. Neural Netw. 61, 85–117 (2015)

    Article  Google Scholar 

  • Stepashko, V.S.: Potential noise immunity of modelling using a combinatorial GMDH algorithm without information regarding the noise. Sov. Autom. Control. 16(3), 15–25 (1983)

    MathSciNet  MATH  Google Scholar 

  • Stepashko, V.S.: Method of critical variances as analytical tool of theory of inductive modeling. J. Autom. Inf. Sci. 40(3), 4–22 (2008)

    Article  MathSciNet  Google Scholar 

  • Weron, R.: Electricity price forecasting: a review of the state-of-the-art with a look into the future. Int. J. Forecast. 30, 1030–1081 (2014)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Frank Lemke .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lemke, F. (2019). Probabilistic Energy Forecasting Based on Self-organizing Inductive Modeling. In: Shakhovska, N., Medykovskyy, M. (eds) Advances in Intelligent Systems and Computing III. CSIT 2018. Advances in Intelligent Systems and Computing, vol 871. Springer, Cham. https://doi.org/10.1007/978-3-030-01069-0_29

Download citation

Publish with us

Policies and ethics