Skip to main content

Massive-Scale Simulation of Electrical Load in Smart Grids Using Generalized Additive Models

  • Conference paper
Modeling and Stochastic Learning for Forecasting in High Dimensions

Part of the book series: Lecture Notes in Statistics ((LNSP,volume 217))

Abstract

The emergence of Smart Grids is posing a wide range of challenges for electric utility companies and network operators: Integration of non-dispatchable power from renewable energy sources (e.g., photovoltaics, hydro and wind), fundamental changes in the way energy is consumed (e.g., due to dynamic pricing, demand response and novel electric appliances), and more active operations of the networks to increase efficiency and reliability. A key in managing these challenges is the ability to forecast network loads at low levels of locality, e.g., counties, cities, or neighbourhoods. Accurate load forecasts improve the efficiency of supply as they help utilities to reduce operating reserves, act more efficiently in the electricity markets, and provide more effective demand-response measures. In order to prepare for the Smart Grid era, there is a need for a scalable simulation environment which allows utilities to develop and validate their forecasting methodology under various what-if-scenarios. This paper presents a massive-scale simulation platform which emulates electrical load in an entire electrical network, from Smart Meters at individual households, over low- to medium-voltage network assets, up to the national level. The platform supports the simulation of changes in the customer portfolio and the consumers’ behavior, installment of new distributed generation capacity at any network level, and dynamic reconfigurations of the network. The paper explains the underlying statistical modeling approach based on Generalized Additive Models, outlines the system architecture, and presents a number of realistic use cases that were generated using this platform.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    More details are available at http://www.erdfdistribution.fr/linky/

  2. 2.

    Assuming that each data point requires 8 bytes memory.

  3. 3.

    It is important to note that the GAMs learned on aggregated load data do not really represent load at the individual Meter level, but more an “average consumer”. As will be shown in Sect. 6, GAMs fit well for aggregates of 70 households or more. The purpose for using GAMs, nevertheless, at the Meter level, is to represent shifts in the customer portfolio and changes in the consumers’ behaviors, as will be explained at the end of this subsection.

  4. 4.

    The installment of new wind power capacity can be represented by network nodes which, at specified time points, change their simulation model from a “void” GAM (producing zero values) to a GAM model simulating wind farm output. Compare with the remark at the end of Sect. 4.2.

References

  1. Ba, A., Sinn, M., Goude, Y., & Pompey, P. (2012). Adaptive learning of smoothing functions: Application to electricity load forecasting. In P. Bartlett, F. C. N. Pereira, C. J. C. Burges, L. Bottou, & K. Q. Weinberger (Eds.), Advances in neural information processing systems (Vol. 25, pp. 2519–2527). Curran Associates, Inc.

    Google Scholar 

  2. Bondu, A., & Boullé, M. (2011). A supervised approach for change detection in data streams. In IJCNN (International joint conference on neural networks), San Jose (pp. 519–526). IEEE.

    Google Scholar 

  3. Bühlmann, P., & Hothorn, T. (2007). Boosting algorithms: Regularization, prediction and model fitting (with discussion). Statistical Science, 22, 477–522.

    Article  MATH  MathSciNet  Google Scholar 

  4. Candillier, L., Tellier, I., Torre, F., & Bousquet, O. (2006). Cascade evaluation of clustering algorithms. In J. Fürnkranz, T. Scheffer, & M. Spiliopoulou (Eds.), 17th European conference on machine learning (ECML’2006), Berlin (Volume LNAI 4212 of LNCS, pp. 574–581). Springer.

    Google Scholar 

  5. Commission for Energy Regulation. (2011). Electricity smart metering customer behavior trials findings report (Technical report). Commission for Energy Regulation, Dublin.

    Google Scholar 

  6. Commission for Energy Regulation. (2011). Results of electricity cost-benefit analysis, customer behavior trials and technology trials (Technical report). Commission for Energy Regulation, Dublin.

    Google Scholar 

  7. Craven, P., & Wahba, G. (1979). Smoothing noisy data with spline functions: Estimated the correct degree of smoothing by the method of general cross validation. Numerische Mathematik, 31, 377–403.

    Article  MATH  MathSciNet  Google Scholar 

  8. dos Santos, L. D. P., Picard, M. L., da Silva, A. G., Worms, D., Jacquin, B., & Bernard, C. (2012). Massive smart meter data storage and processing on top of Hadoop. In International workshop on end-to-end management of big data, VLDB (International conference on very large data bases), Istanbul.

    Google Scholar 

  9. Fan, S., & Hyndman, R. J. (2012). Short-term load forecasting based on a semi-parametric additive model. IEEE Transactions on Power Systems, 27(1), 134–141.

    Google Scholar 

  10. Fawcett, T. (2003). ROC graphs: Notes and practical considerations for data mining researchers (Technical report HPL-2003-4). HP Labs.

    Google Scholar 

  11. Goude, Y., Nedellec, R., & Kong, N. (2013, to appear). Local short and middle term electricity load forecasting with semi-parametric additive models. IEEE Transactions on Smart Grid, 5(1), 440–446.

    Article  Google Scholar 

  12. Hastie, T., & Tibshirani, R. (1986). Generalized additive models (with discussion). Statistical Science, 1, 297–318.

    Google Scholar 

  13. Hastie, T., & Tibshirani, R. (1990). Generalized additive models. Boca Raton: Chapman & Hall/CRC.

    Google Scholar 

  14. International Technical Support Organization. (2013). Addressing data volume, velocity, and variety with IBM InfoSphere streams V3.0. http://www.redbooks.ibm.com/redbooks/pdfs/sg248108.pdf. March 2013.

  15. Muratori, M., Roberts, M., Sioshansi, R., Marano, V., & Rizzoni, G. (2013). A highly resolved modeling technique to simulate residential power demand. Applied Energy, 107(C), 465–473.

    Google Scholar 

  16. Nedellec, R., Cugliari, J., & Goude, Y. (2014, to appear). Electric load forecasting and backcasting with semi-parametric models. International Journal of Forecasting, 30(2), 375–381.

    Article  Google Scholar 

  17. Paatero, J. V., & Lund, P. D. (2006). A model for generating household electricity load profiles. International Journal of Energy Research, 30(5), 273–290.

    Google Scholar 

  18. Pierrot, A., & Goude, Y. (2011). Short-term electricity load forecasting with generalized additive models. In Proceedings of ISAP power, Hersonissos (pp. 593–600).

    Google Scholar 

  19. Swan, L., & Ugursal, V. (2009). Modeling of end-use energy consumption in the residential sector: A review of modeling techniques. Renewable and Sustainable Energy Reviews, 13(8), 1819–1835.

    Google Scholar 

  20. Wood, S. (2001). mgcv: GAMs and generalized ridge regression for R. R News, 1(2), 20–25.

    Google Scholar 

  21. Wood, S. (2004). Stable and efficient multiple smoothing parameter estimation for generalized additive models. Journal of the American Statistical Association, 99, 673–686.

    Article  MATH  MathSciNet  Google Scholar 

  22. Wood, S. (2006). Generalized additive models, an introduction with R. Boca Raton: Chapman and Hall/CRC.

    MATH  Google Scholar 

  23. Wood, S. (2011). Fast stable restricted maximum likelihood and marginal likelihood estimation of semi-parametric generalized linear models. Journal of the Royal Statistical Society Series (B), 73(1), 3–36.

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Pascal Pompey .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Pompey, P., Bondu, A., Goude, Y., Sinn, M. (2015). Massive-Scale Simulation of Electrical Load in Smart Grids Using Generalized Additive Models. In: Antoniadis, A., Poggi, JM., Brossat, X. (eds) Modeling and Stochastic Learning for Forecasting in High Dimensions. Lecture Notes in Statistics(), vol 217. Springer, Cham. https://doi.org/10.1007/978-3-319-18732-7_11

Download citation

Publish with us

Policies and ethics