Massive-Scale Simulation of Electrical Load in Smart Grids Using Generalized Additive Models

  • Pascal PompeyEmail author
  • Alexis Bondu
  • Yannig Goude
  • Mathieu Sinn
Conference paper
Part of the Lecture Notes in Statistics book series (LNS, volume 217)


The emergence of Smart Grids is posing a wide range of challenges for electric utility companies and network operators: Integration of non-dispatchable power from renewable energy sources (e.g., photovoltaics, hydro and wind), fundamental changes in the way energy is consumed (e.g., due to dynamic pricing, demand response and novel electric appliances), and more active operations of the networks to increase efficiency and reliability. A key in managing these challenges is the ability to forecast network loads at low levels of locality, e.g., counties, cities, or neighbourhoods. Accurate load forecasts improve the efficiency of supply as they help utilities to reduce operating reserves, act more efficiently in the electricity markets, and provide more effective demand-response measures. In order to prepare for the Smart Grid era, there is a need for a scalable simulation environment which allows utilities to develop and validate their forecasting methodology under various what-if-scenarios. This paper presents a massive-scale simulation platform which emulates electrical load in an entire electrical network, from Smart Meters at individual households, over low- to medium-voltage network assets, up to the national level. The platform supports the simulation of changes in the customer portfolio and the consumers’ behavior, installment of new distributed generation capacity at any network level, and dynamic reconfigurations of the network. The paper explains the underlying statistical modeling approach based on Generalized Additive Models, outlines the system architecture, and presents a number of realistic use cases that were generated using this platform.


Mean Square Error Wind Power Wind Farm Smart Grid Area Under Curve 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Ba, A., Sinn, M., Goude, Y., & Pompey, P. (2012). Adaptive learning of smoothing functions: Application to electricity load forecasting. In P. Bartlett, F. C. N. Pereira, C. J. C. Burges, L. Bottou, & K. Q. Weinberger (Eds.), Advances in neural information processing systems (Vol. 25, pp. 2519–2527). Curran Associates, Inc.Google Scholar
  2. 2.
    Bondu, A., & Boullé, M. (2011). A supervised approach for change detection in data streams. In IJCNN (International joint conference on neural networks), San Jose (pp. 519–526). IEEE.Google Scholar
  3. 3.
    Bühlmann, P., & Hothorn, T. (2007). Boosting algorithms: Regularization, prediction and model fitting (with discussion). Statistical Science, 22, 477–522.zbMATHMathSciNetCrossRefGoogle Scholar
  4. 4.
    Candillier, L., Tellier, I., Torre, F., & Bousquet, O. (2006). Cascade evaluation of clustering algorithms. In J. Fürnkranz, T. Scheffer, & M. Spiliopoulou (Eds.), 17th European conference on machine learning (ECML’2006), Berlin (Volume LNAI 4212 of LNCS, pp. 574–581). Springer.Google Scholar
  5. 5.
    Commission for Energy Regulation. (2011). Electricity smart metering customer behavior trials findings report (Technical report). Commission for Energy Regulation, Dublin.Google Scholar
  6. 6.
    Commission for Energy Regulation. (2011). Results of electricity cost-benefit analysis, customer behavior trials and technology trials (Technical report). Commission for Energy Regulation, Dublin.Google Scholar
  7. 7.
    Craven, P., & Wahba, G. (1979). Smoothing noisy data with spline functions: Estimated the correct degree of smoothing by the method of general cross validation. Numerische Mathematik, 31, 377–403.zbMATHMathSciNetCrossRefGoogle Scholar
  8. 8.
    dos Santos, L. D. P., Picard, M. L., da Silva, A. G., Worms, D., Jacquin, B., & Bernard, C. (2012). Massive smart meter data storage and processing on top of Hadoop. In International workshop on end-to-end management of big data, VLDB (International conference on very large data bases), Istanbul.Google Scholar
  9. 9.
    Fan, S., & Hyndman, R. J. (2012). Short-term load forecasting based on a semi-parametric additive model. IEEE Transactions on Power Systems, 27(1), 134–141.Google Scholar
  10. 10.
    Fawcett, T. (2003). ROC graphs: Notes and practical considerations for data mining researchers (Technical report HPL-2003-4). HP Labs.Google Scholar
  11. 11.
    Goude, Y., Nedellec, R., & Kong, N. (2013, to appear). Local short and middle term electricity load forecasting with semi-parametric additive models. IEEE Transactions on Smart Grid, 5(1), 440–446.CrossRefGoogle Scholar
  12. 12.
    Hastie, T., & Tibshirani, R. (1986). Generalized additive models (with discussion). Statistical Science, 1, 297–318.Google Scholar
  13. 13.
    Hastie, T., & Tibshirani, R. (1990). Generalized additive models. Boca Raton: Chapman & Hall/CRC.Google Scholar
  14. 14.
    International Technical Support Organization. (2013). Addressing data volume, velocity, and variety with IBM InfoSphere streams V3.0. March 2013.
  15. 15.
    Muratori, M., Roberts, M., Sioshansi, R., Marano, V., & Rizzoni, G. (2013). A highly resolved modeling technique to simulate residential power demand. Applied Energy, 107(C), 465–473.Google Scholar
  16. 16.
    Nedellec, R., Cugliari, J., & Goude, Y. (2014, to appear). Electric load forecasting and backcasting with semi-parametric models. International Journal of Forecasting, 30(2), 375–381.CrossRefGoogle Scholar
  17. 17.
    Paatero, J. V., & Lund, P. D. (2006). A model for generating household electricity load profiles. International Journal of Energy Research, 30(5), 273–290.Google Scholar
  18. 18.
    Pierrot, A., & Goude, Y. (2011). Short-term electricity load forecasting with generalized additive models. In Proceedings of ISAP power, Hersonissos (pp. 593–600).Google Scholar
  19. 19.
    Swan, L., & Ugursal, V. (2009). Modeling of end-use energy consumption in the residential sector: A review of modeling techniques. Renewable and Sustainable Energy Reviews, 13(8), 1819–1835.Google Scholar
  20. 20.
    Wood, S. (2001). mgcv: GAMs and generalized ridge regression for R. R News, 1(2), 20–25.Google Scholar
  21. 21.
    Wood, S. (2004). Stable and efficient multiple smoothing parameter estimation for generalized additive models. Journal of the American Statistical Association, 99, 673–686.zbMATHMathSciNetCrossRefGoogle Scholar
  22. 22.
    Wood, S. (2006). Generalized additive models, an introduction with R. Boca Raton: Chapman and Hall/CRC.zbMATHGoogle Scholar
  23. 23.
    Wood, S. (2011). Fast stable restricted maximum likelihood and marginal likelihood estimation of semi-parametric generalized linear models. Journal of the Royal Statistical Society Series (B), 73(1), 3–36.MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Pascal Pompey
    • 1
    Email author
  • Alexis Bondu
    • 2
  • Yannig Goude
    • 2
  • Mathieu Sinn
    • 1
  1. 1.IBM Research, Damastown Industrial EstateDublin 15Ireland
  2. 2.EDF R&DClamartFrance

Personalised recommendations