Skip to main content

A Two-Fold Machine Learning Approach for Efficient Day-Ahead Load Prediction at Hourly Granularity for NYC

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 70))

Abstract

Recent surge in electricity requirements has propelled a need for accurate load forecasting methods. Several peak load demand forecasting methods exist which predict the highest load requirement of the day. However, Short Term Load Forecasting (STLF) takes precedence owing to the constant load fluctuation over the day, especially in developed cities, and therefore finds more practical and economical use. While statistical methods have largely been used for STLF, contemporary works involving Machine Learning (ML) have seen more success. Such ML methods have made use of several years of data, focused on testing only for a short duration (few weeks), disregarded federal and public holidays when the load demands are erratic, or utilized simulated and not real-time data. This provokes the need for a solution that is capable of forecasting real-time load accurately for all days of the year. The authors of this paper propose a unique two-fold approach to model the training data used for accurate day-ahead hourly load prediction, which also predicts suitably well for federal and public holidays. The New York Independent System Operator’s (NYISO) electrical load dataset is used to evaluate the model for the year 2017 with a Mean Absolute Percentage Error (MAPE) of 3.596.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Energy Information Administration, eia.gov (2018). U.S. Energy Facts- Energy Explained, Your Guide To Understanding Energy- Energy Information Administration. [Online] Available at: https://www.eia.gov/energyexplained/?page=us_energy_home

  2. Smart Grid And Renewables: A Guide for Effective Deployment, 2013, p. 47 [Online]. Available: https://www.irena.org/documentdownloads/publications/smart_grids.pdf. Accessed: 23 March 2018

  3. How Does Forecasting Enhance Smart Grid Benefits? (White paper), SAS Institute, 2010, p. 9 [Online]. Available: https://www.sas.com/content/dam/SAS/en_us/doc/whitepaper1/how-does-forecasting-enhance-smart-grid-benefits-106395.pdf. Accessed 20 March 2018

  4. The Smart Grid: An Introduction. Litos Strategic Communication, 2008, p. 48 [Online]. Available: https://www.smartgrid.gov/files/The_Smart_Grid_Introduction_2008_04.pdf. Accessed 18 March 2018

  5. New York Independent System Operator. [Available Online]: http://www.nyiso.com/public/index.jsp

  6. Hippert, H.S., Pedreira, C.E., Souza, R.C.: Neural networks for short-term load forecasting: a review and evaluation. IEEE Trans. Power Syst. 16(1), 44–55 (2001)

    Article  Google Scholar 

  7. Hafen, R.P., Samaan, N., Makarov, Y.V., Diao, R., Lu, N.: Joint seasonal ARMA approach for modeling of load forecast errors in planning studies. In 2014 IEEE PES T&D Conference and Exposition, pp. 1–5. Chicago, IL, USA (2014)

    Google Scholar 

  8. Guan, C., Luh, P.B., Michel, L.D., Chi, Z.: Hybrid Kalman filters for very short-term load forecasting and prediction interval estimation. IEEE Trans. Power Syst. 28(4), 3806–3817 (2013)

    Article  Google Scholar 

  9. Foster, J., Liu, X., McLoone, S.: Adaptive sliding window load forecasting. In: 2017 28th Irish Signals and Systems Conference (ISSC). Killarney pp. 1–6 (2017)

    Google Scholar 

  10. Fan, G.-F., Peng, L.-L., Hong, W.-C., Sun, F.: Electric load forecasting by the SVR model with differential empirical mode decomposition and auto regression. Neurocomputing 173, 958–70 (2015)

    Article  Google Scholar 

  11. Neupane, B., Perera, K.S., Aung, Z., Woon, W.L.: Artificial neural network-based electricity price forecasting for smart grid deployment. In: 2012 International Conference on Computer Systems and Industrial Informatics, Sharjah, pp. 1-6 (2012)

    Google Scholar 

  12. World Weather Online. [Available Online]: https://www.worldweatheronline.com

Download references

Acknowledgements

The authors would like to acknowledge Solarillion Foundation for its support and funding of the research work carried out.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Syed Shahbaaz Ahmed .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ahmed, S.S., Thiruvengadam, R., Shashank Karrthikeyaa , A.S., Vijayaraghavan, V. (2020). A Two-Fold Machine Learning Approach for Efficient Day-Ahead Load Prediction at Hourly Granularity for NYC. In: Arai, K., Bhatia, R. (eds) Advances in Information and Communication. FICC 2019. Lecture Notes in Networks and Systems, vol 70. Springer, Cham. https://doi.org/10.1007/978-3-030-12385-7_8

Download citation

Publish with us

Policies and ethics