A Two-Fold Machine Learning Approach for Efficient Day-Ahead Load Prediction at Hourly Granularity for NYC

  • Syed Shahbaaz AhmedEmail author
  • Raghavendran Thiruvengadam
  • A. S. Shashank Karrthikeyaa
  • Vineeth Vijayaraghavan
Conference paper
Part of the Lecture Notes in Networks and Systems book series (LNNS, volume 70)


Recent surge in electricity requirements has propelled a need for accurate load forecasting methods. Several peak load demand forecasting methods exist which predict the highest load requirement of the day. However, Short Term Load Forecasting (STLF) takes precedence owing to the constant load fluctuation over the day, especially in developed cities, and therefore finds more practical and economical use. While statistical methods have largely been used for STLF, contemporary works involving Machine Learning (ML) have seen more success. Such ML methods have made use of several years of data, focused on testing only for a short duration (few weeks), disregarded federal and public holidays when the load demands are erratic, or utilized simulated and not real-time data. This provokes the need for a solution that is capable of forecasting real-time load accurately for all days of the year. The authors of this paper propose a unique two-fold approach to model the training data used for accurate day-ahead hourly load prediction, which also predicts suitably well for federal and public holidays. The New York Independent System Operator’s (NYISO) electrical load dataset is used to evaluate the model for the year 2017 with a Mean Absolute Percentage Error (MAPE) of 3.596.


Machine learning Demand forecasting Short-term load forecasting Smart grid Energy management Energy efficiency 



The authors would like to acknowledge Solarillion Foundation for its support and funding of the research work carried out.


  1. 1.
    Energy Information Administration, (2018). U.S. Energy Facts- Energy Explained, Your Guide To Understanding Energy- Energy Information Administration. [Online] Available at:
  2. 2.
    Smart Grid And Renewables: A Guide for Effective Deployment, 2013, p. 47 [Online]. Available: Accessed: 23 March 2018
  3. 3.
    How Does Forecasting Enhance Smart Grid Benefits? (White paper), SAS Institute, 2010, p. 9 [Online]. Available: Accessed 20 March 2018
  4. 4.
    The Smart Grid: An Introduction. Litos Strategic Communication, 2008, p. 48 [Online]. Available: Accessed 18 March 2018
  5. 5.
    New York Independent System Operator. [Available Online]:
  6. 6.
    Hippert, H.S., Pedreira, C.E., Souza, R.C.: Neural networks for short-term load forecasting: a review and evaluation. IEEE Trans. Power Syst. 16(1), 44–55 (2001)CrossRefGoogle Scholar
  7. 7.
    Hafen, R.P., Samaan, N., Makarov, Y.V., Diao, R., Lu, N.: Joint seasonal ARMA approach for modeling of load forecast errors in planning studies. In 2014 IEEE PES T&D Conference and Exposition, pp. 1–5. Chicago, IL, USA (2014)Google Scholar
  8. 8.
    Guan, C., Luh, P.B., Michel, L.D., Chi, Z.: Hybrid Kalman filters for very short-term load forecasting and prediction interval estimation. IEEE Trans. Power Syst. 28(4), 3806–3817 (2013)CrossRefGoogle Scholar
  9. 9.
    Foster, J., Liu, X., McLoone, S.: Adaptive sliding window load forecasting. In: 2017 28th Irish Signals and Systems Conference (ISSC). Killarney pp. 1–6 (2017)Google Scholar
  10. 10.
    Fan, G.-F., Peng, L.-L., Hong, W.-C., Sun, F.: Electric load forecasting by the SVR model with differential empirical mode decomposition and auto regression. Neurocomputing 173, 958–70 (2015)CrossRefGoogle Scholar
  11. 11.
    Neupane, B., Perera, K.S., Aung, Z., Woon, W.L.: Artificial neural network-based electricity price forecasting for smart grid deployment. In: 2012 International Conference on Computer Systems and Industrial Informatics, Sharjah, pp. 1-6 (2012)Google Scholar
  12. 12.
    World Weather Online. [Available Online]:

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Syed Shahbaaz Ahmed
    • 1
    Email author
  • Raghavendran Thiruvengadam
    • 1
  • A. S. Shashank Karrthikeyaa
    • 2
  • Vineeth Vijayaraghavan
    • 1
  1. 1.Solarillion FoundationChennaiIndia
  2. 2.SSN College of EngineeringChennaiIndia

Personalised recommendations