Bottom-Up Estimation and Top-Down Prediction: Solar Energy Prediction Combining Information from Multiple Sources

  • Youngdeok Hwang
  • Siyuan Lu
  • Jae-Kwang Kim
Conference paper
Part of the ICSA Book Series in Statistics book series (ICSABSS)


Accurately forecasting solar power using the data from multiple sources is an important but challenging problem. Our goal is to combine two different physics model forecasting outputs with real measurements from an automated monitoring network so as to better predict solar power in a timely manner. To this end, we consider a new approach of analyzing large-scale multilevel models for computational efficiency. This approach features a division of the large-scale data set into smaller ones with manageable sizes, based on their physical locations, and fit a local model in each area. The local model estimates are then combined sequentially from the specified multilevel models using our novel bottom-up approach for parameter estimation. The prediction, on the other hand, is implemented in a top-down matter. The proposed method is applied to the solar energy prediction problem for the US Department of Energy’s SunShot Initiative.



This report was prepared as an account of work sponsored by an agency of the US government. Neither the US government nor any agency thereof, nor any of their employees, makes any warranty, expressed or implied, or assumes any legal liability or responsibility for the accuracy, completeness, or usefulness of any information, apparatus, product, or process disclosed, or represented that its use would not infringe privately owned rights. Reference herein to any specific commercial product, process, or service by trade name, trademark, manufacturer, or otherwise does not necessarily constitute or imply its endorsement, recommendation, or favoring by the US government or any agency thereof. The views and opinions of authors expressed herein do not necessarily state or reflect those of the US government or any agency thereof.


  1. Chatterjee, S., Lahiri, P., & Li, H. (2008). Parametric bootstrap approximation to the distribution of EBLUP and related prediction intervals in linear mixed models. The Annals of Statistics, 36, 1221–1245. (06)Google Scholar
  2. Denholm, P., & Margolis, R. M. (2007). Evaluating the limits of solar photovoltaics (pv) in traditional electric power systems. Energy Policy, 35, 2852–2861.CrossRefGoogle Scholar
  3. Du, J., & Tracton, M. S. (2001). Implementation of a real-time shortrange ensemble forecasting system at ncep: An update. In Ninth Conference on Mesoscale Processes, Preprints, Ninth Conference on Mesoscale Processes, Fort Lauderdale, FL., American Meteorological Society.Google Scholar
  4. Ela, E., Milligan, M., & Kirby, B. (2011). Operating Reserves and Variable Generation. NREL/TP-5500-51978.
  5. Gramacy, R. B., Bingham, D., Holloway, J. P., Grosskopf, M. J., Kuranz, C. C., Rutter, E., et al. (2015). Calibrating a large computer experiment simulating radiative shock hydrodynamics. The Annals of Applied Statistics, 9(3), 1141–1168.MathSciNetCrossRefzbMATHGoogle Scholar
  6. Hall, P., & Maiti, T. (2006). On parametric bootstrap methods for small area prediction. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 68, 221–238.MathSciNetCrossRefzbMATHGoogle Scholar
  7. Lange, K. L., Little, R. J. A., & Taylor, J. M. G. (1989). Robust statistical modeling using the T distribution. Journal of the American Statistical Association, 84, 881–896.Google Scholar
  8. Margolis, R., Coggeshall, C., & Zuboy, J. (2012). Integration of solar into the U.S. electric power system. In SunShot vision study. Washington, DC: U.S. Department of Energy.Google Scholar
  9. Mathiesen, P., & Kleissl, J. (2011). Evaluation of numerical weather prediction for intra-day solar forecasting in the continental united states. Solar Energy, 85, 967–977.CrossRefGoogle Scholar
  10. Orwig, K., Ahlstrom, M., Banunarayanan, V., Sharp, J., Wilczak, J., Freedman, J., et al. (2015). Recent trends in variable generation forecasting and its value to the power system. IEEE Transactions on Sustainable Energy, 99, 1–10.Google Scholar
  11. Pelland, S., Galanis, G., & Kallos, G. (2013). Solar and photovoltaic forecasting through post-processing of the global environmental multiscale numerical weather prediction model. Progress in Photovoltaics: Research and Applications, 21, 284–296.Google Scholar
  12. Skamarock, W. C., Klemp, J. B., Dudhia, J., Gill, D. O., Barker, D. M., Duda, M. G., et al. (2008). A description of the advanced research WRF version 3. NCAR TECHNICAL NOTE: NCAR/TNñ475+STR. National Center for Atmospheric Research, Boulder, Colorado, USA.Google Scholar
  13. Wong, R. K. W., Storlie, C. B., & Lee, T. C. M. (2016). A frequentist approach to computer model calibration. Journal of the Royal Statistical Society: Series B (Statistical Methodology). (To appear)Google Scholar
  14. Zhang, J., Florita, A., Hodge, B.-M., Siyuan, L., Hamann, H. F., Banunarayanan, V., et al. (2015). A suite of metrics for assessing the performance of solar power forecasting. Solar Energy, 111, 157–175.CrossRefGoogle Scholar
  15. Zhang, J., Hodge, B.-M., Siyuan, L., Hamann, H. F., Lehman, B., Simmons, J., et al. (2015). Baseline and target values for regional and point PV power forecasts: Toward improved solar forecasting. Solar Energy, 122, 804–819.CrossRefGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  1. 1.Department of StatisticsSungkyunkwan UniversitySeoulKorea
  2. 2.IBM Thomas. J. Watson Research CenterYorktown HeightsUSA
  3. 3.Department of StatisticsIowa State UniversityAmesUSA

Personalised recommendations