How accurate is food security early warning? Evaluation of FEWS NET accuracy in Ethiopia
- 127 Downloads
Famine early warning systems are fundamental for anticipating and preventing food security crises. These systems require diverse socio-economic, climate and other environmental indicators. However, the uncertainty that is inherent in climate forecasts and other early warning data can influence the accuracy of early warning systems. Inaccurate forecasts result in ineffective preparedness and poor resource allocation. We present a replicable method to evaluate the accuracy of the Famine Early Warning System Network (FEWS NET) food security projections. The analysis was carried out for Ethiopia over the period January 2011 to June 2017. The findings show high levels of accuracy in the system overall which should give decision makers a high degree of confidence in using the information provided by FEWS NET. The results indicate higher accuracy in the western parts of the country and lower accuracy in the generally food insecure northeastern regions – likely due to insufficient information and high levels of vulnerability. In addition, we found a significant decrease in accuracy during the 2015/2016 El Niño, likely linked to the heterogeneous impacts from El Niño and higher levels of forecast uncertainty. The results also show mixed forecasting accuracy in situations of transition from food security to food crises and point to geographical areas where investments in early warning data collection and analysis would likely yield valuable improvements in the performance of the system.
KeywordsEarly warning systems Food security Skill∙ FEWS NET Accuracy Climate services
This research was carried out with the support of Tetra Tech International Development Services, a leading science-based consulting firm.
Compliance with ethical standards
Conflict of interest
Both authors declared that they have no conflicts of interest.
- Bailey, R. (2012). Famine early warning and early action: The cost of delay. London: Chatham House.Google Scholar
- Braimoh, A., Manyena, B. Obuya, G. & Muraya, F. (2018). Assessment of Food Security Early Warning Systems for East and Southern Africa. Africa Climate Business Plan Series, World Bank, Washington, DC. World Bank. https://openknowledge.worldbank.org/handle/10986/29269 License: CC BY 3.0 IGO. Accessed 5 Mar 2019.
- Brown, M. E. (2008). Famine early warning systems and remote sensing data. Germany: Springer Science & Business Media.Google Scholar
- Cabot Venton, C. (2016). The Economic Case for Early Humanitarian Response to the Ethiopia 2015/2016 Drought, Available at: https://static1.squarespace.com/static/5567b109e4b0101076d7f0bd/t/581b75e0cd0f68b05009b283/1478194658325/Ethiopia+Contingency+Analysis.pdf. Accessed 5 Mar 2019.
- Choularton, R. (2007). Contingency planning and humanitarian action: A review of the practice. Overseas Development Institute, UK, Humanitarian Practice Network.Google Scholar
- Choularton, R., Frankenberger, T., Kurtz, J., & Nelson, S. (2015). Measuring shocks and stressors as part of resilience measurement, resilience measurement technical working group. Technical series no. 5. Rome: Food Security Information Network.Google Scholar
- Coughlan de Perez, E., van Aalst, M., Choularton, R., van den Hurk, B., Mason, S., Nissan, H., & Schwager, S. (2019). From rain to famine: Assessing the utility of rainfall observations and seasonal forecasts to anticipate food insecurity in East Africa. Food Security, 11(1). https://doi.org/10.1007/s12571-018-00885-9.
- De Waal, A. (2018). Mass starvation: The history and future of famine. Cambridge: Polity Press.Google Scholar
- Downing, T. 2003. Toward a vulnerability/adaptation science: Lessons from famine early warning and food security. In Climate change adaptive capacity and development, ed. J. B. Smith, R. J. T. Klein, and S. Huq, 77–100. London: Imperial College Press.Google Scholar
- Enenkel, M., See, L., Karner, M., Álvarez, M., Rogenhofer, E., Baraldès-Vallverdú, C., Lanusse, C. & Salse, N. (2015b). Food security monitoring via mobile data collection and remote sensing: Results from the Central African Republic. PloS One, 10(11), p.e0142030.Google Scholar
- FAO, IFAD, UNICEF, WFP & WHO. (2017). The state of food security and nutrition in the world 2017. Building resilience for peace and food security. Rome, FAO. Available at: https://docs.wfp.org/api/documents/WFP-0000022419/download/?_ga=2.172148192.254743601.1517331528-1003727597.1509551064. Accessed 5 Mar 2019.
- FAO, IFAD, UNICEF, WFP & WHO. (2018). The state of food security and nutrition in the world 2018. Building climate resilience for food security and nutrition. Rome, FAO.Google Scholar
- FEWS NET. (2015a). Ethiopia Food Security Outlook October 2015 to March 2016. Available at http://fews.net/east-africa/ethiopia/foodsecurity-outlook/october-2015. Accessed 5 Mar 2019.
- FEWS NET. (2015b). Ethiopia Food Security Outlook July to December 2015. Available at http://fews.net/east-africa/ethiopia/food-security-outlook/july-2015. Accessed 5 Mar 2019.
- FEWS NET. (2015c). Ethiopia Food Security Outlook April to September 2015 Available at http://fews.net/east-africa/ethiopia/food-security-outlook/april-2015. Accessed 5 Mar 2019.
- FEWS NET. (2016). Ethiopia Food Security Outlook February to September 2016. Available at http://fews.net/east-africa/ethiopia/food-security-outlook/february-2016. Accessed 5 Mar 2019.
- FEWS NET. (2017a). Food Insecurity Mapping. Available at: http://fews.net/fews-data/334. Accessed 5 Mar 2019.
- FEWS NET. (2017b). Global Alert: Very large assistance needs and famine risk will continue in 2018. Available at: http://www.fews.net/global/alert/november-28-2017. Accessed 5 Mar 2019.
- FEWS NET. (2018a). Hunger-related Mortality Likely as IPC Phase 4 Outcomes and Large-Scale Assistance Needs Persist. Available at: https://fews.net/sites/default/files/Food_assistance_peak_needs_2019.pdf. Accessed 5 Mar 2019.
- FEWS NET. (2018b). Agroclimatology: Analyzing the effects of weather and climate on food security. Available at: http://fews.net/sites/default/files/White%20Paper%20-%20Agroclimatology%20-%20Aug2017v2.pdf. Accessed 5 Mar 2019.
- FEWS NET. (2018c). Building rainfall assumptions for scenario development. Washington, DC: FEWS NET. Available at: https://fews.net/sites/default/files/documents/reports/Guidance_Document_Rainfall_2018.pdf. Accessed 5 Mar 2019.
- Food Security Information Network (FSIN) Resilience Measurement Technical Working Group. (2014). A Common Analytical Model for Resilience Measurement: Causal Framework and Methodological Options, Available at: http://www.fsincop.net/resource-centre/detail/en/c/267086/. Accessed 5 Mar 2019.
- Funk, C., Peterson, P., Landsfeld, M., Pedreros, D., Verdin, J., Shukla, S., Husak, G., Rowland, J., Harrison, L., Hoell, A., & Michaelsen, J. (2014). The climate hazards infrared precipitation with stations—a new environmental record for monitoring extremes. Scientific Data, 2, 150066.CrossRefGoogle Scholar
- Headey, D.D., & Ecker, O. (2012). IFPRI Discussion Paper: Improving the measurement of food security, International Food Policy Research Institute (IFPRI). Available at: http://www.ifpri.org/publication/improving-measurement-food-security.
- Hillier, D., & Dempsey, B. (2012). A dangerous delay: the cost of late response to early warnings in the 2011 drought in the horn of Africa. Oxfam Policy and Practice: Agriculture, Food and Land, 12(1), 1–34.Google Scholar
- IPC Global Partners. (2012). Integrated Food Security Phase Classification Technical Manual Version 2.0. Evidence and Standards for Better Food Security Decisions. FAO. Rome.Google Scholar
- Jolliffe, I. T., & Stephenson, D. B. (Eds.). (2012). Forecast verification: a practitioner’s guide in atmospheric science (2nd ed.). Chippenham: John Wiley & Sons, Ltd.Google Scholar
- Rogers, D. & Tsirkunov, V. (2011). Costs and benefits of early warning systems. Global Assessment Report, United Nations International Strategy for Disaster Reduction. Available at: https://www.preventionweb.net/english/hyogo/gar/2011/en/bgdocs/Rogers_&_Tsirkunov_2011.pdf.
- USAID & DRMFSS. (2011). An atlas of Ethiopian livelihoods. USAID/DRMFSS: Addis Ababa.Google Scholar
- WFP. (2016). WFP El Niño Response in Ethiopia. Available at: https://www.wfp.org/content/wfp-el-nino-response-ethiopia. Accessed 5 Mar 2019.
- Wilkinson, E., Wiengärtner, L., Choularton, R., Bailey, M., Todd, M., Kniveton, D., & Cabot Venton, C. (2018). Forecasting hazards, averting disasters: Implementing forecast-based action at scale. London: Overseas Development Institute.Google Scholar