Advertisement

False confidence: are we ignoring significant sources of uncertainty?

  • Brandon KuczenskiEmail author
COMMENTARY AND DISCUSSION ARTICLE
  • 31 Downloads

Abstract

Purpose

With the increasing use of stochastic simulation, also known as Monte Carlo simulation, to perform uncertainty analysis in life cycle assessment, it is important to consider whether the predominant methods and practices in the field accurately represent uncertainty in the results.

Methods

Two quantitative aspects of uncertainty characterization in ecoinvent, namely the derivation of additional uncertainty from the pedigree matrix and the use of static market activities to model consumption mixes, are reviewed with respect to their effects on stochastic simulation results. A discrete choice simulation is applied to model uncertainty in a consumption mix, and the results are compared to the conventional approach.

Results and discussion

Both practices studied are found to systematically underestimate uncertainty as measured by the size of the confidence interval. In markets with multiple suppliers, the uncertainty in the market average is dramatically narrower than the variability in the suppliers themselves.

Conclusions

The current state of practice leads to false inferences and may be misleading to the public. Life cycle assessment researchers should distinguish between synthetic variability models, such as those used in ecoinvent, and authentic estimates of uncertainty in foreground models. The community must continue to develop and critically evaluate methods for uncertainty characterization.

Keywords

Life cycle assessment Uncertainty Stochastic simulation Pedigree matrix Monte carlo 

Notes

References

  1. Brugnach M, Tagg A, Keil F, de Lange WJ (2006) Uncertainty matters: computer models at the science–policy interface. Water Resour Manag 21(7):1075–1090CrossRefGoogle Scholar
  2. Ciroth A, Fleischer G, Steinbach J (2004) Uncertainty calculation in life cycle assessments. Int J Life Cycle Assess 9(4):216–226CrossRefGoogle Scholar
  3. Ciroth A, Muller S, Weidema B, Lesage P (2013) Empirically based uncertainty factors for the pedigree matrix in ecoinvent. Int J Life Cycle Assess 21(9):1338–1348CrossRefGoogle Scholar
  4. ecoinvent Centre (2019) How to interpret the uncertainty fields in ecoinvent? https://www.ecoinvent.org/support/faqs/methodology-of-ecoinvent-3/how-to-interpret-the-uncertainty-fields-in-ecoinvent.html. Accessed 15 Jan 2019
  5. Finnveden G, Lindfors LG (1998) Data quality of life cycle inventory data — rules of thumb. Int J Life Cycle Assess 3(2):65–66CrossRefGoogle Scholar
  6. Frischknecht R, Jungbluth N, Althaus HJ, Doka G, Dones R, Heck T, Hellweg S, Hischier R, Nemecek T, Rebitzer G, Spielmann M (2005) The ecoinvent database: overview and methodological framework. Int J Life Cycle Assess 10(1):3–9CrossRefGoogle Scholar
  7. Henriksson PJG, Heijungs R, Dao HM, Phan LT, de Snoo GR, Guinée JB (2015) Product carbon footprints and their uncertainties in comparative decision contexts. PLoS One 10(3):e0121221.  https://doi.org/10.1371/journal.pone.0121221 CrossRefGoogle Scholar
  8. Huijbregts MAJ, Norris G, Bretz R, Ciroth A, Maurice B, Bahr B, Weidema B, Beaufort ASH (2001) Framework for modelling data uncertainty in life cycle inventories. Int J Life Cycle Assess 6(3):127–132CrossRefGoogle Scholar
  9. Kuczenski B (2019) Market variability in Ecoinvent. GitHub repository. https://github.com/bkuczenski/variability_jlca
  10. Lesage P, Mutel C, Schenker U, Margni M (2018) Uncertainty analysis in LCA using precalculated aggregated datasets. Int J Life Cycle Assess 23(11):2248–2265CrossRefGoogle Scholar
  11. Lesage P, Mutel C, Schenker U, Margni M (2019) Are there infinitely many trucks in the technosphere, or exactly one? How independent sampling of instances of unit processes affects uncertainty analysis in LCA. Int J Life Cycle Assess 24(2):338–350CrossRefGoogle Scholar
  12. Maurice B, Frischknecht R, Coelho-Schwirtz V, Hungerbühler K (2000) Uncertainty analysis in life cycle inventory. Application to the production of electricity with French coal power plants. J Clean Prod 8(2):95–108CrossRefGoogle Scholar
  13. Mendoza Beltran A, Prado V, Font Vivanco D, Henriksson PJG, Guinée JB, Heijungs R (2018) Quantified uncertainties in comparative life cycle assessment: what can be concluded? Environ Sci Technol 52(4):2152–2161Google Scholar
  14. Muller S, Lesage P, Ciroth A, Mutel C, Weidema BP, Samson R (2014) The application of the pedigree approach to the distributions foreseen in ecoinvent v3. Int J Life Cycle Assess 21(9):1327–1337CrossRefGoogle Scholar
  15. Muller S, Lesage P, Samson R (2016) Giving a scientific basis for uncertainty factors used in global life cycle inventory databases: an algorithm to update factors using new information. Int J Life Cycle Assess 21(8):1185–1196CrossRefGoogle Scholar
  16. Qin Y, Suh S (2016) What distribution function do life cycle inventories follow? Int J Life Cycle Assess 22(7):1138–1145CrossRefGoogle Scholar
  17. Sonnemann GW, Schuhmacher M, Castells F (2003) Uncertainty assessment by a Monte Carlo simulation in a life cycle inventory of electricity produced by a waste incinerator. J Clean Prod 11(3):279–292CrossRefGoogle Scholar
  18. Suh S, Qin Y (2017) Pre-calculated LCIs with uncertainties revisited. Int J Life Cycle Assess 22(5):827–831CrossRefGoogle Scholar
  19. Tecchio P, Gregory J, Ghattas R, Kirchain R (2018) Structured under-specification of life cycle impact assessment data for building assemblies. J Ind Ecol.  https://doi.org/10.1111/jiec.12746
  20. Vose D (1997) Monte Carlo risk analysis modeling. Chap. I.4 of: Molak, Vlasta (ed), Fundamentals of risk analysis and risk management. CRC PressGoogle Scholar
  21. Weidema BP, Wesnæs MS (1996) Data quality management for life cycle inventories—an example of using data quality indicators. J Clean Prod 4(3–4):167–174CrossRefGoogle Scholar
  22. Woods L (2019) Thinkstep glycerine data. Extract from GaBi Professional database, Service Pack 35. Delivered by Personal communication, 10 January 2019. Datasets: 273fa3fa-94fc-4d7e-bdf2-8f5033a9a71b, 3f2aca16-dd5d-4ad7-907b-19cda5f13c50.Google Scholar
  23. Yang Y, Tao M, Suh S (2017) Geographic variability of agriculture requires sector-specific uncertainty characterization. Int J Life Cycle Assess 23(8):1581–1589CrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Institute for Social, Behavioral, and Economic ResearchUniversity of CaliforniaSanta BarbaraUSA

Personalised recommendations