Structuring expert input for a knowledge-based approach to watershed condition assessment for the Northwest Forest Plan, USA
- 119 Downloads
Assessments of watershed condition for aquatic and riparian species often have to rely on expert opinion because of the complexity of establishing statistical relationships among the many factors involved. Such expert-based assessments can be difficult to document and apply consistently over time and space. We describe and reflect on the process of developing a computer-based decision support application from expert judgments for assessing aquatic and riparian conditions over the 100,000 km2 managed by the US federal government under the Northwest Forest Plan. The decision support system helped structure and document the assessment process and provided consistency and transparency to the evaluation methodology. However, many decisions and trade-offs were required in the expert engagement and model-building processes. Knowledge elicitation in an interactive group had a number of benefits over nominal group or Delphi processes, but efficient knowledge capture required considerable planning and expertise in the subject matter and modeling process. Communicating model results for validation was problematic and only effectively accomplished via in-person workshops. The choice to use different expert groups for each biophysical province provided more opportunities for participation and promoted greater ownership in the assessment, but it also led to increased variation among the resulting model structures. We propose three possible approaches for better managing the consistency of assessment models when multiple expert groups are involved.
KeywordsWatershed assessment Composite indicators Expert judgment Fuzzy logic Modeling Stream condition assessment Stream habitat
Unable to display preview. Download preview PDF.
- Delbecq, A. L., Van de Ven, A. H., & Gustafson, D. H. (1986). Group techniques for program planning: A guide to nominal group and Delphi processes. Middleton: Green Briar.Google Scholar
- Gallo, K., Moyer, C., & Lanigan, S. (2002). Northwest Forest Plan Aquatic And Riparian Effectiveness Monitoring Program: 2001 pilot summary report. USDA Forest Service Regional Ecosystem Office, Portland, OR. Retrieved from http://www.reo.gov/monitoring/reports/watershed/2001_Final_AREMP_Tech_Report.pdf.
- Gallo, K., Lanigan, S. H., Eldred, P., Gordon, S. N., & Moyer, C. (2005). Northwest Forest Plan—The first 10 years (1994–2003): Preliminary assessment of the condition of watersheds. Report PNW-GTR-647. Portland: USDA Forest Service Pacific Northwest Research Station.Google Scholar
- Gordon, S. N. (2006). Decision support systems for forest biodiversity management: A review of tools and an analytical-deliberative framework for understanding their successful application. Doctoral dissertation, Dept. of Forest Resources, Oregon State University, Corvallis, OR. Retrieved from http://ir.library.oregonstate.edu/jspui/handle/1957/2592.
- Herger, L. G., Weiss, A., Augustine, S., & Hayslip, G. (2003). Modeling fish distributions in the Pacific Northwest Coast Range Ecoregion using EMAP data. Report EPA/910/R-03/000. U.S. Environmental Protection Agency, Region 10, Seattle, WA.Google Scholar
- Hubler, S. (2008). PREDATOR: Development and use of RIVPACS-type macroinvertebrate models to assess the biotic condition of wadeable Oregon streams. Hillsboro: Oregon Department of Environmental Quality, Laboratory and Environmental Assessment Division.Google Scholar
- Hubler, S., Miller, S., Merrick, L., Leferink, R., & Borisenko, A. (2009). High level indicators of Oregon’s forested streams. Hillsboro: Oregon Department of Environmental Quality, Laboratory and Environmental Assessment Division.Google Scholar
- Johnson, K. N., Swanson, F., Herring, M., & Greene, S. (Eds.) (1999). Bioregional assessments: Science at the crossroads of management and policy. Washington: Island.Google Scholar
- Johnson, K. N., Gordon, S. N., Duncan, S., Lach, D., McComb, B., & Reynolds, K. (2007). Conserving creatures of the forest: A guide to decision making and decision models for forest biodiversity. Corvallis: College of Forestry, Oregon State University. Retrieved from http://www.ncseonline.org/ncssf/dss.
- Kaufmann, P. R., & Hughes, R. M. (2006). Geomorphic and anthropogenic influences on fish and amphibians in Pacific Northwest coastal streams. In R. M. Hughes, L. Wang, & P. W. Seelbach (Eds.), American fisheries society symposium: Landscape influences on stream habitats and biological assemblages. Bethesda: American Fisheries Society.Google Scholar
- Krueger, R. A., & Casey, M. A. (2000). Focus groups: A practical guide for applied research. Thousand Oaks: Sage.Google Scholar
- Lloyd, R. (1999). Metric mishap caused loss of NASA orbiter. Retrieved from http://www.cnn.com/TECH/space/9909/30/mars.metric.02/.
- Manno, J. P., Smardon, R., DePinto, J. V., Cloyd, E. T., & Del Granado, S. M. (2008). The use of models in Great Lakes decision making: An interdisciplinary synthesis. Report 16. Syracuse: Randolph G. Pack Environmental Institute.Google Scholar
- Marakas, G. M. (1999). Decision support systems in the 21st century. Upper Saddle River: Prentice Hall.Google Scholar
- Marcot, B. G. (2006). Characterizing species at risk I: Modeling rare species under the Northwest Forest Plan. Ecology and Society, 11, 10.Google Scholar
- Mitchell, R. B., Clark, W. C., Cash, D. W., & Dickson, N. M. (Eds.) (2006). Global environmental assessments: Information, institutions, and influence. Cambridge: MIT.Google Scholar
- Mulvey, M., Leferink, R., & Borisenko, A. (2009). Willamette basin rivers and streams assessment. Hillsboro: Oregon Department of Environmental Quality, Laboratory and Environmental Assessment Division.Google Scholar
- Oregon DEQ (2004). Oregon’s 2004 water quality assessment section 305(b) report. Hillsboro: Oregon Department of Environmental Quality, Water Quality Division.Google Scholar
- Pess, G. R., Montgomery, D. R., Steel, E. A., Bilby, R. E., Feist, B. E., & Greenberg, H. M. (2002). Landscape characteristics, land use, and coho salmon (Oncorhynchus kisutch) abundance, Snohomish River, Wash., USA. Canadian Journal of Fisheries and Aquatic Sciences, 59, 613–623.CrossRefGoogle Scholar
- Reeves, G. H., Hohler, D. B., Larsen, D. P., Busch, D. E., Kratz, K., Reynolds, K., et al. (2004). Aquatic and riparian effectiveness monitoring plan for the northwest forest plan. Report PNW-GTR-577. Portland: USDA Forest Service Pacific Northwest Research Station.Google Scholar
- Reynolds, K., & Peets, S. (2001). Integrated assessment and priorities for protection and restoration of watersheds. In: Proceedings of the IUFRO 4.11 conference on forest biometry, modelling and information science. UK: University of Greenwich.Google Scholar
- Reynolds, K. M., Rodriguez, S., & Bevans, K. (2002). Ecosystem management decision support 3.0 user guide. Corvallis: USDA Forest Service Pacific Northwest Research Station.Google Scholar
- Rieman, B. E., Peterson, J. T., Clayton, J., Howell, P., Thurow, R., Thompson, W., et al. (2001). Evaluation of potential effects of federal land management alternatives on trends of salmonids and their habitats in the interior Columbia River basin. Forest Ecology and Management, 153, 43–62.CrossRefGoogle Scholar
- Schmoldt, D. L., & Peterson, D. L. (2000). Analytical group decision making in natural resources: Methodology and application. Forest Science, 46, 62–75.Google Scholar
- Sedell, J. R., Lee, D. C., Rieman, B. E., Thurow, R. F., & Williams, J. E. (1997). Effects of proposed alternatives on aquatic habitats and native fishes. In T. M. Quigley, K. M. Lee, & S. J. Arbelbide (Eds.), Evaluation of EIS alternatives by the science integration team (pp. 435–535). Portland: USDA Forest Service Pacific Northwest Research Station.Google Scholar
- Turban, E., & Aronson, J. E. (2001). Decision support systems and intelligent systems. Upper Saddle River: Prentice Hall.Google Scholar
- USDA & USDI (1994). Record of decision for amendments to Forest Service and Bureau of Land Management planning documents within the range of the northern spotted owl. Washington: USDA Forest Service and Department of Interior Bureau of Land Management.Google Scholar
- van Den Belt, M. (2004). Mediated modeling: A system dynamics approach to environmental consensus building. Washington: Island.Google Scholar