Research Issues and Ideas on Health-Related Surveillance

  • William H. Woodall
  • Olivia A. Grigg
  • Howard S. Burkom


In this overview paper, some of the surveillance methods and metrics used in health-related applications are described and contrasted with those used in industrial practice. Many of the aforesaid methods are based on the concepts and methods of statistical process control. Public health data often include spatial information as well as temporal information, and in this and other regards, public health applications could be considered more challenging than industrial applications. Avenues of research into various topics in health-related monitoring are suggested.


Control Chart Royal Statistical Society Statistical Process Control Quality Technology Syndromic Surveillance 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Axelrod DA, Guidinger MK, Metzger RA, Wiesner RH, Webb RL, Merion RM (2006) Transplant Center Quality Assessment Using a Continuously Updatable, Risk-Adjusted Technique (CUSUM). American Journal of Transplantation 6: 313–323.CrossRefGoogle Scholar
  2. Benjamini Y, Hochberg Y (1995) Controlling the False Discovery Rate: a Practical and Powerful Approach to Multiple Testing. Journal of the Royal Statistical Society, Series B, 57(1): 289–300.MATHMathSciNetGoogle Scholar
  3. Benjamini Y, Kling Y (1999) A Look at Statistical Process Control Through the pvalues. Technical Report RP-SOR-99-08. Tel Aviv University, Israel.˜ybenja/KlingW.html Accessed on 10/04/05.
  4. Benneyan JC (2001) Number-Between g-Type Statistical Control Charts for Monitoring Adverse Events. Health Care Management Science 4: 305–318.CrossRefGoogle Scholar
  5. Benneyan JC (2006) Discussion of “Use of Control Charts in Health Care Monitoring and Public Health Surveillance” by WH Woodall. Journal of Quality Technology 38: 113–123.Google Scholar
  6. Breiman L (2001) Statistical Modelling: The Two Cultures (with discussion). Statistical Science 16: 199–231.MATHCrossRefMathSciNetGoogle Scholar
  7. Buckeridge DL, Burkom H, Campbell M, Hogan WR, Moore AW (2005) Algorithms for Rapid Outbreak Detection: A Research Synthesis. Journal of Biomedical Informatics 38: 99–113.CrossRefGoogle Scholar
  8. Burr T, Graves T, Klamann R, Michalak S, Picard R, Hengartner N (2006) Accounting for Seasonal Patterns in Syndromic Surveillance Data for Outbreak Detection. BMC Medical Informatics and Decision Making 6: 40.CrossRefGoogle Scholar
  9. Chen R (1978) A Surveillance System for Congenital Malformations. Journal of the American Statistical Association 73: 323–327.CrossRefGoogle Scholar
  10. Cowling BJ, Wong IOL, Ho LM, Riley S, Leung GM (2006) Methods for Monitoring Influenza Surveillance Data. International Journal of Epidemiology 35: 1314–1321.CrossRefGoogle Scholar
  11. Fienberg SE, Shmueli G (2005) Statistical Issues and Challenges Associated with the Rapid Detection of Terrorist Outbreaks. Statistics in Medicine 24: 513–529.CrossRefMathSciNetGoogle Scholar
  12. Fraker SE, Woodall WH, Mousavi S (2008) Performance Metrics for Surveillance Schemes, To appear in Quality Engineering.Google Scholar
  13. Fricker RD Jr (2007) Directionally Sensitive Multivariate Statistical Process Control Procedures with Application to Syndromic Surveillance. Advances in Disease Surveillance 3: 1–17.Google Scholar
  14. Fricker RD Jr., HR Rolka (2006) Protecting Against Biological Terrorism: Statistical Issues in Electronic Biosurveillance, Chance 19: 4-13.MathSciNetGoogle Scholar
  15. Fricker RD Jr, Hegler, BL, Dunfee DA (2007). Comparing Syndromic Surveillance Detection Methods: EARS' versus a CUSUM-based Methodology. Statistics in Medicine 27: 3407-3429.CrossRefMathSciNetGoogle Scholar
  16. Fricker RD Jr, Knitt M C, Hu CX (2008). Comparing Directionally Sensitive MCUSUM and MEWMA Procedures with Application to Biosurveillance. To appear in Quality Engineering.Google Scholar
  17. Frisén M (1992) Evaluation of Methods for Statistical Surveillance. Statistics in Medicine 11: 1489–1502.CrossRefGoogle Scholar
  18. Frisén M (2003) Statistical Surveillance, Optimality and Methods. International Statistical Review 71: 403–434.MATHGoogle Scholar
  19. Frisén M, Sonesson C (2005) Optimal Surveillance. In: Lawson AB, Kleinman K (eds) Spatial & Syndromic Surveillance John Wiley & Sons, Ltd., New York, NY, pp. 31–52.CrossRefGoogle Scholar
  20. Frisén M, Wessman P (1999) Evaluation of Likelihood Ratio Methods for Surveillance. Communications in Statistics – Simulation and Computation 28: 597–622.MATHCrossRefGoogle Scholar
  21. Grigg O, Farewell V (2004a) An Overview of Risk-Adjusted Charts. Journal of the Royal Statistical Society A 167: 523–539.CrossRefMathSciNetGoogle Scholar
  22. Grigg O, Farewell V (2004b) A Risk-adjusted Sets Method for Monitoring Adverse Medical Outcomes. Statistics in Medicine 23: 1593-1602.CrossRefGoogle Scholar
  23. Grigg O, Spiegelhalter D (2006) Discussion of “Use of Control Charts in Health Care Monitoring and Public Health Surveillance” by WH Woodall. Journal of Quality Technology 38: 124–126.Google Scholar
  24. Grigg O, Spiegelhalter D (2007) A Simple Risk-Adjusted Exponentially Weighted Moving Average. Journal of the American Statistical Association 102: 140–152.MATHCrossRefMathSciNetGoogle Scholar
  25. Grigg O, Spiegelhalter D (2008) The Null Steady-State Distribution of the CUSUM Statistic. To appear in Technometrics.Google Scholar
  26. Grigg O, Spiegelhalter D, Jones H (2008) Local and Marginal Control Charts Applied to MRSA Bacteraemia Reports in UK Acute NHS Trusts. To appear in the Journal of the Royal Statistical Society, Series A.Google Scholar
  27. Hawkins DM (1993) Regression Adjustment for Variables in Multivariate Quality Control. Journal of Quality Technology 25: 170-81.Google Scholar
  28. Ismail NA, Pettitt AN, Webster RA (2003) ‘Online’ Monitoring and Retrospective Analysis of Hospital Outcomes Based on a Scan Statistic. Statistics in Medicine 22: 2861–2876.CrossRefGoogle Scholar
  29. Joner MD Jr, Woodall WH, Reynolds MR, Jr (2008a) On Detecting a Rate Increase Using a Bernoulli-based Scan Statistic. Statistics in Medicine 27: 2555-2575.CrossRefMathSciNetGoogle Scholar
  30. Joner MD Jr, Woodall WH, Reynolds MR Jr, Fricker RD Jr (2008b) A One-sided MEWMA Chart for Health Surveillance. in Quality and Reliability Engineering International 24: 503-518.CrossRefGoogle Scholar
  31. Kleinman K, Lazarus R, Platt, R (2004) A Generalized Linear Models Approach for Detecting Incident Clusters of Disease in Small Areas, with an Application to Biological Terrorism (with discussion). American Journal of Epidemiology 159: 217–228.CrossRefGoogle Scholar
  32. Kulldorff M (1997) A Spatial Scan Statistic. Communications in Statistics – Theory and Methods 26: 1481–1496.MATHCrossRefMathSciNetGoogle Scholar
  33. Kulldorff M (2001) Prospective Time Periodic Geographical Disease Surveillance Using a Scan Statistic. Journal of the Royal Statistical Society A 164: 61–72.MATHCrossRefMathSciNetGoogle Scholar
  34. Kulldorff, M (2005) SaTScanTM: Software for the spatial, temporal, and spacetime scan statistics, version 5.1 [computer program]. Information Management Services 2005; Available:
  35. Lawson AB, Kleinman K (2005) Spatial & Syndromic Surveillance for Public Health, John Wiley & Sons, Inc., New York.CrossRefGoogle Scholar
  36. Marshall C, Best N, Bottle A, Aylin P (2004) Statistical Issues in the Prospective Monitoring of Health Outcomes Across Multiple Units. Journal of the Royal Statistical Society, Series A, 167(3): 541–559.MathSciNetGoogle Scholar
  37. Naus J, Wallenstein S (2006) Temporal Surveillance Using Scan Statistics. Statistics in Medicine 25: 311–324.CrossRefMathSciNetGoogle Scholar
  38. Novick RJ, Fox SA, Stitt LW, Forbes TL, Steiner S (2006) Direct Comparison of Risk-Adjusted and Non-Risk-Adjusted CUSUM Analyses of Coronary Artery Bypass Surgery Outcomes. The Journal of Thoracic and Cardiovascular Surgery 132: 386–391.CrossRefGoogle Scholar
  39. Porter, ME, Teisberg EO (2006) Redefining Health Care, Creating Value-Based Competition Based on Results. Harvard Business School Press, Boston MA.Google Scholar
  40. Reynolds MR Jr, Stoumbos ZG (1999) A CUSUM Chart for Monitoring a Proportion When Inspecting Continuously. Journal of Quality Technology 31: 87–108.Google Scholar
  41. Rolka H, Burkom H, Cooper GF, Kulldorff M, Madigan D, Wong WK (2007) Issues in Applied Statistics for Public Health Bioterrorism Surveillance Using Multiple Data Streams: Some Research Needs. Statistics in Medicine 26: 1834–1856.CrossRefMathSciNetGoogle Scholar
  42. Sego LH, Woodall WH, Reynolds MR Jr (2008a) A Comparison of Surveillance Methods for Small Incidence Rates. Statistics in Medicine 27: 1225-1247.CrossRefMathSciNetGoogle Scholar
  43. Sego LH, Reynolds MR Jr, Woodall WH (2008b) Risk-Adjusted Monitoring of Survival Times, provisionally accepted by Statistics in Medicine.Google Scholar
  44. Sherlaw-Johnson C, Wilson P, Gallivan S (2007) The Development and Use of Tools for Monitoring the Occurrence of Surgical Wound Infections. Journal of the Operational Research Society 58: 228–234.MATHGoogle Scholar
  45. Shmueli G, Burkom HS (2008) Statistical Challenges in Modern Biosurveillance, to appear in Technometrics.Google Scholar
  46. Sonesson C (2007) A CUSUM Framework for Detection of Space-Time Disease Clusters Using Scan Statistics. Statistics in Medicine 26(26): 4770-4789.CrossRefMathSciNetGoogle Scholar
  47. Sonesson C, Bock D (2003) A Review and Discussion of Prospective Statistical Surveillance in Public Health. Journal of the Royal Statistical Society A 166: 5–21.CrossRefMathSciNetGoogle Scholar
  48. Sparks R (2000) CUSUM Charts for Signaling Varying Location Shifts. Journal of Quality Technology 32: 157-71.Google Scholar
  49. Spliid H (2007) Monitoring Medical Procedures by Exponential Smoothing. Statistics in Medicine 26: 124–138.CrossRefMathSciNetGoogle Scholar
  50. Steiner SH, Cook RJ, Farewell VT, Treasure T (2000) Monitoring Surgical Performance Using Risk-Adjusted Cumulative Sum Charts. Biostatistics 1: 441–452.MATHCrossRefGoogle Scholar
  51. Storey JD, Taylor JE, Siegmund D (2004) Strong Control, Conservative Point Estimation and Simultaneous Conservative Consistency of False Discovery Rates: a Unified Approach. Journal of the Royal Statistical Society, Series B, 66: 187–205.MATHCrossRefMathSciNetGoogle Scholar
  52. Tennant R, Mohammed MA, Coleman JJ, Martin U (2007) Monitoring Patients Using Control Charts: A Systematic Review. To appear in the International Journal for Quality in Health Care.Google Scholar
  53. Thor, J., Lundberg, J., Ask, J., Olsson, J., Carli, C., Härenstam, K. P., and Brommels, M. (2007), “Application of Statistical Process Control in Healthcare Improvement: Systematic Review”, Quality and Safety in Health Care, 16, pp. 387-399.CrossRefGoogle Scholar
  54. Wallenstein S, Naus J (2004) Scan Statistics for Temporal Surveillance for Biologic Terrorism. Morbidity and Mortality Weekly Report 53 (Suppl): 74–78.Google Scholar
  55. Winkel P, Zhang NF (2007) Statistical Development of Quality in Medicine. John Wiley & Sons Ltd: Chichester, pp. 173–181.MATHCrossRefGoogle Scholar
  56. Woodall WH (2006) Use of Control Charts in Health Care Monitoring and Public Health Surveillance (with discussion). Journal of Quality Technology 38: 89–104 (available at ).
  57. Woodall WH, Marshall JB, Joner MD Jr, Fraker SE, Abdel-Salam AG (2008) On the Use and Evaluation of Prospective Scan Methods in Health-Related Surveillance. Journal of the Royal Statistical Society A 171: 223-237.MathSciNetGoogle Scholar
  58. Woodall WH, Spitzner DJ, Montgomery DC, Gupta S (2004) Using Control Charts to Monitor Process and Product Quality Profiles. Journal of Quality Technology 36: 309–320.Google Scholar
  59. Xie M, Goh TN, Kuralmani V (2002) Statistical Models and Control Charts for High Quality Processes, Kluwer Academic Publishers, Norwell, MA.Google Scholar

Copyright information

© Physica-Verlag Heidelberg 2010

Authors and Affiliations

  • William H. Woodall
    • 1
  • Olivia A. Grigg
    • 2
  • Howard S. Burkom
    • 3
  1. 1.Department of StatisticsVirginia TechBlacksburgUSA
  2. 2.MRC Biostatistics UnitInstitute of Public HealthCambridgeUK
  3. 3.National Security Technology DepartmentThe Johns Hopkins University, Applied Physics LaboratoryLaurelUSA

Personalised recommendations