Health Services and Outcomes Research Methodology

, Volume 8, Issue 3, pp 119–133 | Cite as

Signal-to-noise ratio (SNR) as a measure of reproducibility: design, estimation, and application

  • N. Elkum
  • M. M. Shoukri


This paper proposes the use of signal-to-noise ratio (SNR) as another index of a measurement’s reproducibility. We derive its maximum likelihood estimation and discuss confidence interval construction within the framework of the one-way random effect model. We investigate the validity of the approximate normal confidence interval by Monte-Carlo simulations. The paper also derives the optimal allocation for the number of subject and the number of repeated measurements needed to minimize the variance of the maximum likelihood estimator of the SNR. We discuss efficiency in estimation and cost considerations for the optimal allocation of the sample resources. The approach is illustrated on two examples: one from MRI data and the other on the WHO immunization coverage data.


Random effect model Likelihood inference Delta method Monte-Carlo simulations 


  1. Ashton, E.A., Takahashi, C., Berg, M.J., Goodman, A., Totterman, S., Ekholm S.: Accuracy and reproducibility of manual and semi automated quantification of MS lesions by MRI. J. Magn. Reson. Imaging 17, 300–308 (2003)PubMedCrossRefGoogle Scholar
  2. Berube, Wu: Signal-to-noise ratio and related measures in parameter design optimization: an overview. Sankhya 62, 417–432 (2000)Google Scholar
  3. Box, G.: Signal-to-noise ratios, performance criteria, and transformations (with discussion). Technometrics 30, 1–40 (1988)CrossRefGoogle Scholar
  4. Box, G., Bisgaard, S.: The scientific context of quality improvement. Qual. Prog. 6, 54–61 (1987)Google Scholar
  5. Cunningham, I., Shaw, R.: Signal-to-noise optimization of medical imaging system. J. Opt. Soc. Am. A 16, 621–632 (1999)CrossRefGoogle Scholar
  6. Dunn, G.: Design and analysis of reliability studies. Stat. Methods Med. Res. 1, 123–157 (1992)PubMedCrossRefGoogle Scholar
  7. Fleiss, J.: Design and Analysis of Clinical Experiments. Wiley, New York (1986)Google Scholar
  8. Jung, J.A., Coakley, F.V., Vigneron, D.B., Swanson, M.G., Qayyum, A., Weinberg, V., Jones K.D., Carroll, P.R., Kurhanewicz, J.: Prostate depiction at endorectal MR spectroscopic imaging: investigation of a standardized evaluation system. Radiology 233, 701–708 (2004)PubMedCrossRefGoogle Scholar
  9. Kendall, M., Stuart, A.: The Advanced Theory of Statistics. Griffin, London (1986)Google Scholar
  10. Mian, I., Shoukri, M., Tracy, D.: Maximum likelihood estimation of sibling correlations in the analysis of family data. J. Stat. Plan. Inference 27, 125–141 (1991)CrossRefGoogle Scholar
  11. Nair, V.: Taguchi’s parameter design: a panel discussion. Technometrics 34, 127–160 (1992)CrossRefGoogle Scholar
  12. Nair, V., Pregibon, D.: A data analysis strategy for quality engineering experiments. AT&T Tech. J. 65, 73–84 (1986)Google Scholar
  13. Rao, S.: Optimization: Theory and Applications. Wiley Eastern Limited, New Delhi (1994)Google Scholar
  14. Scheffe, H.: The Analysis of Variance. Wiley, New York (1959)Google Scholar
  15. Shoukri, M.M.: Measures of Inter-observer Agreement. Chapman & Hall/CRC Press, Boca Raton, FL (2004)Google Scholar
  16. Sim, K.S., Kamel, N.S.: Image signal-to-noise ratio estimation using the autoregressive model. Scanning 26, 135–139 (2004)PubMedGoogle Scholar
  17. Srinivasan, S., Ophir, J., Alam, S.K.: Theoretical derivation of SNR, CNR and spatial resolution for a local adaptive strain estimator for elastography. Ultrasound Med. Biol. 30, 1185–1197 (2004)PubMedCrossRefGoogle Scholar
  18. Sukhatme, P., Sukhatme, B., Sukhatme, S., Asok, C.: Sampling Theory of Surveys with Applications. Iowa State University Press, Ames, IA (1984)Google Scholar
  19. Taguchi, G.: Introduction to Quality Engineering: Designing Quality into Products and Processes. Kraus International Publications, White Plains, NY (1986)Google Scholar
  20. Taguchi, G., Wu, Y.: Introduction to Off-line Quality Control. Central Japan Quality Control Association, Nagaya, Japan (1985)Google Scholar
  21. Tukey, J.: Variance of variance components: I. Balanced design. Ann. Math. Stat. 27, 722–736 (1956)CrossRefGoogle Scholar
  22. World Health Organization, Department of Immunization Vaccines and Biologicals, Vaccine Assessment and Monitoring Team. Accessed 16 Apr 2005

Copyright information

© Springer Science+Business Media, LLC 2008

Authors and Affiliations

  1. 1.Department of Biostatistics and Epidemiology and Scientific ComputingKing Faisal Specialist Hospital & Research CentreRiyadhSaudi Arabia
  2. 2.Department of Epidemiology and Biostatistics, Schulich School of MedicineUniversity of Western OntarioLondonCanada

Personalised recommendations