Abstract
We use the performance of the Bayesian ideal observer as a figure of merit for hardware optimization because this observer makes optimal use of signal-detection information. Due to the high dimensionality of certain integrals that need to be evaluated, it is difficult to compute the ideal observer test statistic, the likelihood ratio, when background variability is taken into account. Methods have been developed in our laboratory for performing this computation for fixed signals in random backgrounds. In this work, we extend these computational methods to compute the likelihood ratio in the case where both the backgrounds and the signals are random with known statistical properties. We are able to write the likelihood ratio as an integral over possible backgrounds and signals, and we have developed Markov-chain Monte Carlo (MCMC) techniques to estimate these high-dimensional integrals. We can use these results to quantify the degradation of the ideal-observer performance when signal uncertainties are present in addition to the randomness of the backgrounds. For background uncertainty, we use lumpy backgrounds. We present the performance of the ideal observer under various signal-uncertainty paradigms with different parameters of simulated parallel-hole collimator imaging systems. We are interested in any change in the rankings between different imaging systems under signal and background uncertainty compared to the background-uncertainty case. We also compare psychophysical studies to the performance of the ideal observer.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Barrett, H.H., Abbey, C.K.: Bayesian Detection of Random Signals on Random Backgrounds. In: 4th International Conference on Information Processing in Medical Imaging (1997)
Barrett, H.H., Abbey, C.K., Clarkson, E.: Objective assessment of image quality III: ROC metrics, ideal observers, and likelihood- generating functions. J. Opt. Soc. Am. A 15, 1520–1535 (1998)
Barrett, H.H., Abbey, C.K., Clarkson, E.: Some unlikely properties of the likelihood ratio and its logarithm. In: Proc. SPIE 3340 (1998)
Clarkson, E., Barrett, H.H.: Approximation to ideal-observer performance on signal-detection tasks. Applied Optics 39, 1783–1794 (2000)
Clarkson, E.: Bounds on the area under the receiver operating characteristic curve for the ideal observer. J. Opt. Soc. Am. A 19, 1963–1968 (2001)
Gilks, W.R., Richardson, S., Spiegelhalter, D.J. (eds.): Markov Chain Monte Carlo in Practice. Chapman and Hall, Boca Raton (1996)
M. A. Kupinski, J. W. Hoppin, E. Clarkson, and H. H. Barrett: Ideal Observer Computation Using Markov-Chain Monte Carlo. J. Opt. Soc. Am. A ( 2002) (accepted)
Metz, C.E., Herman, B.A., Shen, J.H.: Maximum Likelihood Estimation of Receiver Operating Characteristic (ROC) Curves from Continuously–Distributed Data. Statistics In Medicine 17, 1033–1053 (1998)
Metz, C.E., Pan, X.: Proper Binormal ROC Curves: Theory and Maximum- Likelihood Estimation. Journal of Mathematical Psychology 43, 1–33 (1999)
Rolland, J.P., Barrett, H.H.: Effect of random background inhomogeneity on observer detection performance. J. Opt. Soc. Am. A 9, 649–658 (1992)
Zhang, H.: Signal Detection in Medical Imaging. Ph.D. Dissertation, The University of Arizona (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Park, S., Kupinski, M.A., Clarkson, E., Barrett, H.H. (2003). Ideal-Observer Performance under Signal and Background Uncertainty. In: Taylor, C., Noble, J.A. (eds) Information Processing in Medical Imaging. IPMI 2003. Lecture Notes in Computer Science, vol 2732. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45087-0_29
Download citation
DOI: https://doi.org/10.1007/978-3-540-45087-0_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40560-3
Online ISBN: 978-3-540-45087-0
eBook Packages: Springer Book Archive