Modelling of Subjective Radiological Assessments with Objective Image Quality Measures of Brain and Body CT Images
In this work we determine how well the common objective image quality measures (Mean Squared Error (MSE), local MSE, Signal-to-Noise Ratio (SNR), Structural Similarity Index (SSIM), Visual Signal-to-Noise Ratio (VSNR) and Visual Information Fidelity (VIF)) predict subjective radiologists’ assessments for brain and body computed tomography (CT) images.
A subjective experiment was designed where radiologists were asked to rate the quality of compressed medical images in a setting similar to clinical. We propose a modified Receiver Operating Characteristic (ROC) analysis method for comparison of the image quality measures where the “ground truth” is considered to be given by subjective scores. The best performance was achieved by the SSIM index and VIF for brain and body CT images. The worst results were observed for VSNR.
We have utilized a logistic curve model which can be used to predict the subjective assessments with an objective criteria. This is a practical tool that can be used to determine the quality of medical images.
KeywordsMean Square Error Image Quality Assessment Body Compute Tomography Quality Assessment Method Objective Image Quality
We thank Prof. Paul Marriott, Department of Statistics and Actuarial Sciences, University of Waterloo for valuable advice with regard to the statistical design of our experiments. This research was supported in part by Discovery Grants from the Natural Sciences and Engineering Research Council of Canada (ERV and ZW).
- 2.Chandler, D.M., Lim, K.H., Hemami, S.S.: Effects of spatial correlations and global precedence on the visual fidelity of distorted images. In: Human Vision and Electronic Imaging XI, vol. 6057, February 2006Google Scholar
- 3.Cosman, P.C., Gray, R.M., Olshen, R.A.: Evaluating quality of compressed medical images: Snr, subjective rating, and diagnostic accuracy. In: 82 (ed.) Proceedings of the IEEE, vol. 6, pp. 919–932, June 1994Google Scholar
- 5.A. George and S. J. Livingston. A survey on full reference image quality assessment algorithms. IJRET: Int. J. Research Eng. Technol. 2(12), December 2013Google Scholar
- 6.Koff, D., Bak, P., Brownrigg, P., Hosseinzadeh, D., Khademi, A., Kiss, A., Lepanto, L., Michalak, T., Shulman, H., Volkening, A.: Pan-canadian evaluation of irreversible compression ratios (lossy compression) for development of national guidelines. J. Digit. Imaging 22(6), 569–578 (2009)CrossRefGoogle Scholar
- 7.Koff, D., Shulman, H.: An overview of digital compression of medical images: Can we use lossy image compression in radiology? CARJ 57(4), 211–217 (2006)Google Scholar
- 8.Kowalik-Urbaniak, I.A.: The quest for ’diagnostically lossless’ medical image compression using objective image quality measures. Ph.D. thesis, University of Waterloo, 200 University Ave W, Waterloo, ON N2L 3G1 (2014)Google Scholar
- 9.Kowalik-Urbaniak, I.A., Brunet, D., Wang, J., Vrscay, E., Wang, Z., Koff, D., Koff, N., Wallace, B.: The quest for ’diagnostically lossless’ medical image compression: a comparative study of objective quality metrics for compressed medical images. In: Medical Imaging : Image Perception. Observer Performance, and Technology Assessment 9037, 2014 (2014)Google Scholar
- 13.European Society of Radiology: (ESR). Usability of irreversible image compression in radiological imaging. Insights into. Imaging 2(2), 103–115 (2011)Google Scholar