Abstract
In this paper, we propose a new statistical approach to investigate the performance of some objective quality metrics used in the literature in order to determine the most suitable quality metric for watermark transparency evaluation. To this end, we have defined a new procedure based on the ANOVA (ANalysis Of VAriance) tests and the subjective performance evaluation. Firstly, a set of selected quality metrics is statistically analyzed by means of ANOVA technique to identify the specific metric that provides the best discrimination to watermarking artifacts. So, the obtained results will answer the question: “which metrics are sensitive to watermarking artifacts?” Secondly, subjective tests were performed and some correlation measures between MOS (Mean Opinion Score) and each quality metric are computed. It is clear that the best quality metric is the one that provides the best consistency with subjective experiments. Results from both objective and subjective investigations were discussed to give some concluding remarks. All conclusions drawn in the paper are supported by extensive experiments in terms of used quality metrics, watermarking algorithms and image database.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Petitcolas, F.A.P.: Watermarking schemes evaluation. IEEE Signal Processing 17(5), 58–64 (2000)
Petitcolas, F.A.P., Anderson, R.J., Kuhn, M.G.: Attacks on copyright marking systems. In: Aucsmith, D. (ed.) IH 1998. LNCS, vol. 1525, pp. 219–239. Springer, Heidelberg (1998)
Solachidis, V., Tefas, A., Nikolaidis, N., Pitas, I.: A benchmarking protocol for watermarking methods. In: Procs. of IEEE Int. Conf. on Image Processing (ICIP 2001), Thessaloniki, Greece, pp. 1023–1026 (October 2001)
Pereira, S., Voloshynovskiy, S., Madueño, M., Marchand-Maillet, S., Pun, T.: Second generation benchmarking and application oriented evaluation. In: Moskowitz, I.S. (ed.) IH 2001. LNCS, vol. 2137, pp. 219–239. Springer, Heidelberg (2001)
Benjamin, M., Benoît, M.: Benchmarking Image Watermarking Algorithms with OpenWatermark. In: Procs. of 14th European Signal Processing Conference - EUSIPCO 2006, Florence, Italy (September 2006)
Kim, H.C., Lin, H.C., Guitart, O., Delp, E.J.: Further Progress in Watermark Evaluation Testbed (WET). In: Wong, P.W., Delp, E.J. (eds.) Procs. of the SPIE Int. Conf. on Security and Watermarking of Multimedia Contents (January 2005)
Marini, E., Autrusseau, F., Le Callet, P., Campisi, P.: Evaluation of standard watermarking techniques. In: Procs. of SPIE Electronic Imaging, Security, Steganography, and Watermarking of Multimedia Contents (January 2007)
Meerwald, P.: Digital Image Watermarking in the Wavelet Transform Domain. Master’s thesis, Dept. of Scientific Computing, University of Salzburg, Austria (January 2001)
Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, P.E.: Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing 13(4), 600–612 (2004)
Wang, Z., Bovik, A.C.: A universal image quality index. IEEE Signal Processing Letters (2001)
Barba, D., Le Callet, P.: A robust quality metric for color image quality assessment. In: Proceedings of the IEEE International Conference on Image Processing, pp. 437–440 (2003)
Pereira, S.: Robust digital image watermarking. PhD thesis, Genève, Swiss (2000)
Beghdadi, A., Popescu, B.P.: A New Image Distortion Measure Based on Wavelet Decomposition. In: Proc. of IEEE ISSPA 2003, Paris, France, vol. 2, pp. 485–488 (2003)
Niranjan, D.V., Thomas, D.K., Wilson, S.G., Brian, L.E., Bovik, A.C.: Image quality assessment based on a degradation model. IEEE Trans. Image Processing 9(4), 636–650 (2000)
Shnayderman, R., Gusev, E., Eskicioglu, A.M.: An SVD-based gray-scale image quality measure for local and global assessment. IEEE Transactions on Image Processing 15(2), 422–429 (2006)
Rencher, A.C.: Methods of Multivariate Analysis, 2nd edn. A John Wiley & Sons, Inc. Publication, Chichester (2002)
Havstad, A.: Image Quality Assessment Using Artificial Neural Networks. Master Thesis, School of Engineering and Mathematics, Edith Cowan University (2004)
ITU-R BT.500-11: Methodology for the subjective assessment of the quality of television pictures (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nguyen, P.B., Luong, M., Beghdadi, A. (2010). Statistical Analysis of Image Quality Metrics for Watermark Transparency Assessment. In: Qiu, G., Lam, K.M., Kiya, H., Xue, XY., Kuo, CC.J., Lew, M.S. (eds) Advances in Multimedia Information Processing - PCM 2010. PCM 2010. Lecture Notes in Computer Science, vol 6297. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15702-8_63
Download citation
DOI: https://doi.org/10.1007/978-3-642-15702-8_63
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15701-1
Online ISBN: 978-3-642-15702-8
eBook Packages: Computer ScienceComputer Science (R0)