Abstract
As the results of computer algorithms methods are often visual, image quality assessment is one of its central problems. To provide a convincing proof that a new method is better than the state-of-the-art the image quality assessment should be employed. Therefore image based projects are often accompanied by user studies, in which a group of observers rank or rate results of several algorithms. Unfortunately the problem posed by subjective experiments is their time-consuming and expensive nature. This paper is intended to present how to make the subjective experiments less expensive and therefore more usable.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Gulliksen, H., Tucker, L.R.: A general procedure for obtaining paired comparisons from multiple rank orders. Psychometrika 26, 173–184 (1961)
Keelan, B.W.: A psychophysical image quality measurement standard. SPIE 5294, 181–189 (2003)
Larson, E.C., Chandler, D.M.: Most apparent distortion: full-reference image quality assessment and the role of strategy. J. Electr. Imaging 19(1) (2010)
Lewandowska (Tomaszewska), A.: Scene reduction for subjective image quality assessment. J. Electr. Imaging 25(1), 221–226 (2016)
(Tomaszewska), A.L.: Time compensation in perceptual experiments. In: Chmielewski, L.J., Kozera, R., Shin, B.-S., Wojciechowski, K. (eds.) ICCVG 2014. LNCS, vol. 8671, pp. 33–40. Springer, Heidelberg (2014). doi:10.1007/978-3-319-11331-9_5
Mantiuk, R., Mantiuk, R., Tomaszewska, A., Heidrich, W.: Color correction for tone mapping. Comput. Graph. Forum 28, 193–202 (2009)
Mantiuk, R., Tomaszewska, A., Mantiuk, R.: Comparison of four subjective methods for image quality assessment. Comput. Graph. Forum 31, 2478–2491 (2012)
Pitrey, Y., Barkowsky, M., Pepion, R., Le Callet, P., Hlavacs, H.: Influence of the source content and encoding configuration on the perceived quality for scalable video coding. In: Proceedings of SPIE, vol. 8291, pp. 82911K–82911K-8 (2012)
Pinson, M., Wolf, S.: Techniques for evaluating objective video quality models using overlapping subjective data sets [electronic resource]/Pinson, M.H., Wolf, S. U.S. Department of Commerce, National Telecommunications and Information Administration, 1 online resource United States (2008)
Pitrey, Y., Robitza, W., Hlavacs, H.: Instance selection techniques for subjective quality of experience evaluation. In: QoEMCS, Part of the EuroITV Conference (2012). http://dcti.iscte.pt/events/qoemcs/
Ponomarenko, N., Lukin, V., Zelensky, A., Egiazarian, K., Carli, M., Battisti, F.: TID2008 - a database for evaluation of full-reference visual quality assessment metrics. Adv. Mod. Radioelectronics 10, 30–45 (2009)
Ponomarenko, N., Ieremeiev, L.J.O., Lukin, V., Egiazarian, E., Astola, J., Vozel, B., Chehdi, K., Carli, M., Battisti, F., Jay Kuo, C.C.: Image database TID2013: peculiarities, results and perspectives. Signal Process. Image Commun. 30, 57–77 (2015)
Sheikh, H.R., Sabir, M.F., Bovik, A.C.: A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Trans. Image Process. 15(11), 3441–3452 (2006)
Silverstein, D.A., Farrell, J.E.: Efficient method for paired comparison. J. Electr. Imaging 10, 394–398 (2001)
Strauss, C., Pasteau, F., Autrusseau, F., Babel, M., Bedat, L., Deforges, O.: Subjective and objective quality evaluation of LAR coded art images. In: IEEE International Conference on Multimedia & Expo, ICME 2009, New York, USA (2009)
Tomaszewska, A.: Blind noise level detection. In: Campilho, A., Kamel, M. (eds.) ICIAR 2012. LNCS, vol. 7324, pp. 107–114. Springer, Heidelberg (2012). doi:10.1007/978-3-642-31295-3_13
Tomaszewska, A.: User study in non-static HDR scenes acquisition. In: Bolc, L., Tadeusiewicz, R., Chmielewski, L.J., Wojciechowski, K. (eds.) ICCVG 2012. LNCS, vol. 7594, pp. 245–252. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33564-8_30
Tomaszewska, A., Stefanowski, K.: Real-time spherical harmonics based subsurface scattering. In: Campilho, A., Kamel, M. (eds.) ICIAR 2012. LNCS, vol. 7324, pp. 402–409. Springer, Heidelberg (2012). doi:10.1007/978-3-642-31295-3_47
Zhang, L., Zhang, L., Mou, X., Zhang, D.: FSIM: a feature similarity index for image quality assessment. IEEE Trans. Image Process. 20(8), 2378–2386 (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Lewandowska (Tomaszewska), A. (2017). Subjective Image Quality Assessment Optimization. In: ChoraÅ›, R. (eds) Image Processing and Communications Challenges 8. IP&C 2016. Advances in Intelligent Systems and Computing, vol 525. Springer, Cham. https://doi.org/10.1007/978-3-319-47274-4_20
Download citation
DOI: https://doi.org/10.1007/978-3-319-47274-4_20
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-47273-7
Online ISBN: 978-3-319-47274-4
eBook Packages: EngineeringEngineering (R0)