Time Compensation in Perceptual Experiments

  • Anna Lewandowska (Tomaszewska)
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8671)


Image quality plays important role in many image processing applications. To provide a convincing proof that a new method is better than the state-of-the-art, computer graphics projects are often accompanied by user studies, in which a group of observers rank or rate results of several algorithms. Such user studies, known as subjective image quality assessment experiments, are very time consuming. This paper is intended to help design time compensated quality assessment experiment.


Mean Opinion Score Image Quality Assessment Sorting Algorithm Similarity Judgement Perceptual Experiment 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Torgerson, W.S.: Theory and methods of scaling (1985)Google Scholar
  2. 2.
    Keelan, B.W.: A psychophysical image quality measurement standard. In: SPIE, vol. 5294, pp. 181–189 (2003)Google Scholar
  3. 3.
    ITU-T.Rec.P.910, Subjective audiovisual quality assessment methods for multimedia applications (2008)Google Scholar
  4. 4.
    ITU-R.Rec.BT.500-11, Methodology for the Subjective Assessment of the Quality for Television Pictures (2002)Google Scholar
  5. 5.
    Tomaszewska, A., Markowski, M.: Dynamic Scenes HDRI Acquisition. In: Campilho, A., Kamel, M. (eds.) ICIAR 2010, Part II. LNCS, vol. 6112, pp. 345–354. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  6. 6.
    Mantiuk, R., Tomaszewska, A., Mantiuk, R.: Comparison of four subjective methods for image quality assessment. Computer Graphics Forum (2012)Google Scholar
  7. 7.
    Tomaszewska, A.: Blind Noise Level Detection. In: Campilho, A., Kamel, M. (eds.) ICIAR 2012, Part I. LNCS, vol. 7324, pp. 107–114. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  8. 8.
    Tomaszewska, A., Stefanowski, K.: Real-Time Spherical Harmonics Based Subsurface Scattering. In: Campilho, A., Kamel, M. (eds.) ICIAR 2012, Part I. LNCS, vol. 7324, pp. 402–409. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  9. 9.
    Tomaszewska, A.: User Study in Non-static HDR Scenes Acquisition. In: Bolc, L., Tadeusiewicz, R., Chmielewski, L.J., Wojciechowski, K. (eds.) ICCVG 2012. LNCS, vol. 7594, pp. 245–252. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  10. 10.
    Mantiuk, R., Mantiuk, R., Tomaszewska, A., Heidrich, W.: Color correction for tone mapping. Computer Graphics Forum 28, 193–202 (2009)CrossRefGoogle Scholar
  11. 11.
    Wang, Z., Bovik, A.C.: Modern Image Quality Assessment. Morgan & Claypool Publishers (2006)Google Scholar
  12. 12.
    Pedersen, M., Hardeberg, J.Y.: Full-Reference Image Quality Metrics: Classification and Evaluation. Foundations and Trends in Computer Graphics and Vision 7(1), 1–80 (2011)CrossRefGoogle Scholar
  13. 13.
    Sheikh, H.R., Sabir, M.F., Bovik, A.C.: A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms. IEEE Transactions on Image Processing 15(11), 3441–3452 (2006)CrossRefGoogle Scholar
  14. 14.
    Ponomarenko, N., Lukin, V., Zelensky, A., Egiazarian, K., Carli, M., Battisti, F.: TID2008 - A database for evaluation of full-reference visual quality assessment metrics. Advances of Modern Radioelectronics 10, 30–45 (2009)Google Scholar
  15. 15.
    Gulliksen, H., Tucker, L.R.: A general procedure for obtaining paired comparisons from multiple rank orders. Psychometrika 26, 173–184 (1961)CrossRefzbMATHMathSciNetGoogle Scholar
  16. 16.
    Silverstein, D.A., Farrell, J.E.: Efficient method for paired comparison. Journal of Electronic Imaging 10, 394 (2001)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Anna Lewandowska (Tomaszewska)
    • 1
  1. 1.Faculty of Computer Science and Information TechnologyWest Pomeranian University of Technology, SzczecinSzczecinPoland

Personalised recommendations