Redefining ITU-T P.912 Recommendation Requirements for Subjects of Quality Assessments in Recognition Tasks

  • Mikołaj I. Leszczuk
  • Artur Koń
  • Joel Dumke
  • Lucjan Janowski
Part of the Communications in Computer and Information Science book series (CCIS, volume 287)


The transmission and analysis of video is often used for a variety of applications outside the entertainment sector, and generally this class of video is used to perform a specific task. Therefore it is crucial to measure, and ultimately, optimize task-based video quality. To develop accurate objective measurements and models for video quality assessment, subjective experiments must be performed. Problems of quality measurements for task-based video are partially addressed in a few preliminary standards and a Recommendation (ITU-T P.912, “Subjective Video Quality Assessment Methods for Recognition Tasks,”) that mainly introduce basic definitions, methods of testing and requirements for subjects taking part in psychophysical experiments. Nevertheless, to the best of the authors’ knowledge, the issue of requirements for subjects has been not verified in any specific academic research. Consequently, in this paper, we compare groups of subjects assessing video quality for task-based video. Once a comparison has been made for task-based video, specifications amendments for P.912 are developed. These will assist researchers of task-based video quality in identifying the subjects that will allow them to successfully perform the psychophysical experiment required.


ITU-T standards systems video quality 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    ANSI S3.2, American National Standard Method for Measuring the Intelligibility of Speech over Communications Systems (1989)Google Scholar
  2. 2.
    ITU-T P.800, Methods for subjective determination of transmission quality (1996),
  3. 3.
    ITU-T P.910, Subjective video quality assessment methods for multimedia applications (1999),
  4. 4.
    ITU-T P.912, Subjective video quality assessment methods for recognition tasks (2008),
  5. 5.
    ITU-R BT.500-12, Methodology for the subjective assessment of the quality of television pictures (2009),
  6. 6.
    CENELEC EN 50132, Alarm systems. CCTV surveillance systems for use in security applications (2011)Google Scholar
  7. 7.
    Ford, C.G., McFarland, M.A., Stange, I.W.: Subjective video quality assessment methods for recognition tasks. In: Proceedings of SPIE, vol. 7240, 72400Z–72400Z–11 (2009)Google Scholar
  8. 8.
    Leszczuk, M., Stange, I., Ford, C.: Determining image quality requirements for recognition tasks in generalized public safety video applications: Definitions, testing, standardization, and current trends. In: 2011 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), pp. 1–5 (June 2011)Google Scholar
  9. 9.
    Leszczuk, M.: Assessing Task-Based Video Quality — A Journey from Subjective Psycho-Physical Experiments to Objective Quality Models. In: Dziech, A., Czyżewski, A. (eds.) MCSS 2011. CCIS, vol. 149, pp. 91–99. Springer, Heidelberg (2011), CrossRefGoogle Scholar
  10. 10.
    Spangler, T.: Golden eyes. Multichannel News (October 2009)Google Scholar
  11. 11.
    Szczuko, P., Romaniak, P., Leszczuk, M., Mirek, R., Pleva, M., Ondas, S., Szwoch, G., Korus, P., Kollmitzer, C., Dalka, P., Kotus, J., Ciarkowski, A., Dąbrowski, A., Pawłowski, P., Marciniak, T., Weychan, R., Misiorek, F.: D1.2, report on ns and cs hardware construction. Tech. rep., The INDECT Consortium: Intelligent Information System Supporting Observation, Searching and Detection for Security of Citizens in Urban Environment, European Seventh Framework Programme FP7-218086-collaborative project, Europa (2010), cop.Google Scholar
  12. 12.
    VQEG: The Video Quality Experts Group,
  13. 13.
    VQiPS: Video quality tests for object recognition applications. Public Safety Communications DHS-TR-PSC-10-09, U.S. Department of Homeland Security’s Office for Interoperability and Compatibility (June 2010)Google Scholar
  14. 14.
    VQiPS: Recorded-video quality tests for object recognition tasks. Public Safety Communications DHS-TR-PSC-11-01, U.S. Department of Homeland Security’s Office for Interoperability and Compatibility (June 2011)Google Scholar
  15. 15.
    Watson, A.: Video acuity: A metric to quantify the effective performance of video systems. In: Imaging Systems Applications, p. IMD3. Optical Society of America (2011),

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Mikołaj I. Leszczuk
    • 1
  • Artur Koń
    • 1
  • Joel Dumke
    • 2
  • Lucjan Janowski
    • 1
  1. 1.Department of TelecommunicationsAGH University of Science and TechnologyKrakówPoland
  2. 2.Institute for Telecommunication Sciences (ITS)National Telecommunications and Information Administration (NTIA)BoulderUSA

Personalised recommendations