Abstract
Video-surveillance attracted an important research effort in the last few years. Many works are dedicated to the design of efficient systems and the development of robust algorithms. video compression is a very important stage in order to ensure the viability of video-surveillance systems. However, it introduces some distortions decreasing significantly the detection, recognition and identification tasks for legal investigators. Fortunately, an important effort is made in terms of standard definition for video-surveillance in order to achieve to a complete interoperability. However, quality issues are still not addressed in an appropriate way. Investigators are often facing the dilemma of selecting the best match (legal evidence) of the targeted object in the video-sequence. In this paper, we propose an offline quality monitoring system for the extraction of most suitable legal evidence images for video-surveillance applications. This system is constructed around three innovative parts: First, a robust tracking algorithm based on foveal wavelet and mean shift. Second, a no-reference quality metric based on sharpness feature. Finally, a super-resolution algorithm allowing to increase the size of the tracked object without using any information outside the image itself. The combination of the proposed algorithms allowed the construction of a quality monitoring system increasing significantly the efficiency of the legal evidence image extraction.
Similar content being viewed by others
References
Allebach J, Wong PW (1996) Edge-directed interpolation. In: Proc. IEEE int. conf. on image proc
ANSI/SIA OSIPS DVI-01 (2008) SIA open, systems integration and performance standards—digital video interface data model
Arrêté du 3 août (2007) Portant définition des normes techniques des systèmes de vidéosurveillance. http://www.legifrance.gouv.fr. Accessed 31 Oct 2012
Batten CF (2000) Autofocusing and astigmatism correction in the scanning electron microscope. M. Phil. thesis, University of Cambridge, Cambridge, UK
Bovik A (2000) Handbook of image and video processing. Academic Press
Caviedes J, Obert F (2004) A new sharpness metric based on local kurtosis, edge and energy information. Signal Process 19(2):147–161
Chang DB, Carey WK, Hermami SS (1999) Regularity-preserving image interpolation. In: Proc. IEEE int. conf. on image proc., pp 1293–1297
Chern NK, Neow NPA, Ang MH (2001) Practical issues in pixel-based autofocusing for machine vision. Proc IEEE Int Conf Robot Autom 3:2791–2796
Cohen N, Gattuso J, MacLennan-Brown K (2009) CCTV operational requirements manual. Home Office Scientific Development Branch, publication no. 28/09. http://www.globalmsc.net/documents/55-06_-_CCTV_Operational_Re2.pdf. Accessed 31 Oct 2012
Comaniciu D, Meer P (2002) Mean shift: a robust approach toward feature space analysis. IEEE Trans Patt Anal Mach Intell 24(5):603–619
Comaniciu D, Ramesh V, Meer P (2003) Kernel-based object tracking. IEEE Trans Patt Anal Mach Intell 25(5):564–575
Davis J, Sharma V (2003) Otcbvs benchmark dataset collection
Di Zenzo S (1986) A note on the gradient of multi-images. Comput Vis Graph Image Process 33:116–125
Elad M, Feuer A (1997) Restoration of single super-resolution image from several blurred, noisy and down-sampled measured images. IEEE Trans Image Process 6(12):1646–1658
EN 50132-5-3 (2012) Alarm systems—CCTV surveillance systems for use in security applications
Erasmus S, Smith K (1982) An automatic focusing and astigmatism correction system for the sem and ctem. J Microsc 127:185–199
Ferzli R, Karam LJ (2009) A no-reference objective image sharpness metric based on the notion of just noticeable blur (jnb). IEEE Trans Image Process 18(4):717–728
Firestone L, Cook K, Talsania N, Preston K (1991) Comparison of autofocus methods for automated microscopy. Cytometry 12:195–206
Ford C, Stange I (2010) A framework for generalizing public safety video applications to determine quality requirements. In: IEEE conference on multimedia communications, services and security, Krakow, Poland, 6–7 May 2010
Hardie R, Barnard K, Amstrong E (1997) Joint map registration and high-resolution image estimation using a sequence of undersampled images. IEEE Trans Image Process 6(12):1621–1633
Irani M, Peleg S (1991) Improving resolution by image registration. CVGIP, Graph Models Image Process 53:231–239
ISO 22311 (2012) Societal security—Videosurveillance Format for Interoperability
ISO/IEC JTC1 SC29 wg1n5595 (2009) Call for advanced image coding (AIC) for security applications
ISO/IEC JTC1 SC29 wg1n5598 (2009) ISO/IEC 29170 AIC technical report on evaluation methodologies—working draft v3
ITU-T J.144 (2004) Rec. Objective perceptual video quality measurement techniques for digital cable television in the presence of a full reference
ITU-T J.149 (2004) Rec. Method for specifying accuracy and cross-calibration of video quality metrics (VQM)
Jensen K, Anastassiou D (1995) Subpixel edge localization and the interpolation of still images. IEEE Trans Image Process 4:285–295
Leachtenauer JC, Malila W, Irvine J, Colburn L, Salvaggio N (1997) General image-quality equation: GIQE. Appl Opt IP 36(32):8322–8328
Li X, Orchard MT (2001) New edge-directed interpolation. IEEE Trans Image Process 10(10):1521–1527
Maalouf A, Carré P, Augereau B, Fernandez-Maloigne C (2007) Regularization of multivalued images by means of a wavelet-based partial differential equation, EUSIPCO2007. In: 15th European signal processing conference, Poznan, Poland
Mallat S (2000) Foveal orthonormal wavelets for singularities. Tech. report, Ecole Polytechnique
Mallat S (2009) Geometrical grouplets. Appl Comput Harmon Anal 26(2):161–180
Mallat S, Hwang WL (1992) Singularity detection and processing with wavelets. IEEE Trans Inf Theory 38:617–643
Mallat S, Zhong S (1992) Characterization of signals from multiscale edges. IEEE Trans Pattern Anal Mach Intell 14(7):710–732
Marziliano P, Dufaux F, Winkler S, Ebrahimi T (2004) Perceptual blur and ringing metrics: applications to jpeg2000. Signal Process Image Commun 19(2):163–172
Muresan DD, Parks TW (2000) Prediction of image detail. In: Proc. IEEE int. conf. on image proc., pp 323–326
National Image Interpretability Rating Scale (1996). http://www.fas.org/irp/imint/niirs_c/guide.htm. Accessed 31 Oct 2012
Ning J, Zhang L, Zhang D, Wu C (2009) Robust object tracking using joint color-texture histogram. In: IJPRAI
Open Network Video Interface Forum (ONVIF) (2012). http://www.onvif.org/Documents/Specifications.aspx. Accessed 31 Oct 2012
Patti AJ, Sezan MI, Tekalp AM (1997) Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time. IEEE Trans Image Process 6(8):1064–1076
Physical Security Interoperability Alliance (PSIA) (2012). http://www.psialliance.org. Accessed 31 Oct 2012
Sabir MR, Sheikh HR, Bovik AC (2006) A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Trans Image Process 15:3440–3451
Target tracking movie demos (2012). http://www.perceptivu.com. Accessed 31 Oct 2012
The Eden project multi-sensor data set (2006). http://www.imagefusion.org. Accessed 31 Oct 2012
Video quality in public safety working group (2008) Defining video quality requirements: a guide for public safety, vol 1.0. http://www.npstc.org/download.jsp?tableId=37&column=217&id=1695&file=VQiPSFactSheet32910_2_.pdf. Accessed 31 Oct 2012
VQEG (2000) Final report from the video quality experts group on the validation of objective models of video quality assessment. http://www.vqeg.org. Accessed 31 Oct 2012
Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600-612
Zhang N, Vladar A, Postek M, Larrabee B (2003) A kurtosis-based statistitcal measure for two-dimensional processes and its application to image sharpness. In: Proc. section of physical and engineering sciences of American Statistical Society, pp 4730–4736
Acknowledgement
This work has been supported by the project QuIAVU funded by the French Research Agency.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Maalouf, A., Larabi, MC. & Nicholson, D. Offline quality monitoring for legal evidence images in video-surveillance applications. Multimed Tools Appl 73, 189–218 (2014). https://doi.org/10.1007/s11042-012-1268-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-012-1268-9