Forensic Sketch Matching Using SURF

  • Dileep Kumar Kotha
  • Santanu Rath
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 174)


 This paper deals with the problem of forensic sketch matching. Research in past decade offered solutions for matching sketches that were drawn while looking at the subject (viewed sketches). In this paper, we emphasize on matching the forensic sketches, which are drawn by specially trained artists in police department based on the description of subject by an eyewitness. Recently, a method for forensic sketch matching using LFDA (Local Feature based Discriminant Analysis) was published. Here, the same problem is addressed using a novel preprocessing technique combined with a local feature descriptor called SURF (Speeded Up Robust Features). In our method, we first preprocess the images using a special preprocessing technique suitable for forensic sketch matching. After the preprocessing, SURF is used to extract features in the form of 64-variable vectors for each image. Then all these vectors of one image are combined to form the SURF descriptor vector for that image. These descriptor vectors are then used for matching. This method was applied to match a dataset of 64 Forensic Sketches against a gallery of 1058 photos. From our experiments, it was observed that our approach of image preprocessing combined with SURF had shown promising results with a good accuracy.


Face Recognition Interest Point Preprocessing Technique Descriptor Vector Local Feature Descriptor 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Klare, B., Li, Z., Jain, A.K.: Matching Forensic Sketches to Mug Shot Photos. IEEE Transaction Pattern Analysis and Machine Intelligence, 639–646 (March 2011)Google Scholar
  2. 2.
    Bay, H., Tuytelaars, T., Van Gool, L.: SURF: Speeded Up Robust Features. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3951, pp. 404–417. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  3. 3.
    Wang, X., Tang, X.: Face Photo-Sketch Synthesis and Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 31 (2009)Google Scholar
  4. 4.
    Klare, B., Jain, A.: Sketch to Photo Matching: A Feature-Based Approach. In: Proc. SPIE Conf. Biometric Technology for Human Identification VII (2010)Google Scholar
  5. 5.
    Tang, X., Wang, X.: Face Sketch Recognition. IEEE Trans. Circuits and Systems for Video Technology 14(1), 50–57 (2004)CrossRefGoogle Scholar
  6. 6.
    Liu, Q., Tang, X., Jin, H., Lu, H., Ma, S.: A Nonlinear Approach for Face Sketch Synthesis and Recognition. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1005–1010 (2005)Google Scholar
  7. 7.
    Zhong, J., Gao, X., Tian, C.: Face Sketch Synthesis Using E-HMM and Selective Ensemble. In: Proc. IEEE Conf. Acoustics, Speech and Signal Processing (2007)Google Scholar
  8. 8.
    Liao, S., Yi, D., Lei, Z., Qin, R., Li, S.: Heterogeneous Face Recognition from Local Structures of Normalized Appearance. In: Proc. Third Int’l Conf. Biometrics (2009)Google Scholar
  9. 9.
    Lei, Z., Li, S.: Coupled Spectral Regression for Matching Heterogeneous Faces. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1123–1128 (June 2009)Google Scholar
  10. 10.
    Klare, B., Jain, A.: Heterogeneous Face Recognition: Matching NIR to Visible Light Images. In: Proc. Int’l Conf. Pattern Recognition (2010)Google Scholar
  11. 11.
    Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns. IEEE Trans. Pattern Analysis and Machine Intelligence 24(7), 971–987 (2002)CrossRefGoogle Scholar
  12. 12.
    Frowd, C., Bruce, V., McIntyr, A., Hancock, P.: The relative importance of external and internal features of facial composites. British Journal of Psychology 98(1), 61–77 (2007)CrossRefGoogle Scholar
  13. 13.
    Klare, B., Zhifeng, L., Jain, A.: On matching forensic sketches to mug shot photos. MSU Technical report (2010)Google Scholar
  14. 14.
    Du, G., Su, F., Cai, A.: Face recognition using SURF features. In: Proc. of SPIE, vol. 7496, pages 749628–1 (2009)Google Scholar
  15. 15.
    Gibson, L.: Limited page sample E-book copy of Forensic Art Essentials. Elsevier (2008)Google Scholar
  16. 16.
    Taylor, K.: Limited page sample E-book copy of Forensic Art and Illustration. CRC Press (2001)Google Scholar
  17. 17.
    FERET Database. NIST (2001),
  18. 18.
    FaceVACS Software Developer Kit, Cognitec Systems GmbH (2010),

Copyright information

© Springer India 2013

Authors and Affiliations

  1. 1.National Institute of TechnologyRourkelaIndia

Personalised recommendations