Research on the Nearest Neighbor Representation Classification Algorithm in Feature Space

  • Yan-Hong Hu
  • Yu-Hai Li
  • Ming Zhao
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 733)


Representation-based classification and recognition, such as face recognition, have dominant performance in dealing with high-dimension data. However, for low-dimension data the classification results are not satisfying. This paper proposes a classification method based on nearest neighbor representation in feature space, which extends representation-based classification to nonlinear feature space, and also remedies its drawback in low-dimension data processing. First of all, the proposed method projects the data into a high-dimension space through a kernel function. Then, the test sample is represented by the linear combination of all training samples and the corresponding coefficients of each training sample will be obtained. Finally, the test sample is assigned to the class of the training sample with a minimum distance. The results of experiments on standard two-class datasets and ORL and YALE face databases show that the algorithm has better classification performance.


Nearest neighbor classification Representation Kernel function 


  1. 1.
    Cover, T., Hart, P.: Nearest neighbor pattern classification. IEEE Trans. Inf. Theor. IT-13(1), 21–27 (1967)CrossRefzbMATHGoogle Scholar
  2. 2.
    Li, S.Z., Lu, J.W.: Face recognition using the nearest feature line method. IEEE Trans. Neural Netw. 10(2), 439–443 (1999)CrossRefGoogle Scholar
  3. 3.
    Chien, J.T., Wu, C.C.: Discriminant waveletfaces and nearest feature classifiers for face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 24(12), 1644–1649 (2002)CrossRefGoogle Scholar
  4. 4.
    Samet, H.: K-nearest neighbor finding using MaxNearestDist. IEEE Trans. Pattern Anal. Mach. Intell. 30(2), 243–252 (2008)CrossRefGoogle Scholar
  5. 5.
    Wang, J., Neskovic, P., Cooper, L.N.: Improving nearest neighbor rule with a simple adaptive distance measure. Pattern Recogn. Lett. 28(2), 207–213 (2007)CrossRefGoogle Scholar
  6. 6.
    Peng, Q.S., Wei, W.H.: Parallel fuzzy clustering algorithm based on kernel method. Comput. Eng. Des. 29(8), 1881–1883 (2008)MathSciNetGoogle Scholar
  7. 7.
    Tao, D.C., Tang, X.O., Li, X.L., Rui, Y.: Direct kernel biased discriminant analysis: a new content-based image retrieval relevance feedback algorithm. IEEE Trans. Multimed. 8(4), 716–727 (2006)CrossRefGoogle Scholar
  8. 8.
    Wright, J., Yang, A.Y., Ganesh, A., Sastry, S.S., Ma, Y.: Robust face recognition via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 31(2), 210–227 (2009)CrossRefGoogle Scholar
  9. 9.
    Xu, Y., Zhu, Q., Chen, Y., Pan, J.S.: An improvement to the nearest neighbor classifier and face recognition experiments. Int. J. Innov. Comput. Inf. Control 9(2), 543–554 (2013)Google Scholar
  10. 10.
    Samaria, F.S., Harter, A.C.: Parameterisation of a stochastic model for human face identification. In: Proceedings of the 2nd IEEE International Workshop on Applications of Computer Vision, Sarasota, FL, pp. 138–142, December 1994Google Scholar
  11. 11.
    Bellhumer, P.N., Hespanha, J., Kriegman, D.: Eigenfaces vs Fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997)CrossRefGoogle Scholar
  12. 12.
    Xu, Y., Fan, Z.Z., Zhu, Q.: Feature space-based human face image representation and recognition. Opt. Eng. 51(1), 017205-1–017205-7 (2012)CrossRefGoogle Scholar
  13. 13.
    Naseem, T.R., Bennamoun, M.: Linear regression for face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 32(11), 2106–2112 (2010)CrossRefGoogle Scholar
  14. 14.
    Zheng, W.S., Zhao, L., Zou, C.: Locally nearest neighbor classifiers for pattern classification. Pattern Recogn. 37(6), 1307–1309 (2004)CrossRefzbMATHGoogle Scholar
  15. 15.
    Gao, Q.B., Wang, Z.Z.: Center-based nearest neighbor classifier. Pattern Recogn. 40(1), 346–349 (2007)MathSciNetCrossRefzbMATHGoogle Scholar
  16. 16.
    Hu, Q.H., Zhu, P.F., Yang, Y.B., Yu, D.: Large-margin nearest neighbor classifiers via sample weight learning. Neurocomputing 74(4), 656–660 (2011)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.School of Occupational & Continuing EducationCentral China Normal UniversityWuhanPeople’s Republic of China
  2. 2.School of Information ManagementCentral China Normal UniversityWuhanPeople’s Republic of China
  3. 3.School of Computer TechnologyYangtze UniversityJinzhouPeople’s Republic of China

Personalised recommendations