Combination of Dichotomizers for Maximizing the Partial Area under the ROC Curve

  • Maria Teresa Ricamato
  • Francesco Tortorella
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6218)

Abstract

In recent years, classifier combination has been of great interest for the pattern recognition community as a method to improve classification performance. The most part of combination rules are based on maximizing the accuracy and, only recently, the Area under the ROC curve (AUC) has been proposed as an alternative measure. However, there are several applications which focus only on particular regions of the ROC curve, i.e. the most relevant for the problem. In these cases, looking on a partial section of the AUC is the most suitable approach to adopt. In this paper we propose a new algorithm able to maximize only a part of the AUC by means of a linear combination of dichotomizers. Moreover, we empirically show that algorithms that maximize the AUC do not maximize the partial AUC, i.e., the two kinds of maximization are independent.

Keywords

Classifiers combination ROC curve partial AUC 

References

  1. 1.
    Huang, J., Ling, C.X.: Using AUC and accuracy in evaluating learning algorithms. IEEE Trans. on Knowledge and Data Engineering 17, 299–310 (2005)CrossRefGoogle Scholar
  2. 2.
    Cortes, C., Mohri, M.: AUC optimization vs. error rate minimization advances. In: Neural Information Processing Systems. MIT Press, Cambridge (2003)Google Scholar
  3. 3.
    Dodd, L.E., Pepe, M.S.: Partial AUC estimation and regression. Biometrics 59, 614–623 (2003)CrossRefMathSciNetGoogle Scholar
  4. 4.
    Jiang, Y., Metz, C.E., Nishikawa, R.M.: A receiver operating characteristic partial area index for highly sensitive diagnostic tests. Radiology 201, 745–750 (1996)Google Scholar
  5. 5.
    McClish, D.K.: Analyzing a portion of the ROC curve. Medical Decision Making 9, 190–195 (1989)CrossRefGoogle Scholar
  6. 6.
    Bradley, A.P.: The use of the area under the roc curve in the evaluation of machine learning algorithms. Patt. Recogn. 30, 1145–1159 (1997)CrossRefGoogle Scholar
  7. 7.
    Hanley, J.A., McNeil, B.J.: The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143, 29–36 (1982)Google Scholar
  8. 8.
    Nandakumar, K., Dass, S.C., Jain, A.K.: Likelihood ratio-based biometric score fusion. IEEE Trans. on Patt. Anal. and Mach. Intell. 30, 342–347 (2008)CrossRefGoogle Scholar
  9. 9.
    Marrocco, C., Molinara, M., Tortorella, F.: Optimal linear combination of dichotomizers via auc. In: Proceed. of the 22nd Intern. Conf. on Mach. Learn. - Workshop on ROC Analysis in Mach. Learn., pp. 778–785 (2005)Google Scholar
  10. 10.
    Poh, N., Bengio, S.: Database, protocol and tools for evaluating score-level fusion algorithms in biometric authentication. Patt. Recogn. 39, 223–233 (2006)CrossRefGoogle Scholar
  11. 11.
    Su, J.Q., Liu, J.S.: Linear combinations of multiple diagnostic markers. Journal of the Americ. Stat. Assoc. 88, 1350–1355 (1993)MATHCrossRefMathSciNetGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Maria Teresa Ricamato
    • 1
  • Francesco Tortorella
    • 1
  1. 1.DAEIMIUniversità degli Studi di CassinoCassinoItaly

Personalised recommendations