Skip to main content

A Comparison of Three Implementations of Multi-Label Conformal Prediction

  • Conference paper
  • First Online:
Statistical Learning and Data Sciences (SLDS 2015)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9047))

Included in the following conference series:

Abstract

The property of calibration of Multi-Label Learning (MLL) has not been well studied. Because of the excellent calibration property of Conformal Predictors (CP), it is valuable to achieve calibrated MLL prediction via CP. Three practical implementations of Multi-Label Conformal Predictors (MLCP) can be established. Among them are Instance Reproduction MLCP (IR-MLCP), Binary Relevance MLCP (BR-MLCP) and Power Set MLCP (PS-MLCP). The experimental results on benchmark datasets show that all three MLCP methods possess calibration property. Comparatively speaking, BR-MLCP performs better in terms of prediction efficiency and computational cost than the other two.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Balasubramanian, V., Ho, S.S., Vovk, V.: Conformal Prediction for Reliable Machine Learning: Theory. Adaptations and Applications. Morgan Kaufmann, Massachusetts (2014)

    Google Scholar 

  2. Fedorova, V.: Conformal prediction and testing under on-line compression models. PhD Thesis, Royal Holloway University of London (2014)

    Google Scholar 

  3. Madjarov, G., Kocev, D., Gjorgjevikj, D., Dzeroski, S.: An extensive experimental comparison of methods for multi-label learning. Pattern Recognition 45(9), 3084–3104 (2012)

    Article  Google Scholar 

  4. Nouretdinov, I., Melluish, T., Vovk, V.: Ridge regression confidence machine. In: ICML, pp. 385–392. Citeseer (2001)

    Google Scholar 

  5. Papadopoulos, H.: A Cross-Conformal Predictor for Multi-label Classification. In: Iliadis, L., Maglogiannis, I., Papadopoulos, H., Sioutas, S., Makris, C. (eds.) AIAI 2014 Workshops. IFIP AICT, vol. 437, pp. 241–250. Springer, Heidelberg (2014)

    Chapter  Google Scholar 

  6. Tsoumakas, G., Katakis, I.: Multi-label classification: An overview. International Journal of Data Warehousing and Mining (IJDWM) 3(3), 1–13 (2007)

    Article  Google Scholar 

  7. Vovk, V., Gammerman, A., Shafer, G.: Algorithmic Learning in a Random World. Springer, New York (2005)

    MATH  Google Scholar 

  8. Wang, H., Liu, X., Lv, B., Yang, F., Hong, Y.: Reliable multi-label learning via conformal predictor and random forest for syndrome differentiation of chronic fatigue in traditional chinese medicine. PLoS ONE 9(6), e99565 (2014)

    Google Scholar 

  9. Zhang, M.L., Zhou, Z.H.: A review on multi-label learning algorithms. IEEE Transactions on Knowledge and Data Engineering 26(8), 1819–1837 (2014)

    Article  Google Scholar 

  10. Zhang, M., Zhou, Z.: Ml-knn: A lazy learning approach to multi-label learning. Pattern Recognition 40(7), 2038–2048 (2007)

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Huazhen Wang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Wang, H., Liu, X., Nouretdinov, I., Luo, Z. (2015). A Comparison of Three Implementations of Multi-Label Conformal Prediction. In: Gammerman, A., Vovk, V., Papadopoulos, H. (eds) Statistical Learning and Data Sciences. SLDS 2015. Lecture Notes in Computer Science(), vol 9047. Springer, Cham. https://doi.org/10.1007/978-3-319-17091-6_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-17091-6_19

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-17090-9

  • Online ISBN: 978-3-319-17091-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics