Abstract
In the real world, concept drift happens in various scenarios including medical treatment planing. Traditional approaches simply eliminate/dilute the effect of outdated samples on the prediction, leading to a less confident (based on fewer samples) prediction and a waste of undiscovered information contained in past samples. With the knowledge of how concepts change, outdated samples can be adapted for up-to-date prediction, which improves the confidence of prediction, especially for medical data sets of which the scale is relatively small. In this paper we present an adaptive k-NN classifier which can detect the occurrence of target concept drift and update past samples according to the knowledge of the drift for better prediction, and assess the performance over simulated and real-world categorical medical data sets. The experiment results show our classifier achieves better performance under concept drift.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Altman, N.S.: An introduction to kernel and nearest-neighbor nonparametric regression. Am. Stat. 46(3), 175–185 (1992)
Bach, S.H., Maloof, M.A.: Paired learners for concept drift. In: 2008 Eighth IEEE International Conference on Data Mining, ICDM 2008, pp. 23–32. IEEE (2008)
Boriah, S., Chandola, V., Kumar, V.: Similarity measures for categorical data: a comparative evaluation. Red 30(2), 3 (2008)
Klinkenberg, R.: Learning drifting concepts: example selection vs. example weighting. Intell. Data Anal. 8(3), 281–300 (2004)
Koychev, I.: Tracking changing user interests through prior-learning of context. In: De Bra, P., Brusilovsky, P., Conejo, R. (eds.) AH 2002. LNCS, vol. 2347, pp. 223–232. Springer, Heidelberg (2002). https://doi.org/10.1007/3-540-47952-X_24
Mahalanobis, P.C.: On the generalized distance in statistics. Proc. Natl. Inst. Sci. (Calcutta) 2, 49–55 (1936)
Minku, L.L., White, A.P., Yao, X.: The impact of diversity on online ensemble learning in the presence of concept drift. IEEE Trans. Knowl. Data Eng. 22(5), 730–742 (2010)
Perou, C.M.: Molecular stratification of triple-negative breast cancers. The Oncol. 16(Suppl. 1), 61–70 (2011)
Prat, A., Perou, C.M.: Deconstructing the molecular portraits of breast cancer. Mol. Oncol. 5(1), 5–23 (2011)
Stanfill, C., Waltz, D.: Toward memory-based reasoning. Commun. ACM 29(12), 1213–1228 (1986)
Street, W.N., Kim, Y.: A streaming ensemble algorithm (SEA) for large-scale classification. In: Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 377–382. ACM (2001)
Sun, Y., Tang, K., Zhu, Z., Yao, X.: Concept drift adaptation by exploiting historical knowledge. arXiv preprint arXiv:1702.03500 (2017)
Widmer, G., Kubat, M.: Learning in the presence of concept drift and hidden contexts. Mach. Learn. 23(1), 69–101 (1996)
Acknowledgments
China National Science Foundation (Granted Number 61272438,61472253), Cross Research Fund of Biomedical Engineering of Shanghai Jiao Tong University (YG2015MS61), and Research Funds of Science and Technology Commission of Shanghai Municipality (Granted Number 15411952502, 14511107702) support this work.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Zhu, N., Cao, J., Zhang, Y. (2019). An Adaptive k-NN Classifier for Medical Treatment Recommendation Under Concept Drift. In: Sun, Y., Lu, T., Xie, X., Gao, L., Fan, H. (eds) Computer Supported Cooperative Work and Social Computing. ChineseCSCW 2018. Communications in Computer and Information Science, vol 917. Springer, Singapore. https://doi.org/10.1007/978-981-13-3044-5_42
Download citation
DOI: https://doi.org/10.1007/978-981-13-3044-5_42
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-3043-8
Online ISBN: 978-981-13-3044-5
eBook Packages: Computer ScienceComputer Science (R0)