Abstract
We introduce an adaptive prequential learning framework for Bayesian Network Classifiers which attempts to handle the cost-performance trade-off and cope with concept drift. Our strategy for incorporating new data is based on bias management and gradual adaptation. Starting with the simple Naïve Bayes, we scale up the complexity by gradually increasing the maximum number of allowable attribute dependencies, and then by searching for new dependences in the extended search space. Since updating the structure is a costly task, we use new data to primarily adapt the parameters and only if this is really necessary, do we adapt the structure. The method for handling concept drift is based on the Shewhart P-Chart. We evaluated our adaptive algorithms on artificial domains and benchmark problems and show its advantages and future applicability in real-world on-line learning systems.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Brumen, B., Golob, I., Jaakkola, H., Welzer, T., Rozman, I.: Early Assessment of Classification Performance. Australasian CS Week Frontiers, pp. 91–96 (2004)
Castillo, G., Gama, J., Medas, P.: Adaptation to Drifting Concepts. In: Pires, F.M., Abreu, S.P. (eds.) EPIA 2003. LNCS, vol. 2902, pp. 279–293. Springer, Heidelberg (2003)
Castillo, G., Gama, J.: Bias Management of Bayesian Network Classifiers. In: Hoffmann, A., Motoda, H., Scheffer, T. (eds.) DS 2005. LNCS (LNAI), vol. 3735, pp. 70–83. Springer, Heidelberg (2005)
Castillo, G.: Adaptive Learning Algorithms for Bayesian Network Classifiers. PhD. Dissertation, University of Aveiro (2006)
Friedman, N., Geiger, D., Goldszmidt, M.: Bayesian Network Classifiers. Machine Learning 29, 131–161 (1997)
Dawid, A.P.: Statistical theory: The prequential approach. Journal of the Royal Statistical Society A 147, 278–292 (1984)
Gama, J.: Iterative Bayes. Theoretical Computer Science 292-2, 417–430 (2003)
O’Rourke, J.O.: Computational Geometry in C. Cambridge University Press, Cambridge (1992)
Sahami, M.: Learning Limited Dependence Bayesian Classifiers. In: Proceedings of KDD 1996, vol. 10, pp. 335–338. AAAI Press, Menlo Park (1996)
Sen, P.K.: Estimates of the regression coefficient based on Kendall’s tau. Journal of the American Statistical Association 63, 1379–1389 (1968)
Widmer, G., Kubat, M.: Learning in the Presence of Concept Drift and Hidden Context. Machine Learning 23, 69–101 (1996)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Castillo, G., Gama, J. (2006). An Adaptive Prequential Learning Framework for Bayesian Network Classifiers. In: Fürnkranz, J., Scheffer, T., Spiliopoulou, M. (eds) Knowledge Discovery in Databases: PKDD 2006. PKDD 2006. Lecture Notes in Computer Science(), vol 4213. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11871637_11
Download citation
DOI: https://doi.org/10.1007/11871637_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-45374-1
Online ISBN: 978-3-540-46048-0
eBook Packages: Computer ScienceComputer Science (R0)