Abstract
This chapter summarizes the fundamental aspects of supervised methods. The chapter provides an overview of concepts from various interrelated fields used in subsequent chapters. It presents basic definitions and arguments from the supervised machine learning literature and considers various issues, such as performance evaluation techniques and challenges for data mining tasks.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Boutella R. M., Luob J., Shena X., Browna C. M., Learning multi-label scene classification, Pattern Recognition, 37(9), pp. 1757–1771, 2004.
Buja, A. and Lee, Y.S., Data Mining criteria for tree based regression and classification, Proceedings of the 7th International Conference on Knowledge Discovery and Data Mining, (pp 27–36), San Diego, USA, 2001.
Clare, A., King R.D., Knowledge Discovery in Multi-label Phenotype Data, Lecture Notes in Computer Science, Vol. 2168, Springer, Berlin, 2001.
Cohen, W. W., Schapire R.E., and Singer Y., Learning to order things. Journal of Artificial Intelligence Research, 10:243270, 1999.
Dietterich, T. G., Approximate statistical tests for comparing supervised classification learning algorithms. Neural Computation, 10(7): 1895–1924, 1998.
Dietterich, T. G., Lathrop, R. H., and Perez, T. L., Solving the multiple-instance problem with axis-parallel rectangles, Artificial Intelligence, 89(1–2), pp. 31–71, 1997.
Duda, R., and Hart, P., Pattern Classification and Scene Analysis, New-York, Wiley, 1973.
Dunteman, G.H., Principal Components Analysis, Sage Publications, 1989.
Fayyad, U., Piatesky-Shapiro, G. & Smyth P., From Data Mining to Knowledge Discovery: An Overview. In U. Fayyad, G. Piatetsky-Shapiro, P. Smyth, & R. Uthurusamy (Eds), Advances in Knowledge Discovery and Data Mining, pp 1–30, AAAI/MIT Press, 1996.
Friedman, J.H. & Tukey, J.W., A Projection Pursuit Algorithm for Exploratory Data Analysis, IEEE Transactions on Computers, 23:9, 881–889, 1973.
Fukunaga, K., Introduction to Statistical Pattern Recognition. San Diego, CA: Academic, 1990.
Fürnkranz J. and Hiillermeier J., Pairwise preference learning and ranking. In Proc. ECML03, pages 145156, Cavtat, Croatia, 2003.
Grumbach S., Milo T., Towards Tractable Algebras for Bags. Journal of Computer and System Sciences 52(3): 570–588, 1996.
Har-Peled S., Roth D., and Zimak D., Constraint classification: A new approach to multiclass classification. In Proc. ALT02, pages 365379, Lubeck, Germany, 2002, Springer.
Hunter L., Klein T. E., Finding Relevant Biomolecular Features. ISMB 1993, pp. 190–197, 1993.
Hwang J., Lay S., and Lippman A., Nonparametric multivariate density estimation: A comparative study, IEEE Transaction on Signal Processing, 42(10): 2795–2810, 1994.
Janikow, C.Z., Fuzzy Decision Trees: Issues and Methods, IEEE Transactions on Systems, Man, and Cybernetics, Vol. 28, Issue 1, pp. 1–14. 1998.
Jimenez, L. O., & Landgrebe D. A., Supervised Classification in High-Dimensional Space: Geometrical, Statistical, and Asymptotical Properties of Multivariate Data. IEEE Transaction on Systems Man, and Cybernetics-Part C: Applications and Reviews, 28:39–54, 1998.
Jin, R., & Ghahramani Z., Learning with Multiple Labels, The Sixteenth Annual Conference on Neural Information Processing Systems (NIPS 2002) Vancouver, Canada, pp. 897–904, December 9–14, 2002.
Kim J.O. & Mueller C.W., Factor Analysis: Statistical Methods and Practical Issues. Sage Publications, 1978.
Mitchell, T, Machine Learning, McGraw-Hill, 1997.
Pfahringer, B., Controlling constructive induction in CiPF, In Bergadano, F. and De Raedt, L. (Eds.), Proceedings of the seventh European Conference on Machine Learning, pp. 242–256, Springer-Verlag, 1994.
Quinlan, J. R., C4.5: Programs for Machine Learning, Morgan Kaufmann, Los Altos, 1993.
Ragavan, H. and Rendell, L., Look ahead feature construction for learning hard concepts. In Proceedings of the Tenth International Machine Learning Conference: pp. 252–259, Morgan Kaufman, 1993.
Rastogi, R, and Shim, K., PUBLIC: A Decision Tree Classifier that Integrates Building and Pruning,Data Mining and Knowledge Discovery, 4(4):315–344, 2000.
Schapire R., Singer Y., Boostexter: a boosting-based system for text categorization. Machine Learning 39(2/3):135168, 2000.
Schmitt, M., On the complexity of computing and learning with multiplicative neural networks, Neural Computation 14:2, 241–301, 2002.
Shafer, J. C., Agrawal, R. and Mehta, M, SPRINT: A Scalable Parallel Classifier for Data Mining, Proc. 22nd Int. Conf. Very Large Databases, T. M. Vijayaraman and Alejandro P. Buchmann and C. Mohan and Nandlal L. Sarda (eds), 544–555, Morgan Kaufmann, 1996.
Valiant, L. G. (1984). A theory of the leamabie. Communications of the ACM 1984, pp. 1134–1142.
Vapnik, V.N., The Nature of Statistical Learning Theory. Springer-Verlag, New York, 1995.
Wolpert, D. H., The relationship between PAC, the statistical physics framework, the Bayesian framework, and the VC framework. In D. H. Wolpert, editor, The Mathematics of Generalization, The SFI Studies in the Sciences of Complexity, pages 117–214. AddisonWesley, 1995.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer Science+Business Media, Inc.
About this chapter
Cite this chapter
Maimon, O., Rokach, L. (2005). Introduction to Supervised Methods. In: Maimon, O., Rokach, L. (eds) Data Mining and Knowledge Discovery Handbook. Springer, Boston, MA. https://doi.org/10.1007/0-387-25465-X_8
Download citation
DOI: https://doi.org/10.1007/0-387-25465-X_8
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-24435-8
Online ISBN: 978-0-387-25465-4
eBook Packages: Computer ScienceComputer Science (R0)