Abstract
This paper deals with dimensionality and sample length reduction applied to the tasks of exploratory data analysis. Proposed technique relies on distance preserving linear transformation of given dataset to the lower dimensionality feature space. Coefficients of feature transformation matrix are found using Fast Simulated Annealing - an algorithm inspired by physical annealing of solids. Furthermore the elimination or weighting of data elements which, as an effect of above mentioned transformation, were moved significantly from the rest of the dataset can be performed. Presented method was positively verified in routines of clustering, classification and outlier detection. It ensures proper efficiency of those procedures in compact feature space and with reduced data sample length at the same time.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Alba, E. (ed.): Parallel Metaheuristics. John Wiley & Sons, New York (2005)
Bishop, C.M.: Pattern Recognition and Machine Learning. Springer, Heidelberg (1999)
Chandola, V., Banerjee, A., Kumar, V.: Anomaly detection: A survey. ACM Computing Surveys 41, 15:1–15:58 (2009)
Cox, T.F., Cox, M.A.A.: Multidimensional Scaling. Chapman & Hall, Boca Raton (2000)
Ingber, L.: Adaptive simulated annealing (ASA): Lessons learned. Control and Cybernetics 25(1), 33–54 (1996)
Jain, A.K., Duin, R.P.W., Mao, J.: Statistical Pattern Recognition: A Review. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(1), 4–37 (2000)
Kirkpatrick, S., Gelatt, C.D., Vecchi, M.: Optimization by Simulated Annealing. Science 220, 671–680 (1983)
Kowalski, P.A., Kulczycki, P.: Data Sample Reduction for Classification of Interval Information using Neural Network Sensitivity Analysis. In: Dicheva, D., Dochev, D. (eds.) AIMSA 2010. LNCS, vol. 6304, pp. 271–272. Springer, Heidelberg (2010)
Kulczycki, P.: Kernel Estimators in Industrial Applications. In: Prasad, B. (ed.) Soft Computing Applications in Industry, pp. 69–91. Springer, Heidelberg (2008)
Lee, J.L., Verleysen, M.: Nonlinear Dimensionality Reduction. Springer, Heidelberg (2007)
Łukasik, S.: Parallel Computing of Kernel Density Estimates with MPI. In: Shi, Y., van Albada, G.D., Dongarra, J., Sloot, P.M.A. (eds.) ICCS 2007. LNCS, vol. 4489, pp. 726–733. Springer, Heidelberg (2007)
van der Maaten, L.J.P.: Feature Extraction from Visual Data. PhD Thesis, Tilburg University, June 23 (2009)
Mitra, P., Murthy, C.A., Pal, S.K.: Unsupervised Feature Selection using Feature Similarity. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(4), 301–312 (2002)
Pal, S.K., Mitra, P.: Pattern Recognition Algorithms for Data Mining. Chapman and Hall, London (2004)
Sait, S.M., Youssef, H.: Iterative computer algorithms with applications in engineering. IEEE Computer Society, Los Alamitos (1999)
Saxena, A., Pal, N.R., Vora, M.: Evolutionary methods for unsupervised feature selection using Sammons stress function. Fuzzy Information and Engineering 2(3), 229–247 (2010)
Silverman, B.W.: Density Estimation for Statistics and Data Analysis. Chapman and Hall, London (1986)
Szu, H., Hartley, R.: Fast simulated annealing. Physics Letters A 122(3-4), 157–162 (1987)
Tan, P.-N., Steinbach, M., Kumar, V.: Introduction to Data Mining. Pearson Addison-Wesley, Boston (2006)
UCI Machine Learning Repository, http://archive.ics.uci.edu/ml/
Verleysen, M., François, D.: The Curse of Dimensionality in Data Mining and Time Series Prediction. In: Cabestany, J., Prieto, A., Sandoval, F. (eds.) IWANN 2005. LNCS, vol. 3512, pp. 758–770. Springer, Heidelberg (2005)
Wand, M.P., Jones, M.C.: Kernel Smoothing. Chapman and Hall, London (1995)
Xu, R., Wunsch, D.C.: Clustering. Wiley, New York (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Łukasik, S., Kulczycki, P. (2011). An Algorithm for Sample and Data Dimensionality Reduction Using Fast Simulated Annealing. In: Tang, J., King, I., Chen, L., Wang, J. (eds) Advanced Data Mining and Applications. ADMA 2011. Lecture Notes in Computer Science(), vol 7120. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25853-4_12
Download citation
DOI: https://doi.org/10.1007/978-3-642-25853-4_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25852-7
Online ISBN: 978-3-642-25853-4
eBook Packages: Computer ScienceComputer Science (R0)