Abstract
We propose here a parallel implementation of multidimensional scaling (MDS) method which can be used for visualization of large datasets of multidimensional data. Unlike in traditional approaches, which employ classical minimization methods for finding the global optimum of the “stress function”, we use a heuristic based on particle dynamics. This method allows avoiding local minima and is convergent to the global one. However, due to its O(N 2) complexity, the application of this method in data mining problems involving large datasets requires efficient parallel codes. We show that employing both optimized Taylor’s algorithm and hybridized model of parallel computations, our solver is efficient enough to visualize multidimensional data sets consisting of 104 feature vectors in time of minutes.
Chapter PDF
Similar content being viewed by others
References
Torgerson, W.S.: Multidimensional scaling. 1. Theory and method. Psychometrika 17, 401–419 (1952)
Tenenbaum, J.B., de Silva, V., Langford, J.C.: A Global Geometric Framework for Nonlinear Dimensionality Reduction. Science 290, 2319–2323 (2000)
Roweis, S.T., Saul, L.K.: Nonlinear Dimensionality Reduction by Locally Linear Embedding. Science 290, 2323–2326 (2000)
Kruskal, J.: Multidimensional scaling by optimizing goodness-of-fit to a nonmetric hypothesis. Psychometrika 29, 1–27 (1964)
Sammon, J.W.: A nonlinear mapping for data structure analysis. IEEE Trans. Comput. C-18(5), 401–409 (1969)
Dzwinel, W.: How to Make Sammon’s Mapping Useful for Multidimensional Data Structures Analysis? Pattern Recognition 27(7), 949–959 (1994)
Dzwinel, W.: Virtual particles and search for global minimum. Future Generation Computer Systems 12, 371–389 (1997)
Dzwinel, W., Basiak, J.: Method of particles in visual clustering of multidimensional and large data sets. Future Generation Computer Systems 15, 365–379 (1999)
Pawliczek, P., Dzwinel, W.: Visual Analysis of Multidimensional Data Using Fast MDS algorithm. In: Proceedings of 20th IEEE-SPIE Symposium Photonics, Electronics and Web Engineering, Signal Processing Syposium, Jachranka, Poland, May 24-26 (2007)
Shu, J., Wang, B., Chen, M., Wang, J., Zheng, W.: Optimization techniques for parallel force-decomposition algorithm in molecular dynamic simulation. Computer Physics Communications 154, 121–130 (2003)
Taylor, V.E., Stevens, R.L., Arnold, K.E.: Parallel molecular dynamics: Communication requirements for massively parallel machines. In: Proceedings of Frontiers 1995, Fifth Symposium on the Frontiers of Massively Parallel Computation, p. 156. IEEE Comput. Society Press, Los Alamitos (1994)
LeCun, Y., Cortes, C.: The MNIST database of handwritten digits, http://yann.lecun.com/exdb/mnist/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Pawliczek, P., Dzwinel, W. (2010). Parallel Implementation of Multidimensional Scaling Algorithm Based on Particle Dynamics. In: Wyrzykowski, R., Dongarra, J., Karczewski, K., Wasniewski, J. (eds) Parallel Processing and Applied Mathematics. PPAM 2009. Lecture Notes in Computer Science, vol 6067. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-14390-8_32
Download citation
DOI: https://doi.org/10.1007/978-3-642-14390-8_32
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-14389-2
Online ISBN: 978-3-642-14390-8
eBook Packages: Computer ScienceComputer Science (R0)