Summary
The applicability of Simulated Annealing (SA) (Kirkpatrick et al. (1983)) is studied in the context of the data analysis scheme of the “bond energy algorithm” originally proposed by McCormick et al. (1972) for permuting rows and columns of data matrices into visually interpretable forms. To evaluate the performance of three variations of SA, they were compared to two deterministic, heuristic methods known to perform well for the particular type of data analysis task chosen: (1) the streamlined implementation of the Bond Energy Algorithm (BEA) of Arabie et al. (1988) and Schleutermann (1989) that improves upon the original version of McCormick et al. (1972), and (2) the well-known Lin and Kernighan Algorithm (LK) (1973) for the Traveling Salesman Problem (TSP). Contrary to earlier findings (e.g., De Soete et al. (1988a, 1988b)), a version of simulated annealing was developed that performs well in a time complexity comparable to that of our implementation of Lin and Kernighan’s algorithm. From the empirical results, it appears that suitable implementation of a simulated annealing algorithm can outperform good deterministic algorithms in some data analysis applications. For speeding up execution of the SA algorithm, the focus here is on the use of a state transition scheme less randomized than others often suggested in the literature on SA.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
ARABIE, P., and HUBERT, L.J. (1989), The bond energy algorithm reconsidered, IEEE Transactions on System, Man and Cybernetics.
ARABIE, P., HUBERT, L.J., and SCHLEUTERMANN, S. (1989), Blockmodels from the bond energy algorithm, Submitted to: Social Networks.
ARABIE, P., SCHLEUTERMANN, S., DAWS, J., and HUBERT, L.J. (1988), Marketing applications of sequencing and partitioning of nonsymmetric and/or two mode matrices, in: Data, Expert Knowledge and Decisions, eds. W. Gaul and M. Schader, Springer Verlag, Berlin, 215–224.
BASS, F., PESSEMIER, E., and LEHMANN, D. (1972), An experimental study of relationships between attitudes, brand preference, and choice, Behavioral Science 17, 532–541.
BREIGER, R., BOORMAN, S., and ARABIE, P. (1975), An algorithm for clustering relational data with applications to social network analysis and comparison with multidimensional scaling, Journal of Mathematical Psychology, 12, 3, 328–383.
ERNY, V. (1985), A thermodynamical approach to the traveling salesman problem: an efficient simulation algorithm, Journal of Optimization Theory and Application, 45, 41–51.
DE SOETE, G., HUBERT, L., and ARABIE, P. (1988a), The comparative performance of simulated annealing on two problems of combinatorial data analysis, in: Data Analysis and Informatics V, ed. E. Diday, North-Holland, Amsterdam, 489–496.
DE SOETE, G., HUBERT, L., and ARABIE, P. (1988b), On the use of simulated annealing for combinatorial data analysis, in: Data, Expert Knowledge and Decisions, eds. W. Gaul and M. Schader, Springer Verlag, Berlin, 329–340.
DESARBO, W.S. (1982), GENNCLUS: New models for general nonhierarchical clustering analysis, Psychometrika, 47, 449–475.
GARCIA, H., and PROTH, J.M. (1987), The short horizon planning level-generalized issue, in: Data Analysis: the Ins and Outs of Solving Real Problems, eds. J. Janssen, F. Marcotorchino and J. Proth, Plenum Press, New York, 273–282.
GOLDEN, B.L., and STEWART, W.R. (1985), Empirical analysis of heuristics, in: Traveling Salesman Problem: A Guided Tour of Combinatorial Optimization, eds. E.L. Lawler, J.K. Lenstra, A.H.G. Rinnooy Kan and D.B. Shmoys, Wiley, Chichester, England, 207–249.
GREENE, J.W., and SUPOWIT, K.J. (1986), Simulated annealing without rejected moves, IEEE Transactions on Computer-Aided Design 5, 221–228.
HAJEK, B. (1988), Cooling schedules for optimal annealing, Mathematics of Operations Research, 13, 2, 311–329.
JOHNSON, D., ARAGON, C., MCGEOCH, L., and SCHEVON, C. (in press a), Optimization by simulated annealing: an experimental evaluation (part i), Operations Research.
JOHNSON, D., ARAGON, C., MCGEOCH, L., and SCHEVON, C. (in press b), Optimization by simulated annealing: an experimental evaluation (part ii), Operations Research.
KIRKPATRICK, S., C.D.GELATT, J., and VECCHI, M.P. (1983), Optimization by simulated annealing, Science, 220, 671–680.
LAWLER, E.L., LENSTRA, J.K., RINNOOY KAN, A.H.G., and SHMOYS, D.B. (1985), Traveling Salesman Problem: A Guided Tour of Combinatorial Optimization, Wiley, Chichester, England.
LENSTRA, J. (1974), Clustering a data array and the traveling-salesman problem, Operations Research, 22, 413–414.
LIN, S. (1965), Computer solutions of the traveling salesman problem, Bell System Technical Journal, 44, 2245–2269.
LIN, S., and KERNIGHAN, B. (1973), An effective heuristic algorithm for the traveling-salesman problem, Operations Research, 21, 498–516.
LUNDY, M., and MEES, A. (1986), Convergence of the annealing algorithm, Mathematical Programming, 34, 111–124.
MCCORMICK, JR., W.T., SCHWEITZER, P.J., and WHITE, T.W. (1972), Problem decomposition and data reorganization by a clustering technique, Operations Research, 20, 993–1009.
ROETHLISBERGER, F., and DICKSON, W. (1939), Management and the Worker, Harvard University Press, Cambridge, MA.
SALANCIK, G. (1986), An index of subgroup influence in dependency networks, Administrative Science Quarterly, 31, 194–211.
SAMPSON, S. (1968), A novitiate in a period of change: An experimental and case study of social relationships, PhD Thesis, Cornell University.
SCHLEUTERMANN, S.E. (1989), Pattern Recognition with Simulated Annealing, Master’s thesis, University of Illinois, Urbana.
SPAETH, H. (1988), Cluster analysis algorithms, Ellis Horwood (Original work published 1977 ), Chichester, England.
VAN LAARHOVEN, P., and AARTS, E. (1987), Simulated Annealing: Theory and Applications, Reidel, Dordrecht, The Netherlands.
WHITE, S.R. (1984), Concepts of scale in simulated annealing, in: Proceedings of the IEEE International Conference on Computer-Aided Design, 646–651.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1990 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Schleutermann, S., Arabie, P., Hubert, L.J., Bronsard, F. (1990). Some Algorithms for “Bond Energy” Data Analysis, Including Simulated Annealing. In: Schader, M., Gaul, W. (eds) Knowledge, Data and Computer-Assisted Decisions. NATO ASI Series, vol 61. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-84218-4_11
Download citation
DOI: https://doi.org/10.1007/978-3-642-84218-4_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-84220-7
Online ISBN: 978-3-642-84218-4
eBook Packages: Springer Book Archive