Abstract
We consider the well-known line search algorithm that iteratively refines the search interval by subdivision and bracketing the optimum. In our applications, evaluations of the objective function typically require minutes or hours, so it becomes attractive to use more than the standard three steps in the subdivision, performing the evaluations in parallel. A statistical model for this scenario is presented giving the total execution time T in terms of the number of steps k and the probability distribution for the individual evaluation times. Both the model and extensive simulations show that the expected value of T does not fall monotonically with k, in fact more steps may significantly increase the execution time. We propose heuristics for speeding convergence by continuing to the next iteration before all evaluations are complete. Simulations are used to estimate the speedup achieved.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
D. Abramson, I. Foster, J. Giddy, A. Lewis, R. Sosic, R. Sutherst and N. White, The Nimrod computational workbench: A case study in desktop metacomputing, in Computational Techniques and Applications Conference, Melbourne, July, 1995.
D. Abramson, A. Lewis and T. C. Peachey, An automatic design optimization tool and its application to computational fluid dynamics, in Supercomputing 2001, Denver, November, 2001.
A. O. Allen, Probability, Statistics and Queueing Theory (Academic Press, New York, 1978).
F. W. Burton, Speculative computation, parallelism and functional programming, IEEE Trans. Comput., C–34 (1985), 1190–1193.
J. Kiefer, Sequential minimax search for a maximum, Proc. AMS 4 (1953), 502–506.
M. J. D. Powell, An efficient method of finding the minimum of a function of several variables without calculating derivatives, Comput. J., 7 (1964), 155–162.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag New York
About this chapter
Cite this chapter
Peachey, T., Abramson, D., Lewis, A. (2009). Parallel line search. In: Pearce, C., Hunt, E. (eds) Optimization. Springer Optimization and Its Applications, vol 32. Springer, New York, NY. https://doi.org/10.1007/978-0-387-98096-6_20
Download citation
DOI: https://doi.org/10.1007/978-0-387-98096-6_20
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-0-387-98095-9
Online ISBN: 978-0-387-98096-6
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)