Abstract
In this paper, we give an overview of some recent developments in using simulation together with gradient estimation techniques to provide solutions for difficult stochastic optimization problems and stochastic variational inequalities. The basic idea is to observe a fixed sample path (by using the method of common random numbers from the simulation literature), solve the resulting deterministic problem using fast and effective methods from nonlinear programming, and then use the resulting solutions to infer information about the solution of the original stochastic problem. We describe these so-called sample-path methods precisely, review some conditions under which they are known to work, and comment on their potential advantages and limitations. We also illustrate some application areas in which these ideas have been successful.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Correa, R. and Lemaréchal, C. 1993. Convergence of some algorithms for convex minimization Mathematical Programming 62: 261–275.
De Wolf, D. and Smeers, Y. 1997. A stochastic version of a Stackelberg-NashCournot equilibrium model. Management Science 43 (2): 190–197.
Dirkse, S. and Ferris, M. C. 1995a. The PATH solver: a non-monotone stabilization scheme for mixed complementarity problems. Optimization Methods and Software 5: 123–156.
Dirkse, S. and Ferris, M. C. 1995b. MCPLIB: A collection of nonlinear mixed complementarily problems. Optimization Methods and Software 5: 319–345.
Dontchev, A. and Rockafellar, R. T. 1996. Characterizations of strong regularity for variational inequalities over polyhedral convex sets. SIAM Journal on Optimization 6: 1087–1105.
Ferris, M. C. and Pang, J.-S. 1997. Engineering and economic applications of complementarity problems. Forthcoming in SIAM Review.
Fletcher, R. 1987. Practical Methods of Optimization, 2nd Ed. ( Wiley, Chichester).
Fu, B.-R. 1996. Modeling and analysis of discrete tandem production lines using continuous flow models. Ph. D. Dissertation. Department of Industrial Engineering, University of Wisconsin-Madison, Madison, Wisconsin, USA.
Fu, M. C., and Hu, J.-Q. 1995. Sensitivity Analysis for Monte Carlo Simulation of Option Pricing. Probability in the Engineering and Informational Sciences 9: 417–449.
Gill, P. E., Murray, W., and Wright, M. H. 1981. Practical Optimization ( Academic Press, London).
Glasserman, P. 1991. Gradient Estimation via Perturbation Analysis (Kluwer, Norwell, MA).
Gürkan, G. 1996. Performance optimization in simulation: Sample-path optimization of buffer allocations in tandem lines. Ph.D. Dissertation, Department of Industrial Engineering, University of Wisconsin-Madison, Madison, Wisconsin, USA.
Gürkan, G., Özge, A. Y. and Robinson, S. M. 1996. Sample-path solution of stochastic variational inequalities, with applications to option pricing. In: Proceedings of the 1996 Winter Simulation Conference, eds. J. M. Charnes, D. M. Motrice, D. T. Brunner, and J. J. Swain ( IEEE, Piscataway, New Jersey ), 337–344.
Gürkan, G., Özge, A. Y. and Robinson, S. M. 1997. Sample-path solution of stochastic variational inequalities. Preprint.
Harker, P. T. and Pang, J.-S. 1990. Finite-dimensional variational inequality and nonlinear complementarity problems: A survey of theory, algorithms, and applications. Mathematical Programming 48: 161–220.
Haurie, A., Zaccour, C., Legrand, J., and Smeers, Y. 1987. A stochastic dynamic Nash-Cournot model for the European gas market. Technical report G-87–24, GERAD, École des Hautes Etudes Commerciales, Montréal, Québec, Canada.
Healy, K. and Schruben, L. W. 1991. Retrospective simulation response optimization. In: Proceedings of the 1991 Winter Simulation Conference, eds. B.L. Nelson, W.D. Kelton and G.M. Clark ( IEEE, Piscataway, New Jersey ), 901–906.
Hiriart-Urruty, J.-B. and Lemaréchal, C. 1993a. Convex Analysis and Minimization Algorithms I (Grundlehren der mathematischen Wissenschaften 305, Springer-Verlag, Berlin).
Hiriart-Urruty, J.-B. and Lemaréchal, C. 1993b. Convex Analysis and Minimization Algorithms II (Grundlehren der mathematischen Wissenschaften 306, Springer-Verlag, Berlin).
Ho, Y.-C. and Cao, X.-R. 1991. Perturbation Analysis of Discrete Event Dynamical Systems (Kluwer, Norwell, MA).
Hogan, W. W. 1975. Energy policy models for Project Independence. Computers & Operations Research 2: 251–271.
Hull, J. C. 1993. Options, Futures, and Other Derivative Securities, 2d Ed. (Prentice-Hall, Englewood Cliffs, NJ ).
Josephy, N. H. 1979. Newton’s Method for Generalized Equations and the PIES Energy Model. Ph.D. Dissertation, Department of Industrial Engineering, University of Wisconsin-Madison, Madison, Wisconsin, USA.
Kall, P. 1986. Approximation to optimization problems: An elementary review. Mathematics of Operations Research 11: 9–18.
Kiwiel, K. C. 1990. Proximity control in bundle methods for convex nondifferentiable minimization Mathematical Programming 46: 105–122.
L’Ecuyer, P., Giroux, N. and Glynn, P. W. 1994. Stochastic optimization by simulation: numerical experiments with the M/M/1 queue in the steady-state. Management Science 40: 1245–1261.
Mort, J. and Wright, S. J. 1993. Optimization Software Guide. Frontiers in Applied Mathematics Vol. 14 ( Society for Industrial and Applied Mathematics, Philadelphia, Pennsylvania ).
Mulvey, J. M. and Vladimirou, H. 1991. Applying the progressive hedging algorithm to stochastic generalized networks. Annals of Operations Research 31: 399–424.
Özge, A. Y. 1997. Sample-path solution of stochastic variational inequalities and simulation optimization problems. Ph.D. Dissertation, Department of Industrial Engineering, University of Wisconsin-Madison, Madison, Wisconsin, USA.
Plambeck, E. L., Fu, B.-R., Robinson, S. M., and Suri, R. 1993. Throughput optimization in tandem production lines via nonsmooth programming In: Proceedings of the 1993 Summer Computer Simulation Conference, ed. J. Schoen ( Society for Computer Simulation, San Diego, CA ), 70–75.
Plambeck, E. L., Fu, B.-R., Robinson, S. M., and Suri, R. 1996. Sample-path optimization of convex stochastic performance functions. Mathematical Programming. 75: 137–176.
Qi, L., and Sun, J. 1993. A nonsmooth version of Newton’s method. Mathematical Programming 58: 353–367.
Robinson, S. M. 1980. Strongly regular generalized equations. Mathematics of Operations Research 5: 43–62.
Robinson, S. M. 1987. Local epi-continuity and local optimization. Mathematical Programming 37: 208–222.
Robinson, S. M. 1996. Analysis of sample-path optimization Mathematics of Operations Research 21: 513–528.
Rubinstein, R. Y. and Shapiro, A. 1993. Discrete Event Systems: Sensitivity Analysis and Stochastic Optimization by the Score Function Method ( Wiley, Chichester).
Schramm, H., and Zowe, J. 1990. A version of the bundle idea for minimizing a nonsmooth function: conceptual idea, convergence analysis, numerical results. Technical Report, 209. Mathematisches Institut, Universität Bayreuth, Bayreuth, Germany.
Sellami, H. and Robinson, S. M. 1996. Homotopies based on nonsmooth equations for solving nonlinear variational inequalities. In Nonlinear Optimization and Applications, eds. G. Di Pillo and F. Giannessi ( Plenum Publishing Corp., New York and London ) 329–342.
Sellami, H. and Robinson, S. M. 1997. Implementation of a continuation method for normal maps. Mathematical Programming 76: 563–578.
Stoll, H. R. and Whaley, R. E. 1993. Futures and Options ( South-Western, Cincinnati, OH )
Suri, R. 1989. Perturbation analysis: the state of the art and research issues explained via the GI/G/1 queue. Proceedings of the IEEE 77 (1): 114–137.
Suri, R. and Fu, B.-R. 1994. On using continuous flow lines to model discrete production lines. Discrete Event Dynamic Systems 4: 129–169.
Zowe J. 1989. The BT-algorithm for minimizing a nonsmooth functional subject to linear constraints. In: Nonsmooth Optimization and Related Topics, eds. F. H. Clarke, V. Demyanov, and F. Giannessi (Plenum Publishing Corp, New York ).
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1998 Springer Science+Business Media New York
About this chapter
Cite this chapter
Gürkan, G., Özge, A.Y., Robinson, S.M. (1998). Sample-Path Solutions for Simulation Optimization Problems and Stochastic Variational Inequalities. In: Woodruff, D.L. (eds) Advances in Computational and Stochastic Optimization, Logic Programming, and Heuristic Search. Operations Research/Computer Science Interfaces Series, vol 9. Springer, Boston, MA. https://doi.org/10.1007/978-1-4757-2807-1_6
Download citation
DOI: https://doi.org/10.1007/978-1-4757-2807-1_6
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4419-5023-9
Online ISBN: 978-1-4757-2807-1
eBook Packages: Springer Book Archive