On Glowinski’s Open Question on the Alternating Direction Method of Multipliers
- 99 Downloads
The alternating direction method of multipliers was proposed by Glowinski and Marrocco in 1974, and it has been widely used in a broad spectrum of areas, especially in some sparsity-driven application domains. In 1982, Fortin and Glowinski suggested to enlarge the range of the dual step size for updating the multiplier from 1 to the open interval of zero to the golden ratio, and this strategy immediately accelerates the convergence of alternating direction method of multipliers for most of its applications. Meanwhile, Glowinski raised the question of whether or not the range can be further enlarged to the open interval of zero to 2; this question remains open with nearly no progress in the past decades. In this paper, we answer this question affirmatively for the case where both the functions in the objective function are quadratic. Thus, Glowinski’s open question is partially answered. We further establish the global linear convergence of the alternating direction method of multipliers with this enlarged step size range for the quadratic programming under a tight condition.
KeywordsAlternating direction method of multipliers Glowinski’s open question Quadratic programming Step size Linear convergence
Mathematics Subject Classification90C25 90C30 65K05 90C20
Min Tao was supported by the NSFC Grant: 11301280 and the Fundamental Research Funds for the Central Universities: 14380019. Xiaoming Yuan was supported by the General Research Fund from Hong Kong Research Grants Council: 12313516.
- 3.Glowinski, R.: On alternating direction methods of multipliers: a historical perspective. In: Fitzgibbon, W., Kuznetsov, Y.A., Neittaanmaki, P., Pironneau, O. (eds.) Modeling, Simulation and Optimization for Science and Technology, Computational Methods in Applied Sciences, vol. 34, pp. 59–82. Springer, Dordrecht (2014)Google Scholar
- 4.Glowinski, R., Osher, S.J., Yin, W.T. (eds.): Splitting Methods for Communications and Imaging, Science and Engineering. Springer, Switzerland (2016)Google Scholar
- 22.Powell, M.J.D.: A method for nonlinear constraints in minimization problems. In: Fletcher, R. (ed.) Optimization, pp. 283–298. Academic Press, New York (1969)Google Scholar
- 25.Bergen, A.R.: Power Systems Analysis. Prentice Hall, Englewood Cliffs (1986)Google Scholar
- 30.Markowitz, H.M.: Porfolio Selection: Efficient Diversification of Investments. Wiley, New York (1959)Google Scholar
- 37.Meyer, C.D.: Matrix Analysis and Applied Linear Algebra. SIAM, Philadelphia (2006)Google Scholar