Advertisement

An indefinite proximal Peaceman–Rachford splitting method with substitution procedure for convex programming

  • Zhao DengEmail author
  • Sanyang Liu
Article
First Online:
  • 60 Downloads

Abstract

The strictly contractive Peaceman–Rachford splitting method (SCPRSM) has received a tremendous amount of attention for solving linearly constrained separable convex optimization problems. In this paper, we propose an indefinite proximal SCPRSM with substitution procedure (abbreviated as PPRSM-S) to improve numerical results. The prediction step takes a proximal SCPRSM cycle to update the variable blocks, then the correction step corrects the output slightly by computing a combination of the prediction step and the previous iteration. We derive the global convergence of the proposed method and analyze the convergence rate results under much mild conditions. Some experimental results on LASSO and total variation-based denoising problems demonstrate the efficiency of the substitution step and the indefinite proximal term.

Keywords

Convex programming Peaceman–Rachford splitting method Substitution Variational inequality Global convergence 

Mathematics Subject Classification

90C25 90C30 94A08 
This is a preview of subscription content, log in to check access.

Notes

Funding

This work was supported by the National Natural Science Foundation (no. 61877046) and the Fundamental Research Fund of Xidian University (no. JB180707).

Compliance with ethical standards

Conflict of interest

No potential conflict of interest was reported by the authors.

References

  1. Alvarez F, Attouch H (2001) An inertial proximal method for maximal monotone operators via discretization of a nonlinear oscillator with damping. Set Valued Anal 9(1–2):3–11MathSciNetzbMATHGoogle Scholar
  2. Bai J, Li J, Xu F, Zhang H (2018) Generalized symmetric admm for separable convex optimization. Comput Optim Appl 70(1):129–170MathSciNetzbMATHGoogle Scholar
  3. Beck A, Teboulle M (2009) A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J Imaging Sci 2(1):183–202MathSciNetzbMATHGoogle Scholar
  4. Boyd SP, Parikh N, Chu E, Peleato B, Eckstein J (2011) Distributed optimization and statistical learning via the alternating direction method of multipliers. Found Trends Mach Learn Arch 3(1):1–122zbMATHGoogle Scholar
  5. Cand’es EJ, Li X, Ma Y, Wright J (2011) Robust principal component analysis. J ACM 58(3):1–37MathSciNetGoogle Scholar
  6. Chang X, Liu S (2016) A 2-block semi-proximal admm for solving the H-weighted nearest correlation matrix problem. Optimization 66(1):1–16MathSciNetzbMATHGoogle Scholar
  7. Chang X, Liu S, Zhao P, Li X (2017) Convergent prediction–correction-based admm for multi-block separable convex programming. J Comput Appl Math 335:270–288MathSciNetzbMATHGoogle Scholar
  8. Chen C, Chan RH, Ma S, Yang J (2015) Inertial proximal admm for linearly constrained separable convex optimization. SIAM J Imaging Sci 8:2239–2267MathSciNetzbMATHGoogle Scholar
  9. Chen L, Sun D, Toh KC (2017) An efficient inexact symmetric Gauss-seidel based majorized admm for high-dimensional convex composite conic programming. Math Program 161(1):237–270MathSciNetzbMATHGoogle Scholar
  10. Combettes PL, Pesquet JC (2011) Proximal splitting methods in signal processing. In: Fixed-point algorithms for inverse problems in science and engineering, pp 185–212Google Scholar
  11. Corman E, Yuan X (2014) A generalized proximal point algorithm and its convergence rate. SIAM J Optim 24(4):1614–1638MathSciNetzbMATHGoogle Scholar
  12. Deng W, Lai MJ, Peng Z, Yin W (2017) Parallel multi-block admm with \(o(1/k)\) convergence. J Sci Comput 71(2):712–736Google Scholar
  13. Donoho DL, Tsaig Y (2008) Fast solution of \(l_1\)-norm minimization problems when the solution may be sparse. IEEE Trans Inf Theory 54(11):4789–4812Google Scholar
  14. Dou M, Li H, Liu X (2017) An inertial proximal Peaceman–Rachford splitting method. Sci Sin 47(2):333–348 Google Scholar
  15. Facchinei F, Pang J (2003) Finite-dimensional variational inequalities and complementarity problems. Springer, New York [2(1)] zbMATHGoogle Scholar
  16. Fu X, He B, Wang X, Yuan X (2014) Block-wise alternating direction method of multipliers with Gaussian back substitution for multiple-block convex programming. http://www.optimization-online.org/DB_FILE/2014/09/4544.pdf
  17. Gabay D (1983) Chapter IX Applications of the method of multipliers to variational inequalities. Stud Math Appl 15:299–331Google Scholar
  18. Gao B, Ma F (2018) Symmetric alternating direction method with indefinite proximal regularization for linearly constrained convex optimization. J Optim Theory Appl 176(1):178–204MathSciNetzbMATHGoogle Scholar
  19. Gu Y, Jiang B, Han D (2015) A semi-proximal-based strictly contractive Peaceman–Rachford splitting method. arXiv preprint arXiv:1506.02221
  20. Han D, Yuan X, Zhang W, Cai X (2013) An ADM-based splitting method for separable convex programming. Comput Optim Appl 54(2):343–369MathSciNetzbMATHGoogle Scholar
  21. He B (2015) PPA-like contraction methods for convex optimization: a framework using variational inequality approach. J Oper Res Soc China 3(4):391–420MathSciNetzbMATHGoogle Scholar
  22. He B, Yuan X (2012) On the \(o(1/n)\) convergence rate of the Douglas–Rachford alternating direction method. SIAM J Numer Anal 50(2):700–709Google Scholar
  23. He B, Yuan X (2015) On non-Ergodic convergence rate of Douglas–Rachford alternating direction method of multipliers. Numerische Mathematik 130(3):567–577MathSciNetzbMATHGoogle Scholar
  24. He B, Tao M, Yuan X (2012) Alternating direction method with Gaussian back substitution for separalbe convex programming. SIAM J Optim 22(2):313–340MathSciNetzbMATHGoogle Scholar
  25. He B, Liu H, Wang Z, Yuan X (2014) A strictly contractive Peaceman–Rachford splitting method for convex programming. SIAM J Optim 24(3):1011–1040MathSciNetzbMATHGoogle Scholar
  26. He B, Ma F, Yuan X (2016) Convergence study on the symmetric version of ADMM with larger step sizes. SIAM J Imaging Sci 9(3):1467–1501MathSciNetzbMATHGoogle Scholar
  27. He B, Ma F, Yuan X (2017) Optimal linearized alternating direction method of multipliers for convex programming. http://www.optimization-online.org/DB_FILE/2017/09/6228.pdf
  28. Jiang F, Wu Z, Cai X (2018) Generalized ADMM with optimal indefinite proximal term for linearly constrained convex optimization. J Ind Manag Optim.  https://doi.org/10.3934/jimo.2018181
  29. Lions PL, Mercier B (1979) Splitting algorithms for the sum of two nonlinear operators. SIAM J Numer Anal 16(6):964–979MathSciNetzbMATHGoogle Scholar
  30. Peaceman DW, Rachford HH (1955) The numerical solution of parabolic and elliptic differential equations. J Soc Ind Appl Math 3(1):28–41MathSciNetzbMATHGoogle Scholar
  31. Rudin LI, Osher S, Fatemi E (1992) Nonlinear total variation based noise removal algorithms. Physica D 60(1–4):259–268 MathSciNetzbMATHGoogle Scholar
  32. Schaeffer H, Osher S (2013) A low patch-rank interpretation of texture. SIAM J Imaging Sci 6(1):226–262MathSciNetzbMATHGoogle Scholar
  33. Sun H, Tian M, Sun M (2017) The symmetric ADMM with indefinite proximal regularization and its application. J Inequal Appl 2017(1):172MathSciNetzbMATHGoogle Scholar
  34. Tao M, Yuan X (2011) Recovering low-rank and sparse components of matrices from incomplete and noisy observations. SIAM J Optim 21(1):57–81MathSciNetzbMATHGoogle Scholar
  35. Tao M, Yuan X (2018) The generalized proximal point algorithm with step size 2 is not necessarily convergent. Comput Optim Appl 70(3):1–13MathSciNetzbMATHGoogle Scholar
  36. Tibshirani R (2011) Regression shrinkage and selection via the lasso: a retrospective. J R Stat Soc Ser B Stat Methodol 73(3):273–282MathSciNetzbMATHGoogle Scholar
  37. Wang J, Song W (2017) An algorithm twisted from generalized ADMM for multi-block separable convex minimization models. J Comput Appl Math 309:342–358MathSciNetzbMATHGoogle Scholar
  38. Wu Z, Liu F, Li M (2018) A proximal Peaceman–Rachford splitting method for solving the multi-block separable convex minimization problems. Int J Comput Math 96(4):1–26 MathSciNetGoogle Scholar

Copyright information

© SBMAC - Sociedade Brasileira de Matemática Aplicada e Computacional 2019

Authors and Affiliations

  1. 1.School of Mathematics and StatisticsXidian UniversityXi’anPeople’s Republic of China

Personalised recommendations

Cite article

Buy options