Regularization of proximal point algorithms in Hadamard manifolds

  • Qamrul Hasan AnsariEmail author
  • Feeroz Babu
  • Jen-Chih Yao


In this paper, we consider the regularization method for exact as well as for inexact proximal point algorithms for finding the singularities of maximal monotone set-valued vector fields. We prove that the sequences generated by these algorithms converge to an element of the set of singularities of a maximal monotone set-valued vector field. A numerical example is provided to illustrate the inexact proximal point algorithm with regularization. Applications of our results to minimization problems and saddle point problems are given in the setting of Hadamard manifolds.


Inclusion problems regularization method proximal point algorithms maximal monotone vector fields minimization problems saddle point problems Hadamard manifolds 

Mathematics Subject Classification

49J53 49J40 47H05 47J22 



The authors are grateful to the reviewers for their valuable suggestions and corrections that improved the first draft of this paper. In this research, the first author was supported by a research Grant of DST-SERB No. EMR/2016/005124, and the last author was supported by a research Grant No. MOST 105-2115-M-039-002-MY3.


  1. 1.
    Bačák, M., Reich, S.: The asymptotic behavior of a class of nonlinear semigroups in Hadamard spaces. J. Fixed Point Theory Appl. 16, 189–202 (2014)MathSciNetCrossRefGoogle Scholar
  2. 2.
    Bauschke, H.H., Combettes, P.L.: A weak-to-strong convergence principle for Fejér-monotone methods in Hilbert spaces. Math. Oper. Res. 26, 248–264 (2001)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Bauschke, H.H., Matoušková, E., Reich, S.: Projection and proximal point methods, convergence results and counterexamples. Nonlinear Anal. 56, 715–736 (2004)MathSciNetCrossRefGoogle Scholar
  4. 4.
    Bridson, M., Haefliger, A.: Metric Spaces of Non-positive Curvature. Springer, Berlin, Heidelberg, New York (1999)CrossRefGoogle Scholar
  5. 5.
    Bruck, R.E.: A strongly convergent iterative solution of \(0 \in U(x)\) for a maximal monotone operator in Hilbert space. J. Math. Anal. Appl. 48, 114–126 (1974)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Bruck, R.E., Reich, S.: Nonexpansive projections and resolvents of accretive operators in Banach spaces. Houston J. Math. 3, 459–470 (1977)MathSciNetzbMATHGoogle Scholar
  7. 7.
    Bruck, R.E., Reich, S.: A general convergence principle in nonlinear functional analysis. Nonlinear Anal. 4, 939–950 (1980)MathSciNetCrossRefGoogle Scholar
  8. 8.
    da Cruz Neto, J.X., Ferreira, O.P., Lucambio Pérez, L.R., Németh, S.Z.: Convex- and monotone-transformable mathematical programming problems and a proximal-like point method. J. Global Optim., 35, 53–69 (2006)Google Scholar
  9. 9.
    da Cruz Neto, J.X., Ferreira, O.P., Lucambio Pérez, L.R.: Monotone point-to-set vector fields. Balk. J. Geometry Appl 5(1), 69–79 (2000)MathSciNetzbMATHGoogle Scholar
  10. 10.
    Ferreira, O.P., Oliveira, P.R.: Proximal point algorithm on Riemannian manifolds. Optimization 51, 257–270 (2002)MathSciNetCrossRefGoogle Scholar
  11. 11.
    Güler, O.: On The convergence of the proximal point algorithm for convex minimization. SIAM J. Control Optim. 29, 403–419 (1991)MathSciNetCrossRefGoogle Scholar
  12. 12.
    Han, D.R., He, B.S.: A new accuracy criterion for approximate proximal point algorithms. J. Math. Anal. Appl. 263, 343–354 (2001)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Kamimura, S., Takahashi, W.: Approximating solutions of maximal monotone operators in Hilbert spaces. J. Approx. Theory 106, 226–240 (2000)MathSciNetCrossRefGoogle Scholar
  14. 14.
    Kamimura, S., Takahashi, W.: Strong convergence of a proximal-type algorithm in a Banach space. SIAM J. Optim. 13(3), 938–945 (2003)MathSciNetCrossRefGoogle Scholar
  15. 15.
    Lehdili, N., Moudafi, A.: Combining the proximal algorithm and Tikhonov regularization. Optimization 37, 239–252 (1996)MathSciNetCrossRefGoogle Scholar
  16. 16.
    Li, C., López, G., Martín-Márquez, V.: Monotone vector fields and the proximal point algorithm on Hadamard manifolds. J. Lond. Math. Soc. 79, 663–683 (2009)MathSciNetCrossRefGoogle Scholar
  17. 17.
    Li, C., López, G., Martín-Márquez, V.: Iterative algorithms for nonexpansive mappings on Hadamard manifolds. Taiwan. J. Math. 14(2), 541–559 (2010)MathSciNetCrossRefGoogle Scholar
  18. 18.
    Li, C., López, G., Martín-Márquez, V.: Resolvents of set-valued monotone vector fields in Hadamard manifolds. Set Val. Anal. 19, 361–383 (2011)MathSciNetCrossRefGoogle Scholar
  19. 19.
    Nevanlinna, O., Reich, S.: Strong convergence of contraction semigroups and of iterative methods for accretive operators in Banach spaces. Israel J. Math. 32, 44–58 (1979)MathSciNetCrossRefGoogle Scholar
  20. 20.
    Reich, S.: Extension problems for accretive sets in Banach spaces. J. Funct. Anal. 26, 378–395 (1977)MathSciNetCrossRefGoogle Scholar
  21. 21.
    Reich, S., Salinas, Z.: Weak convergence of infinite products of operators in Hadamard spaces. Rend. Circ. Mat. Palermo 65, 55–71 (2016)MathSciNetCrossRefGoogle Scholar
  22. 22.
    Rockafellar, R.T.: Monotone operators and the proximal point algorithm. SIAM J. Control Optim. 14, 877–898 (1976)MathSciNetCrossRefGoogle Scholar
  23. 23.
    Rudin, W.: Real and Complex Analysis, 3rd edn. McGraw-Hill, New York (1987)zbMATHGoogle Scholar
  24. 24.
    Sahu, D.R., Ansari, Q.H., Yao, J.C.: The Prox–Tikhonov-like forward-backward method and applications. Taiwan. J. Math. 19, 481–503 (2015)MathSciNetCrossRefGoogle Scholar
  25. 25.
    Sakai, T.: Riemannian geometry, translations of mathematical monographs. American Mathematical Society, Providence, RI (1996)Google Scholar
  26. 26.
    Solodov, M.V., Svaiter, B.F.: Forcing strong convergence of proximal point iterations in a Hilbert space. Math. Program., Ser. A, 87, 189–202 (2000)MathSciNetCrossRefGoogle Scholar
  27. 27.
    Song, Y., Yang, C.: A note on a paper “A regularization method for the proximal point algorithm”. J. Global Optim. 43, 171–174 (2009)MathSciNetCrossRefGoogle Scholar
  28. 28.
    Tang, G.J., Huang, N.J.: An inexact proximal point algorithm for maximal monotone vector fields on Hadamard manifolds. Oper. Res. Lett. 41, 586–591 (2013)MathSciNetCrossRefGoogle Scholar
  29. 29.
    Udriste, C.: Convex Functions and Optimization Methods on Riemannian Manifolds. Kluwer Academic Publishers, Dordrecht, Boston, London (1994)CrossRefGoogle Scholar
  30. 30.
    Walter, R.: On the metric projections onto convex sets in Riemannian spaces, pp. 91–98. Arch. Math, XXV (1974)Google Scholar
  31. 31.
    Wang, F.: A note on the regularized proximal point algorithm. J. Global Optim. 50, 531–535 (2011)MathSciNetCrossRefGoogle Scholar
  32. 32.
    Wang, J., Li, C., López, G., Yao, J.C.: Convergence analysis of inexact proximal point algorithms on Hadamard manifolds. J. Global Optim. 61(3), 553–573 (2015)MathSciNetCrossRefGoogle Scholar
  33. 33.
    Xu, H.K.: A regularization method for the proximal point algorithm. J. Global Optim. 36, 115–125 (2006)MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Department of MathematicsAligarh Muslim UniversityAligarhIndia
  2. 2.Department of Mathematics and StatisticsKing Fahd University of Petroleum and MineralsDhahranSaudi Arabia
  3. 3.Research Center for International Computing, China Medical University HospitalChina Medical UniversityTaichungTaiwan

Personalised recommendations