Locally optimal and heavy ball GMRES methods
- 149 Downloads
The restarted GMRES (REGMRES) is one of the well used Krylov subspace methods for solving linear systems. However, the price to pay for the restart usually is slower speed of convergence. In this paper, we draw inspirations from the locally optimal CG and the heavy ball methods in optimization to propose two variants of the restarted GMRES that can overcome the slow convergence. Compared to various existing hybrid GMRES which are also designed to speed up REGMRES and which usually require eigen-region estimations, our variants preserve the appealing feature of GMRES and REGMRES—their simplicity. Numerical tests on real data are presented to demonstrate the superiority of the new methods over REGMRES and its variants.
KeywordsGMRES Restarted GMRES Locally optimal GMRES Heavy ball GMRES Linear system
Mathematics Subject Classification65F10
The authors are grateful to an anonymous referee for useful comments.
- 6.Elman, H.C.: Iterative methods for large, sparse nonsymmetric systems of linear equations. Ph.D. thesis, Department of Computer Science, Yale University (1982)Google Scholar
- 8.Elman, H.C., Streit, R.L.: Polynomial iteration for nonsymmetric indefinite linear systems. In: Hennart, J.-P. (ed.) Numerical Analysis. Lecture Notes in Mathematics, vol. 1230, pp. 103–117. Springer, Berlin Heidelberg (1986)Google Scholar
- 12.Imakura, A., Li, R.-C., Zhang, S.-L.: Locally optimal and heavy ball GMRES methods. Technical Report 2015-02, Department of Mathematics, University of Texas at Arlington. http://www.uta.edu/math/preprint/. Accessed Jan 2015
- 14.Li, R.-C.: Rayleigh quotient based optimization methods for eigenvalue problems. In: Bai, Z., Gao, W., Su, Y (eds.) Matrix Functions and Matrix Equations, Series in Contemporary Applied Mathematics, vol. 19. Lecture summary for 2013 Gene Golub SIAM Summer School, 22 July to 2 August 2013, Fudan University, Shanghai, China. World Scientific, Singapore (2015)Google Scholar
- 16.Liang, X., Li, R.-C.: The hyperbolic quadratic eigenvalue problem. Technical Report 2014-01, Department of Mathematics, University of Texas at Arlington. http://www.uta.edu/math/preprint/. Accessed Jan 2014