Abstract
A fixed matrix iteration algorithm was proposed by A. Dax (Numer. Algor. 50, 97–114 2009) for solving linear inequalities in a least squares sense. However, a great deal of computation for this algorithm is required, especially for large-scale problems, because a least squares subproblem should be solved accurately at each iteration. We present a modified method, the inexact fixed iteration method, which is a generalization of the fixed matrix iteration method. In this inexact iteration process, the classical LSQR method is implemented to determine an approximate solution of each least squares subproblem with less computational effort. The convergence of this algorithm is analyzed and several numerical examples are presented to illustrate the efficiency of the inexact fixed matrix iteration algorithm for solving large linear inequalities.
Similar content being viewed by others
References
Björck, Å.: Numerical Methods for Least Squares Problems. SIAM, Philadelphia (1996)
Boyd, S., Vandenberghe, L.: Convex Optimization. Cambridge University Press (2004)
Bramley, R., Winnicka, B.: Solving linear inequalities in a least squares sense. SIAM J. Sci. Comput 17, 275–286 (1996)
Censor, Y., Altschuler, M.D., Powlis, W.D.: A computational solution of the inverse problem in radiation-therapy treatment planning. Appl. Math. Comput 25, 57–87 (1988)
Censor, Y., Ben-Israel, A., Xiao, Y., Galvin, J.M.: On linear infeasibility arising in intensity modulated radiation therapy inverse planning. Linear Algebra Appl 428, 1406–1420 (2008)
Chinneck, J.W.: Feasibility and infeasibility in optimization: algorithms and computational methods. In: International Series in Operations Research and Management Sciences, vol. 118. Springer-Verlag (2007)
Davis, T.A.: Algorithm 915, SuiteSparseQR: Multifrontal multithreaded rank-revealing sparse QR factorization. ACM Trans. Math. Softw. 38, 1–22 (2011)
Dax, A.: The convergence of linear stationary iterative processes for solving singular unstructured systems of linear equations. SIAM Rev. 32, 611–635 (1990)
Dax, A.: The smallest correction of an inconsistent system of linear inequalities. Optimiz. Eng. 2, 349–359 (2001)
Dax, A.: A hybrid algorithm for solving linear inequalities in a least squares sense. Numer. Algor. 50, 97–114 (2009)
Gilbert, J.R., Moler, C., Schreiber, R.: Sparse matrices in MATLAB: design and implementation. SIAM J. Matrix Anal. Appl 13, 333–356 (1992)
Golub, G.H., Kahan, W.: Calculating the singular values and pseudoinverse of a matrix. SIAM J. Numer. Anal 2, 205–224 (1965)
Golub, G.H., Van Loan, C.F.: Matrix Computations. Johns Hopkins University Press (1983)
Han, S.P.: Least squares solution of linear inequalities. Technical Report 2141, Math. Res. Center, University of Wisconsin-Madison (1980)
He, B.S.: A projection and contraction method for a class of linear complementarity problem and its application in convex quadratic programming. Appl. Math. Optim. 25, 247–262 (1992)
He, B.S.: Solving a class of linear projection equations. Numer. Math. 68, 71–80 (1994)
Herman, G.T.: A relaxation method for reconstructing object from noisy X-rays. Math. Progr. 8, 1–19 (1975)
Herman, G.T.: Image Reconstruction from Projections: The Fundamentals of Computerized Tomography. Academic Press, New York (1982)
Moreau, J.J.: Decomposition orthogonale d’un espace Hilbertien selon deux cânes mutuellement polaires. C.R. Acad. Sci. Paris 225, 238–240 (1962)
Morikuni, K., Hayami, K.: Inner-iteration Krylov subspace methods for least squares problems. SIAM J. Matrix Anal. Appl 34, 1–22 (2013)
Paige, C.C., Saunders, M.A.: LSQR, An algorithm for sparse linear equations and sparse least squares. ACM Trans. Math. Software 8, 43–71 (1982)
Pinar, M.C.: Newton’s method for linear inequality systems. Eur. J. Oper. Res 107, 710–719 (1998)
Saad, Y.: Iterative Methods for Sparse Linear Systems. SIAM, Philadelphia (2003)
Stewart, G.W.: Matrix Algorithms, Volume 1: Basic Decompositions. SIAM, Philadelphia (1998)
Stiefel, E.: Ausgleichung ohne Aufstellung der Gausschen Normalgleichungen. Wiss. Z. Tech. Hochsch. Dresden 2, 441–442 (1952–1953)
Wang, R.S.: Functional Analysis and Optimization Theory. Beijing University of Aeronautics and Astronautics Press (2003). In Chinese
Wierzbicki, A.P., Kurcyusz, S.: Projection on a cone, penalty functionals and duality theory for problems with inequality constraints in Hilbert space. SIAM J. Control Optim 15, 25–56 (1977)
Xiu, N., Wang, C., Zhang, J.: Convergence properties of projection and contraction methods for variational inequality problems. Appl. Math. Optim 43, 147–168 (2001)
Zarantonello, E.H.: Projections on Convex Sets in Hilbert Space and Spectral Theory. Academic Press (1971)
National Institute of Standards and Technology, MatrixMarket, http://math.nist.gov/MatrixMarket (2002)
Sparse QR factorization package, http://www.cise.ufl.edu/research/sparse/SPQR/ (2013)
Author information
Authors and Affiliations
Corresponding author
Additional information
The work was supported by National Natural Science Foundations of China (No. 11201136) and Fundamental Research Funds for the Central Universities (No. 531107040014).
Rights and permissions
About this article
Cite this article
Lei, Y. The inexact fixed matrix iteration for solving large linear inequalities in a least squares sense. Numer Algor 69, 227–251 (2015). https://doi.org/10.1007/s11075-014-9892-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11075-014-9892-2