A Projection Method for Optimization Problems on the Stiefel Manifold

  • Oscar Dalmau-Cedeño
  • Harry OviedoEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10267)


In this paper we propose a feasible method based on projections using a curvilinear search for solving optimization problems with orthogonality constraints. Our algorithm computes the SVD decomposition in each iteration in order to preserve feasibility. Additionally, we present some convergence results. Finally, we perform numerical experiments with simulated problems; and analyze the performance of the proposed methods compared with state-of-the-art algorithms.


Constrained optimization Orthogonality constraints Non-monotone algorithm Stiefel manifold Optimization on manifolds 



This work was supported in part by CONACYT (Mexico), Grant 258033.


  1. 1.
    Absil, P.A., Mahony, R., Sepulchre, R.: Optimization Algorithms on Matrix Manifolds. Princeton University Press, Princeton (2009)zbMATHGoogle Scholar
  2. 2.
    Barzilai, J., Borwein, J.M.: Two-point step size gradient methods. IMA J. Numer. Anal. 8(1), 141–148 (1988)MathSciNetCrossRefzbMATHGoogle Scholar
  3. 3.
    Dai, Y.H., Fletcher, R.: Projected barzilai-borwein methods for large-scale box-constrained quadratic programming. Numerische Mathematik 100(1), 21–47 (2005)MathSciNetCrossRefzbMATHGoogle Scholar
  4. 4.
    d’Aspremont, A., Ghaoui, L., Jordan, M.I., Lanckriet, G.R.: A direct formulation for sparse PCA using semidefinite programming. SIAM Rev. 49(3), 434–448 (2007)MathSciNetCrossRefzbMATHGoogle Scholar
  5. 5.
    Eldén, L., Park, H.: A procrustes problem on the stiefel manifold. Numerische Mathematik 82(4), 599–619 (1999)MathSciNetCrossRefzbMATHGoogle Scholar
  6. 6.
    Francisco, J., Martini, T.: Spectral projected gradient method for the procrustes problem. TEMA (São Carlos) 15(1), 83–96 (2014)MathSciNetCrossRefGoogle Scholar
  7. 7.
    Grubisi, I., Pietersz, R.: Efficient rank reduction of correlation matrices. Linear Algebra Appl. 422(2), 629–653 (2007)MathSciNetCrossRefzbMATHGoogle Scholar
  8. 8.
    Joho, M., Mathis, H.: Joint diagonalization of correlation matrices by using gradient methods with application to blind signal separation. In: Sensor Array and Multichannel Signal Processing Workshop Proceedings, pp. 273–277. IEEE (2002)Google Scholar
  9. 9.
    Kokiopoulou, E., Chen, J., Saad, Y.: Trace optimization and eigenproblems in dimension reduction methods. Numer. Linear Algebra Appl. 18(3), 565–602 (2011)MathSciNetCrossRefzbMATHGoogle Scholar
  10. 10.
    Liu, Y.F., Dai, Y.H., Luo, Z.Q.: On the complexity of leakage interference minimization for interference alignment. In: 2011 IEEE 12th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC), pp. 471–475. IEEE (2011)Google Scholar
  11. 11.
    Manton, J.H.: Optimization algorithms exploiting unitary constraints. IEEE Trans. Signal Process. 50(3), 635–650 (2002)MathSciNetCrossRefGoogle Scholar
  12. 12.
    Pietersz, R., Groenen, P.J.: Rank reduction of correlation matrices by majorization. Quant. Fin. 4(6), 649–662 (2004)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Raydan, M.: The Barzilai and Borwein gradient method for the large scale unconstrained minimization problem. SIAM J. Optim. 7(1), 26–33 (1997)MathSciNetCrossRefzbMATHGoogle Scholar
  14. 14.
    Saad, Y.: Numerical Methods for Large Eigenvalue Problems, vol. 158. SIAM, Manchester (1992)zbMATHGoogle Scholar
  15. 15.
    Wen, Z., Yin, W.: A feasible method for optimization with orthogonality constraints. Math. Program. 142(1–2), 397–434 (2013)MathSciNetCrossRefzbMATHGoogle Scholar
  16. 16.
    Yang, C., Meza, J.C., Lee, B., Wang, L.W.: KSSOLVoa MATLAB toolbox for solving the Kohn-Sham equations. ACM Trans. Math. Softw. (TOMS) 36(2), 10 (2009)CrossRefGoogle Scholar
  17. 17.
    Zhang, H., Hager, W.W.: A nonmonotone line search technique and its application to unconstrained optimization. SIAM J. Optim. 14(4), 1043–1056 (2004)MathSciNetCrossRefzbMATHGoogle Scholar
  18. 18.
    Zhang, Z., Du, K.: Successive projection method for solving the unbalanced procrustes problem. Sci. China Ser. A 49(7), 971–986 (2006)MathSciNetCrossRefzbMATHGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Mathematics Research CenterCIMAT A.C.GuanajuatoMexico

Personalised recommendations