First-Order Algorithms for Optimization Problems with a Maximum Eigenvalue/Singular Value Cost and or Constraints

  • Elijah Polak
Part of the Nonconvex Optimization and Its Applications book series (NOIA, volume 57)


Optimization problems with maximum eigenvalue or singular eigenvalue cost or constraints occur in the design of linear feedback systems, signal processing, and polynomial interpolation on a sphere. Since the maximum eigenvalue of a positive definite matrix Q(x) is given by max‖y‖=1〈(y, Q(x)y〉, we see that such problems are, in fact, semi-infinite optimization problems. We will show that the quadratic structure of these problems can be exploited in constructing specialized first-order algorithms for their solution that do not require the discretization of the unit sphere or the use of outer approximations techniques.


Accumulation Point Support Point Maximum Eigenvalue Unique Minimizer Outer Approximation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    S. P. Boyd, V. Balakrishnan, C. H. Barratt, N. M. Khraishi, X. Li, D. G. Meyer, and S. A. Norman. A new CAD method and associated architectures for linear controllers, IEEE Transactions on Automatic Control, 33:268–283, 1988.MathSciNetzbMATHCrossRefGoogle Scholar
  2. [2]
    L. Davis, and E. Polak. Maximum likelihood constrained covariance estimation, Submitted to IEEE Transactions on Signal Processing, Sept 2000.Google Scholar
  3. [3]
    J. C. Doyle, and G. Stein. Multivariable feedback design concepts for a classical/modern synthesis, IEEE Transactions on Automatic Control, AC-26:4–16, 1981.zbMATHCrossRefGoogle Scholar
  4. [4]
    M. Frank, and P. Wolfe. An algorithm for quadratic programming, Naval Research Logistics Quarterly, 3:95–110, 1956.MathSciNetCrossRefGoogle Scholar
  5. [5]
    D. Gray, B. Anderson, and P. Sim. Estimation of structured covariances with applications to array beamforming, Circuits, Systems and Signal Processing, 6:421–447, 1987.zbMATHCrossRefGoogle Scholar
  6. [6]
    J. E. Higgins, and E. Polak. Minimizing pseudo-convex functions on convex compact sets, Journal of Optimi Zation Theory andApplications, 65:128, 1990.MathSciNetGoogle Scholar
  7. [7]
    A. S. Lewis, and M. L. Overton. Eigenvalue optimization, Acta Nurnerica, 5:149–190, 1996.MathSciNetCrossRefGoogle Scholar
  8. [8]
    M. I. Miller, D. R. Fuhrmann, J. A. O’Sullivan, and D. L. Snyder. Maximum likelihood methods for Toeplitz covariance estimation and radar imaging. In S. Haykin, editor, Advances in Spectrum Analysis and Array Processing, Prentice-Hall, 1991.Google Scholar
  9. [9]
    V. Pisarenko. The retrieval of harmonics from a covariance function, Geophysical Journal of the Royal Astronomical Society, 33:347–366, 1973.zbMATHCrossRefGoogle Scholar
  10. [10]
    E. Polak, and L. He. A unified steerable phase I — phase II method of feasible directions for semi-infinite optimization, Journal of Optimization Theory and Applications, 61: 83–107, 1991.MathSciNetCrossRefGoogle Scholar
  11. [11]
    E. Polak. Optimization: Algorithms and Consistent Approximmations, Springer-Verlag, 1997.Google Scholar
  12. [12]
    I. H. Sloan. Interpolation and hyperinterpolation on the sphere, in Multivariate Approximation: Recent Trends and Results. In W. Hausmann, K. Jetter, and M. Reimer, editors, pages 255–268, Academie Verlag (WileyVCH), 1995.Google Scholar
  13. [13]
    D. Snyder, J. O’Sullivan, and M. Miller. The use of maximum likelihood estimation for forming images of diffuse radar targets from delay—Doppler data, IEEE Transactions on Information Theory, 35:536–548, 1989.MathSciNetCrossRefGoogle Scholar
  14. [14]
    L. Vandenberghe, and S. Boyd. Semi-definite programming, SIAM Review, 38:49–95, 1996.MathSciNetzbMATHCrossRefGoogle Scholar
  15. [15]
    R. S. Womersley, and I. H. Sloan. How good can polynomial interpolation on the sphere be?, Technical Report, School of Mathematics, University of New South Wales, , Sydney Australia, 1999.Google Scholar

Copyright information

© Springer Science+Business Media Dordrecht 2001

Authors and Affiliations

  • Elijah Polak
    • 1
  1. 1.Department of Electrical Engineering and Computer SciencesUniversity of CaliforniaBerkeleyUSA

Personalised recommendations