Skip to main content

Prologue

  • Chapter
  • First Online:
Sparse and Redundant Representations

Abstract

A central achievement of classical linear algebra is a thorough examination of the problem of solving systems of linear equations. The results – definite, timeless, and profound – give the subject a completely settled appearance. As linear systems of equations are the core engine in many engineering developments and solutions, much of this knowledge is practically and successfully deployed in applications. Surprisingly, within this well-understood arena there is an elementary problem that has to do with sparse solutions of linear systems, which only recently has been explored in depth; we will see that this problem has surprising answers, and it inspires numerous practical developments. In this chapter we shall concentrate on defining this problem carefully, and set the stage for its answers in later chapters.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 49.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 64.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 99.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Further Reading

  1. D.P. Bertsekas, Nonlinear Programming, 2nd Edition, Athena Scientific, 2004.

    Google Scholar 

  2. S. Boyd and L. Vandenberghe, Convex Optimization, Cambridge University Press, 2004.

    MATH  Google Scholar 

  3. A.M. Bruckstein, D.L. Donoho, and M. Elad, From sparse solutions of systems of equations to sparse modeling of signals and images, SIAM Review, 51(1):34–81, February 2009.

    Article  MATH  MathSciNet  Google Scholar 

  4. S.S. Chen, D.L. Donoho, and M.A. Saunders, Atomic decomposition by basis pursuit, SIAM Journal on Scientific Computing, 20(1):33–61 (1998).

    Article  MathSciNet  Google Scholar 

  5. S.S. Chen, D.L. Donoho, and M.A. Saunders, Atomic decomposition by basis pursuit, SIAM Review, 43(1):129–159, 2001.

    Article  MATH  MathSciNet  Google Scholar 

  6. C. Daniel and F.S. Wood, Fitting Equations to Data: Computer Analysis of Multifactor Data, 2nd Edition, John Wiley and Sons, 1980.

    MATH  Google Scholar 

  7. G. Davis, S. Mallat, and Z. Zhang, Adaptive time-frequency decompositions, Optical-Engineering, 33(7):2183–91, 1994.

    Article  Google Scholar 

  8. G.H. Golub and C.F. Van Loan, Matrix Computations, Johns Hopkins Studies in Mathematical Sciences, Third edition, 1996.

    Google Scholar 

  9. R.A. Horn C.R. Johnson, Matrix Analysis, New York: Cambridge University Press, 1985.

    MATH  Google Scholar 

  10. A.K. Jain, Fundamentals of Digital Image Processing, Englewood Cli_s, NJ, Prentice-Hall, 1989.

    MATH  Google Scholar 

  11. D. Luenberger, Linear and Nonlinear Programming, 2nd Edition, Addison- Wesley, Inc., Reading, Massachusetts 1984.

    MATH  Google Scholar 

  12. S. Mallat, A Wavelet Tour of Signal Processing, Academic-Press, 1998.

    MATH  Google Scholar 

  13. S. Mallat and E. LePennec, Sparse geometric image representation with bandelets, IEEE Trans. on Image Processing, 14(4):423–438, 2005.

    Article  MathSciNet  Google Scholar 

  14. S. Mallat and Z. Zhang, Matching pursuits with time-frequency dictionaries, IEEE Trans. Signal Processing, 41(12):3397–3415, 1993.

    Article  MATH  Google Scholar 

  15. M. Marcus and H. Minc, A Survey of Matrix Theory and Matrix Inequalities, Prindle, Weber & Schmidt, Dover, 1992.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Michael Elad .

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Elad, M. (2010). Prologue. In: Sparse and Redundant Representations. Springer, New York, NY. https://doi.org/10.1007/978-1-4419-7011-4_1

Download citation

Publish with us

Policies and ethics