Computational Optimization and Applications

, Volume 54, Issue 2, pp 263–282 | Cite as

Preconditioned iterative regularization in Banach spaces

  • Paola Brianzi
  • Fabio Di Benedetto
  • Claudio Estatico


Regularization methods for inverse problems formulated in Hilbert spaces usually give rise to over-smoothness, which does not allow to obtain a good contrast and localization of the edges in the context of image restoration.

On the other hand, regularization methods recently introduced in Banach spaces allow in general to obtain better localization and restoration of the discontinuities or localized impulsive signals in imaging applications.

We present here an expository survey of the topic focused on the iterative Landweber method. In addition, preconditioning techniques previously proposed for Hilbert spaces are extended to the Banach setting and numerically tested.


Regularization Banach spaces Landweber method Preconditioning 


  1. 1.
    Asplund, E.: Fréchet differentiability of convex functions. Acta Math. 121, 31–47 (1968) MathSciNetMATHCrossRefGoogle Scholar
  2. 2.
    Beauzamy, B.: Introduction to Banach Spaces and Their Geometry, 2nd revised edn. North-Holland, Amsterdam (1985) MATHGoogle Scholar
  3. 3.
    Benvenuto, F., Zanella, R., Zanni, L., Bertero, M.: Nonnegative least-squares image deblurring: improved gradient projection approaches. Inverse Probl. 26, 025004 (2010) (18 pp.) MathSciNetCrossRefGoogle Scholar
  4. 4.
    Bertero, M., Boccacci, P.: Introduction to Inverse Problems in Imaging. Institute of Physics Publ., Bristol (1998) MATHCrossRefGoogle Scholar
  5. 5.
    Bertsekas, D.P.: Nonlinear Programming. Athena Scientific, Belmont (1995) MATHGoogle Scholar
  6. 6.
    Bonettini, S., Zanella, R., Zanni, L.: A scaled gradient projection method for constrained image deblurring. Inverse Probl. 25, 015002 (2009) (23 pp.) MathSciNetCrossRefGoogle Scholar
  7. 7.
    Brianzi, P., Di Benedetto, F., Estatico, C.: Improvement of space-invariant image deblurring by preconditioned Landweber iterations. SIAM J. Sci. Comput. 30, 1430–1458 (2008) MathSciNetMATHCrossRefGoogle Scholar
  8. 8.
    Canuto, C., Urban, K.: Adaptive optimization of convex functionals in Banach spaces. SIAM J. Numer. Anal. 42, 2043–2075 (2005) MathSciNetMATHCrossRefGoogle Scholar
  9. 9.
    Censor, Y., Elfving, T., Herman, G.T., Nikazad, T.: On diagonally-relaxed orthogonal projection methods. SIAM J. Sci. Comput. 30, 473–504 (2008) MathSciNetMATHCrossRefGoogle Scholar
  10. 10.
    Chan, T.: An optimal circulant preconditioner for Toeplitz systems. SIAM J. Sci. Comput. 9, 766–771 (1988) MATHCrossRefGoogle Scholar
  11. 11.
    Cimmino, G.: Calcolo approssimato per le soluzioni dei sistemi di equazioni lineari. Ric. Sci., Ser. II, Anno IX XVI, 326–333 (1938) Google Scholar
  12. 12.
    Daubechies, I., Defrise, M., De Mol, C.: An iterative thresholding algorithm for linear inverse problems with a sparsity constraint. Commun. Pure Appl. Math. 57, 1413–1457 (2004) MATHCrossRefGoogle Scholar
  13. 13.
    Elfving, T., Nikazad, T., Hansen, P.C.: Semi-convergence and relaxation parameters for a class of SIRT algorithm. Electron. Trans. Numer. Anal. 37, 321–336 (2010) MathSciNetMATHGoogle Scholar
  14. 14.
    Engl, H.W., Hanke, M., Neubauer, A.: Regularization of Inverse Problems. Kluwer Academic, Dordrecht (1996) MATHCrossRefGoogle Scholar
  15. 15.
    Estatico, C., Pastorino, M., Randazzo, A.: A novel microwave imaging approach based on regularization in L p Banach spaces. IEEE Trans. Antennas Propag. 60, 3373–3381 (2012) MathSciNetCrossRefGoogle Scholar
  16. 16.
    Hanke, M., Nagy, J.: Inverse Toeplitz preconditioners for ill-posed problems. Linear Algebra Appl. 284, 137–156 (1998) MathSciNetMATHCrossRefGoogle Scholar
  17. 17.
    Hanke, M., Nagy, J., Vogel, C.: Quasi-Newton approach to nonnegative image restorations. Linear Algebra Appl. 316, 223–236 (2000) MathSciNetMATHCrossRefGoogle Scholar
  18. 18.
    Hansen, P.C., Nagy, J., O’Leary, D.P.: Deblurring Images: Matrices, Spectra, and Filtering. SIAM, Philadelphia (2006) MATHCrossRefGoogle Scholar
  19. 19.
    Hein, T., Kazimierski, K.S.: Accelerated Landweber iteration in Banach spaces. Inverse Probl. 26, 055002 (2010) (17 pp.) MathSciNetCrossRefGoogle Scholar
  20. 20.
    Hein, T., Kazimierski, K.S.: Modified Landweber iteration in Banach spaces—convergence and convergence rates. Numer. Funct. Anal. Optim. 31, 1158–1189 (2010) MathSciNetMATHCrossRefGoogle Scholar
  21. 21.
    Kaltenbacher, B.: Some Newton-type methods for the regularization of nonlinear ill-posed problems. Inverse Probl. 13, 729–753 (1997) MathSciNetMATHCrossRefGoogle Scholar
  22. 22.
    Kamm, J., Nagy, J.: Kronecker product and SVD approximations in image restoration. Linear Algebra Appl. 284, 177–192 (1998) MathSciNetMATHCrossRefGoogle Scholar
  23. 23.
    Landweber, L.: An iteration formula for Fredholm integral equations of the first kind. Am. J. Math. 73, 615–624 (1951) MathSciNetMATHCrossRefGoogle Scholar
  24. 24.
    Natterer, F.: The Mathematics of Computerized Tomography. John Wiley, New York (1986) MATHGoogle Scholar
  25. 25.
    Piana, M., Bertero, M.: Projected Landweber method and preconditioning. Inverse Probl. 13, 441–464 (1997) MathSciNetMATHCrossRefGoogle Scholar
  26. 26.
    Rieder, A.: On the regularization of nonlinear ill-posed problems via inexact Newton iterations. Inverse Probl. 15, 309–327 (1999) MathSciNetMATHCrossRefGoogle Scholar
  27. 27.
    Roggemann, M.C., Welsh, B.: Imaging Through Turbulence. CRC Press, Boca Raton (1996) Google Scholar
  28. 28.
    Scherzer, M.O., Grasmair, M., Grossauer, H., Haltmeier, M., Lenzen, F.: Variational Methods in Imaging. Springer, Berlin (2008) MATHGoogle Scholar
  29. 29.
    Schöpfer, F., Louis, A.K., Schuster, T.: Nonlinear iterative methods for linear ill-posed problems in Banach spaces. Inverse Probl. 22, 311–329 (2006) MATHCrossRefGoogle Scholar
  30. 30.
    Trefethen, L., Bau, D.: Numerical Linear Algebra. SIAM, Philadelphia (1997) MATHCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  • Paola Brianzi
    • 1
  • Fabio Di Benedetto
    • 1
  • Claudio Estatico
    • 1
    • 2
  1. 1.Dipartimento di MatematicaUniversità degli Studi di GenovaGenovaItaly
  2. 2.Dipartimento di Scienza ed Alta TecnologiaUniversità degli Studi dell’InsubriaComoItaly

Personalised recommendations