, 55:17 | Cite as

Irregularization accelerates iterative regularization

  • Paola Brianzi
  • Fabio Di Benedetto
  • Claudio Estatico
  • Luca Surace


When iterative methods are employed as regularizers of inverse problems, a main issue is the trade-off between smoothing effects and computation time, related to the convergence rate of iterations. Very often, faster methods obtain less accuracy. A new acceleration strategy is presented here, inspired by a choice of penalty terms formerly proposed in 2012 by Huckle and Sedlacek in the context of Tikhonov regularization by direct solvers. More precisely, we consider a special penalty term endowed with high regularization capabilities, and we apply it by using the opposite sign, that is negative, to its regularization parameter. This unprecedented choice leads to an “irregularization” phenomenon, which speeds up the underlying basic iterative method. The speeding up effects of the negative valued penalty term can be controlled through a sequence of decreasing coefficients as the iterations proceed in order to prevent noise amplification, tuning the weight of the correction term which generates the anti-regularization behavior. Filter factor expansion and convergence are analyzed in the simplified context of linear inverse problems in Hilbert spaces, by considering modified Landweber iterations as a first case study.


Inverse problems Regularization Modified Landweber Convergence analysis Filter factor 

Mathematics Subject Classification

65F22 65F10 45Q05 


  1. 1.
    Bertero, M., Boccacci, P.: Introduction to Inverse Problems in Imaging. Institute of Physics Publ, Bristol (1998)CrossRefzbMATHGoogle Scholar
  2. 2.
    Beckner, W.: Inequalities in Fourier analysis. Ann. Math. 102, 159–182 (1975)MathSciNetCrossRefzbMATHGoogle Scholar
  3. 3.
    Brianzi, P., Di Benedetto, F., Estatico, C.: Improvement of space-invariant image deblurring by preconditioned Landweber iterations. SIAM J. Sci. Comp. 30, 1430–1458 (2008)MathSciNetCrossRefzbMATHGoogle Scholar
  4. 4.
    Brianzi, P., Di Benedetto, F., Estatico, C.: Preconditioned iterative regularization in Banach spaces. Comput. Optim. Appl. 54, 263–282 (2013)MathSciNetCrossRefzbMATHGoogle Scholar
  5. 5.
    Caponigro, M., Fornasier, M., Piccoli, B., Trélat, E.: Sparse stabilization and control of the Cucker-Smale model. Math. Contr. Rel. Fields AIMS 3, 447–466 (2013)MathSciNetCrossRefzbMATHGoogle Scholar
  6. 6.
    Chidume, C.: Geometric Properties of Banach Spaces and Nonlinear Iterations. Lecture Notes in Mathematics. Springer, Berlin (2009)zbMATHGoogle Scholar
  7. 7.
    Donatelli, M., Hanke, M.: Fast nonstationary preconditioned iterative methods for ill-posed problems, with application to image deblurring. Inverse Probl. 29, 095008 (2013). (16 pp.)MathSciNetCrossRefzbMATHGoogle Scholar
  8. 8.
    Eidelman, Y., Milman, V., Tsolomitis, A.: Functional Analysis: An Introduction. American Mathematical Society, Providence (2004)CrossRefzbMATHGoogle Scholar
  9. 9.
    Estatico, C.: A class of filtering superoptimal preconditioners for highly ill-conditioned linear systems. BIT Numer. Math. 42, 753–778 (2002)MathSciNetCrossRefzbMATHGoogle Scholar
  10. 10.
    Estatico, C., Gratton, S., Lenti, F., Titley-Peloquin, D.: A conjugate gradient like method for p-norm minimization in functional spaces. Numer. Math. 137, 895–922 (2017)MathSciNetCrossRefzbMATHGoogle Scholar
  11. 11.
    Groetsch, C.W.: Generalized Inverses of Linear Operators. Marcel Dekker Inc., New York (1977)zbMATHGoogle Scholar
  12. 12.
    Hanke, M., Nagy, J.G., Plemmons, R.J.: Preconditioned iterative regularization for ill-posed problems. In: Reichel, L., Ruttan, A., Varga, R.S. (eds.) Numerical Linear Algebra and Scientific Computing, pp. 141–163. Walter de Gruyter Press (1993)Google Scholar
  13. 13.
    Hansen, P.C., Nagy, J.G., O’Leary, D.P.: Deblurring Images: Matrices, Spectra, and Filtering. SIAM, Philadelphia (2006)CrossRefzbMATHGoogle Scholar
  14. 14.
    Huckle, T., Sedlacek, M.: Tykhonov-Phillips regularization with operator dependent seminorms. Numer. Alg. 60, 339–353 (2012)CrossRefzbMATHGoogle Scholar
  15. 15.
    Landweber, L.: An iteration formula for Fredholm integral equations of the first kind. Am. J. Math. 73, 615–624 (1951)MathSciNetCrossRefzbMATHGoogle Scholar
  16. 16.
    Lenti, F., Nunziata, F., Estatico, C., Migliaccio, M.: Spatial resolution enhancement of earth observation products using an acceleration technique for iterative methods. IEEE Geosci. Remote Sens. Lett. 12, 269–273 (2015)CrossRefGoogle Scholar
  17. 17.
    Liggins II, M., Hall, D., Llinas, J.: Handbook of Multisensor Data Fusion: Theory and Practice. CRC Press, Boca Raton (2008)CrossRefGoogle Scholar
  18. 18.
    Long, D.G.: Reconstruction and resolution enhancement techniques for microwave sensors. In: Chen, C.H. (ed.) Frontiers of Remote Sensing Information Processing. World Scientific, Sinapore (2003). ch. 11Google Scholar
  19. 19.
    Morikuni, K., Reichel, L., Hayami, K.: FGMRES for linear discrete ill-posed problems. Appl. Numer. Math. 75, 175–187 (2013)MathSciNetCrossRefzbMATHGoogle Scholar
  20. 20.
    Pastorino, M.: Microwave Imaging. John Wiley, Hoboken (2010)CrossRefGoogle Scholar
  21. 21.
    Roggemann, M.C., Welsh, B.: Imaging Through Turbulence. CRC Press, Boca Raton (1996)Google Scholar
  22. 22.
    Saad, Y.: A flexible inner-outer preconditioned GMRES algorithm. SIAM J. Sci. Comput. 14, 461–469 (1993)MathSciNetCrossRefzbMATHGoogle Scholar
  23. 23.
    Scherzer, O.: A modified Landweber iteration for solving parameter estimation problems. Appl. Math. Optim. 38, 45–68 (1998)MathSciNetCrossRefzbMATHGoogle Scholar
  24. 24.
    Scherzer, O., Grasmair, M., Grossauer, H., Haltmeier, M., Lenzen, F.: Variational Methods in Imaging. Springer, Berlin (2009)zbMATHGoogle Scholar
  25. 25.
    Schuster, T., Kaltenbacher, B., Hofmann, B., Kazimierski, K.S.: Regularization Methods in Banach Spaces. Radon Series on Computational and Applied Mathematics, vol. 10. De Gruyter, Berlin (2012)CrossRefzbMATHGoogle Scholar
  26. 26.
    Taylor, A.E., Lay, D.C.: Introduction to Functional Analysis. Krieger Publishing Company, Malabar (1980)zbMATHGoogle Scholar
  27. 27.
    Vesely, L., Zajíček, L.: Delta-convex mappings between Banach spaces and applications, Dissertationes, Math., 289 (1989), Warszawa, Poland (52 pp.)Google Scholar
  28. 28.
    Zhao, D.: Multiscale Seismic Tomography. Geophysics. Springer, Berlin (2015)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Italia S.r.l., part of Springer Nature 2018

Authors and Affiliations

  1. 1.Dipartimento di MatematicaGenovaItaly
  2. 2.IPSEOA Marco PoloGenovaItaly

Personalised recommendations