Joint Segmentation and Nonlinear Registration Using Fast Fourier Transform and Total Variation

  • Thomas Atta-Fosu
  • Weihong Guo
Part of the Association for Women in Mathematics Series book series (AWMS, volume 12)


Image segmentation and registration play active roles in machine vision and medical image analysis of historical data. We explore the joint problem of segmenting and registering a template (current) image given a reference (past) image. We formulate the joint problem as a minimization of a functional that integrates two well-studied approaches in segmentation and registration: geodesic active contours and nonlinear elastic registration. The template image is modeled as a hyperelastic material (St. Venant-Kirchhoff model) which undergoes deformations under applied forces. To segment the deforming template, a two-phase level set-based energy is introduced together with a weighted total variation term that depends on gradient features of the deforming template. This particular choice allows for fast solution using the dual formulation of the total variation. This allows the segmenting front to accurately track spontaneous changes in the shape of objects embedded in the template image as it deforms. To solve the underlying registration problem, we use gradient descent and adopt an implicit-explicit method and use the fast Fourier transform.


  1. 1.
    Ascher, U., Ruuth, S., Wetton, B.: Implicit-explicit methods for time-dependent partial differential equations. SIAM J. Numer. Anal. 32(3), 797–823 (1995)MathSciNetCrossRefGoogle Scholar
  2. 2.
    Aujol, J.F., Gilboa, G., Chan, T.F., Osher, S.: Structure-texture image decomposition - modeling, algorithms, and parameter selection. Int. J. Comput. Vis. 67(1), 111–136 (2006)CrossRefGoogle Scholar
  3. 3.
    Bresson, X., Esedolu, S., Vandergheynst, P., Thiran, J.P., Osher, S.: Fast global minimization of the active contour/snake model. J. Math. Imaging Vis. 28(2), 151–167 (2007)MathSciNetCrossRefGoogle Scholar
  4. 4.
    Chambolle, A.: An algorithm for total variation minimization and applications. J. Math. Imaging Vis. 20(1), 89–97 (2004)MathSciNetzbMATHGoogle Scholar
  5. 5.
    Chan, T.F., Vese, L.A.: Active contours without edges. IEEE Trans. Image Process. 10(2), 266–277 (2001)CrossRefGoogle Scholar
  6. 6.
    Chan, T.F., Golub, G.H., Mulet, P.: A nonlinear primal-dual method for total variation-based image restoration. SIAM J. Sci. Comput. 20(6), 1964–1977 (1999)MathSciNetCrossRefGoogle Scholar
  7. 7.
    Collignon, A., Maes, F., Delaere, D., Vandermeulen, D., Suetens, P., Marchal, G.: Automated multi-modality image registration based on information theory. In: Information Processing in Medical Imaging, vol. 3, pp. 263–274 (1995)Google Scholar
  8. 8.
    Csisz, I., Tusnády, G., et al.: Information geometry and alternating minimization procedures. Stat. Decis. 1, 205–237 (1984)MathSciNetGoogle Scholar
  9. 9.
    Davis, P.: Circulant Matrices. John Wiley & Sons, New York (1979)zbMATHGoogle Scholar
  10. 10.
    Haber, E., Modersitzki, J.: Intensity gradient based registration and fusion of multi-modal images. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 726–733. Springer, Berlin (2006)CrossRefGoogle Scholar
  11. 11.
    Hansen, P.C., Nagy, J.G., O’leary, D.P.: Deblurring images: matrices, spectra, and filtering. SIAM, Philadelphia, PA (2006)CrossRefGoogle Scholar
  12. 12.
    Le Guyader, C., Vese, L.A.: A combined segmentation and registration framework with a nonlinear elasticity smoother. Comput. Vis. Image Underst. 115(12), 1689–1709 (2011)CrossRefGoogle Scholar
  13. 13.
    Ozeré, S., Gout, C., Le Guyader, C.: Joint segmentation/registration model by shape alignment via weighted total variation minimization and nonlinear elasticity. SIAM J. Imaging Sci. 8(3), 1981–2020 (2015)MathSciNetCrossRefGoogle Scholar
  14. 14.
    Pluim, J., Maintz, J., Viergever, M.: Image registration by maximization of combined mutual information and gradient information. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 452–461. Springer, Berlin (2000)CrossRefGoogle Scholar
  15. 15.
    Raoult, A.: Non-polyconvexity of the stored energy function of a Saint Venant-Kirchhoff material. Aplikace Matematiky 31(6), 417–419 (1986)MathSciNetzbMATHGoogle Scholar
  16. 16.
    Viola, P., Iii, W.M.W.: Alignment by maximization of mutual information. Int. J. Comput. Vis. 24(2), 137–154 (1997)CrossRefGoogle Scholar
  17. 17.
    Yezzi, A., Zollei, L., Kapur, T.: A variational framework for joint segmentation and registration. In: Mathematical Methods in Biomedical Image Analysis, pp. 44–51. IEEE, Piscataway, NJ (2001)Google Scholar

Copyright information

© The Author(s) and the Association for Women in Mathematics 2018

Authors and Affiliations

  1. 1.Department of Mathematics, Applied Mathematics & StatisticsCase Western Reserve UniversityClevelandUSA

Personalised recommendations