Skip to main content

Segmentation as a Graph Problem

  • Chapter
  • First Online:
  • 3319 Accesses

Part of the book series: Advances in Computer Vision and Pattern Recognition ((ACVPR))

Abstract

2d and 3d images can be mapped on a graph where scene elements are nodes and neighborhood is expressed by edges connecting the nodes. Assigning weights to edges that represent local properties of a good segmentation allows finding a segmentation using optimization methods on graphs. Two such techniques that have been used for segmentation are minimum cost graph cuts and minimum cost paths. Minimum cost paths are computed using variants of Dijkstra’s algorithm. Optimal graph cuts have been computed using various different strategies (graph cuts, random walks, normalized cuts, image foresting transform). Methodology, parameterization, advantages, and problems for algorithms that are based on either of the two techniques are discussed in this chapter.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   49.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   64.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   99.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    If the boundary is not closed, at least one non-saturated edge between source and sink would exist. Flow could be increased until this edge is saturated as well.

  2. 2.

    It is possible that edges between two neighboring pixels are removed by this procedure which may make a pixel unreachable from S and T. This corresponds to segmentation boundaries that are broader than a pixel in methods such as the watershed transform. If this is undesirable, similar strategies as in WST have to be followed for assigning these pixels either to foreground or background.

References

  • Adams R, Bischof L (1994) Seeded region growing. IEEE Trans Pattern Anal Mach Intell 16(6):641–647

    Article  Google Scholar 

  • Allène C, Audibert JY, Couprie M, Cousty J, Keriven R (2007) Some links between min-cuts, optimal spanning forests and watersheds. Math Morphol Appl Image Signal Process 253–264

    Google Scholar 

  • Bagci U, Udupa JK, Yao J, Mollura DL (2012) Co-segmentation of functional and anatomical images. In: 15th international conference on medical image computing and computer assisted intervention MICCAI2012. Part III, LNCS, vol 7512, pp 459–467

    Google Scholar 

  • Baudin PY, Azzabou N, Carlier P, Paragios N (2012) Automatic skeletal muscle segmentation through random walks and graph-based seed placement. In: International symposium medical imaging ISBI, pp 1036–1039

    Google Scholar 

  • Beucher S, Meyer F (1992) The morphological approach to segmentation: the watershed transformation. Opt Eng 433–481

    Google Scholar 

  • Boykov Y, Jolly MP (2001) Interactive graph cuts for optimal boundary and region segmentation of objects in n-d images. In: 8th international conference on computer vision (ICCV’01), vol 1, pp 105–112

    Google Scholar 

  • Boykov Y, Kolmogorov V (2004) An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Trans Pattern Anal Mach Intell 26(9):1124–1137

    Article  MATH  Google Scholar 

  • Boykov Y, Veksler O, Zabih R (2001) Fast approximate energy minimization via graph cuts. IEEE Trans Pattern Anal Mach Intell 23(11):1222–1239

    Article  Google Scholar 

  • Camilus LS, Govindam VK (2012) A review on graph based segmentation. Int J Image Graph Signal Process 5:1–13

    Article  Google Scholar 

  • Chen Y, Wang Z, Hu J, Zhao W, Wu Q (2012) The domain knowledge based graph-cut model for liver CT segmentation. Biomed Image Process Control 7:591–598

    Article  Google Scholar 

  • Ciesielski KC, Udupa JK, Falcao AX, Miranda PAV (2012) Fuzzy connectedness image segmentation in graph cut formulation: a linear-time algorithm and a comparative analysis. J Math Imaging Vis 44:375–398

    Article  MathSciNet  MATH  Google Scholar 

  • Ciesielski KC, Miranda PAV, Falcao AX, Udupa JK (2013) Joint graph cut and relative fuzzy connectedness image segmentation algorithm. Med Image Anal 17:1046–1057

    Article  MATH  Google Scholar 

  • Couprie C, Grady L, Najman L, Talbot H (2009) Power watersheds: a new image segmentation framework extending graph cuts, random walker and optimal spanning forest. IEEE Int Conf Comput Vis ICCV 2009:731–738

    Google Scholar 

  • Danesh H, Kafieh R, Rabbani H, Hajizadeh F (2014) Segmentation of choroidal boundary in enhanced depth imaging OCTs using a multiresolution texture based modeling in graph cuts. Comput Math Models Med 2014:8

    Google Scholar 

  • Duchenne O, Audibert JY, Keriven R, Ponce J, Segonne F (2008) Segmentation by transduction. In: IEEE conference on computer vision and pattern recognition CVPR2008, pp 1–8

    Google Scholar 

  • Falcao AX, Stolfi J, de Alencar Lotufo R (2004) The image foresting transform: theory, algorithms, and applications. IEEE Trans Pattern Anal Mach Intell 26(1):19–29

    Article  Google Scholar 

  • Funka-Lea G, Boykov Y, Florin C, Jolly MP, Moreau-Gobard R, Ramaraj R, Rinck D (2006) Automatic heart isolation for CT coronary visualization using graph-cuts. In: 3rd IEEE international symposium on biomedical imaging: nano to macro, pp 614–617

    Google Scholar 

  • Gamio JC, Belongie S, Majumdar S (2004) Normalized cuts in 3d for spinal MRI segmentation. IEEE Trans Med Imaging 23(1):36–44

    Article  Google Scholar 

  • Grady L, Funka-Lea G (2004) Multi-label image segmentation for medical applications based on graph-theoretic electrical potentials. In: Computer vision and mathematical methods in medical and biomedical image analysis. LNCS, vol 3117, pp 230–245

    Google Scholar 

  • Grady L (2006) Random walks for image segmentation. IEEE Trans Pattern Anal Mach Intell 28(11):1768–1783

    Article  Google Scholar 

  • Grady L, Schiwietz T, Aharon S, Westermann R (2005) Random walks for interactive organ segmentation in two and three dimensions: implementation and validation. In: Medical image computing and computer-assisted intervention—MICCAI 2005. LNCS, vol 3750, pp 773–780

    Google Scholar 

  • Géraud T, Mangin JF, Bloch I, Maître H (1995) Segmenting internal structures in 3d MR images of the brain by Markovian relaxation on a watershed based adjacency graph. In: IEEE international conference on image processing ICIP 1995, pp 548–551

    Google Scholar 

  • Häggström M (2014) Medical gallery of Mikael Häggström 2014. Wikiversity J Med 1(2). doi:10.15347/wjm/2014.008

  • Hamamci A, Kucuk N, Karaman K, Engin K, Unal G (2012) Tumor-cut: segmentation of brain tumors on contrast enhanced MR images for radiosurgery applications. IEEE Trans Med Imaging 31(3):790–804

    Article  Google Scholar 

  • Han D, Bayouth J, Song Q, Taurani A, Sonka M, Buatti J, Wu X (2011) Globally optimal tumor segmentation in PET-CT images: a graph-based co-segmentation method. In: 22nd international conference information processing in medical imaging IPMI 2011. LNCS, vol 6801, pp 245–256

    Google Scholar 

  • Herman GT, Carvalho BM (2001) Multiseeded segmentation using fuzzy connectedness. IEEE Trans Pattern Anal Mach Intell 23(5):460–474

    Article  Google Scholar 

  • Huang SH, Chu YH, Lai SH, Novak CL (2009) Learning-based vertebra detection and iterative normalized-cut segmentation for spinal MRI. IEEE Trans Med Imaging 28(10):1595–1605

    Article  Google Scholar 

  • Kauffmann C, Piché N (2010) Seeded ND medical image segmentation by cellular automaton on GPU. Int J Comput Assist Radiol Surg 5:251–262

    Article  Google Scholar 

  • Kéchichian R, Valette S, Desvignes M, Prost R (2013) Shortest-path constraints for 3d multiobject semiautomatic segmentation via clustering and graph cut. IEEE Trans Image Process 22(11):4224–4236

    Article  MathSciNet  Google Scholar 

  • Kolmogorov V, Zabih R (2004) What energy functions can be minimized via graph cuts? IEEE Trans Pattern Anal Mach Intell 26(2):147–159

    Article  MATH  Google Scholar 

  • Lucchi A, Smith K, Achanta R, Knott G, Fua P (2012) Supervoxel-based segmentation of mitochondria in EM image stacks with learned shape features. IEEE Trans Med Imaging 31(2):474–486

    Article  Google Scholar 

  • Mahapatra D, Schüffler PJ, Tielbeek JAW, Vos FM, Buhmann JM (2013) Crohn‘s disease tissue segmentation from abdominal MRI using semantic information and graph cuts. In: IEEE 10th international symposium biomedical imaging: from nano to macro, pp 358–361

    Google Scholar 

  • Ng A, Jordan M, Weiss Y (2002) On spectral clustering: analysis and an algorithm. In: Proceedings 14th annual conference advances in neural information processing systems, pp 849–856

    Google Scholar 

  • Peng B, Zhang L, Zhang D (2013) A survey of graph theoretical approaches to image segmentation. Pattern Recognit 46:1020–1038

    Article  Google Scholar 

  • Radhakrishna A, Shaji A, Smith K, Lucchi A, Fua P (2010) Susstrunk S (2010). SLIC superpixels, EPFL Techn Rep

    Google Scholar 

  • Rak M, König T, Toennies KD (2013) An adaptive subdivision scheme for quadratic programming in multi-label image segmentation. In: British machine vision conference BMVC 2013

    Google Scholar 

  • Rother C, Kolmogorov V, Blake A (2004) Grabcut: interactive foreground extraction using iterated graph cuts. ACM Trans Graph (TOG) 23(3):309–314

    Article  Google Scholar 

  • Ryba T, Jirik M, Zelezny M (2013) An automatic liver segmentation algorithm based on grow cut and level sets. Pattern Recognit Image Anal 23(4):502–507

    Article  Google Scholar 

  • Salah MB, Mitiche A, Ayed IB (2011) Multiregion image segmentation by parametric kernel graph cuts. IEEE Trans Image Process 20(2):545–557

    Article  MathSciNet  Google Scholar 

  • Shi J, Malik J (2000) Normalized cuts and image segmentation. IEEE Trans Pattern Anal Mach Intell 22(8):888–905

    Article  Google Scholar 

  • Sinop AK, Leo Grady (2007) A seeded image segmentation framework unifying graph cuts and random walker which yields a new algorithm. In: IEEE 11th international conference on computer vision. ICCV 2007, pp 1–8

    Google Scholar 

  • Steffen J, Rak M, König T, Toennies KD (2016) Information efficient automatic object detection and segmentation using cosegmentation, similarity based clustering and graph label transfer. In: 5th international conference pattern recognition, applications and methods, ICPRAM, pp 397–406

    Google Scholar 

  • Tolliver DA, Miller GL (2006) Graph partitioning by spectral rounding: applications in image segmentation and clustering. In: IEEE computer society conference on computer vision and pattern recognition, vol 1, pp 1053–1060

    Google Scholar 

  • Udupa JK, Samarasekera S (1996) Fuzzy connectedness and object definition: theory, algorithms, and applications in image segmentation. Graph Models Image Process 58(3):246–261

    Article  Google Scholar 

  • Udupa JK, Saha PK (2003) Fuzzy connectedness and image segmentation. Proc IEEE 91(10):1649–1669

    Google Scholar 

  • van der Lijn F, den Heijer T, Breteler MMB, Niessen WJ (2008) Hippocampus segmentation in MR images using atlas registration, voxel classification and graph cuts. Neuroimage 43:708–720

    Article  Google Scholar 

  • Veksler O (2008) Star shape prior for graph-cut image segmentation. In: Computer vision—ECCV 2008. LNCS, vol 5304, pp 454–467

    Google Scholar 

  • Vezhnevets V, Konouchine V (2005) GrowCut: interactive multi-label ND image segmentation by cellular automata. Proc Graphicon 1:150–156

    Google Scholar 

  • Vicente S, Kolmogorov V, Rother C (2008) Graph cut based image segmentation with connectivity priors. In: IEEE conference on computer vision and pattern recognition, CVPR 2008, pp 1–8

    Google Scholar 

  • Vicente S, Rother C, Kolmogorov V (2011) Object cosegmentation. In: IEEE conference on computer vision and pattern recognition (CVPR), pp 2217–2224

    Google Scholar 

  • Wighton P, Sadeghi M, Lee TK, Atkins S (2009) A fully automatic random walker segmentation for skin lesions in a supervised setting. In: 12th international conference medical image computing and computer assisted intervention MICCAI 2009. Part II, LNCS, vol 5762, pp 1108–1115

    Google Scholar 

  • Wu Z, Leahy R (1993) An optimal graph theoretic approach to data clustering: theory and its application to image segmentation. IEEE Trans Pattern Recognit Mach Anal 15(11):1101–1113

    Article  Google Scholar 

  • Zheng Y, Stambolian D, O’Brien J, Gee JC (2013). Optic disk and cup segmentation from color fundus photograph using graph cut with priors. In: 16th international conference on medical image computing and computer assisted intervention MICCAI2013. LNCS, vol 8150, pp 75–82

    Google Scholar 

  • Zhu L, Kolesov I, Gao Y, Kikinis R, Tannenbaum A (2014) An effective interactive medical image segmentation method using fast growcut. In: MICCAI workshop on interactive medical image computing

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Klaus D. Toennies .

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer-Verlag London Ltd.

About this chapter

Cite this chapter

Toennies, K.D. (2017). Segmentation as a Graph Problem. In: Guide to Medical Image Analysis. Advances in Computer Vision and Pattern Recognition. Springer, London. https://doi.org/10.1007/978-1-4471-7320-5_8

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-7320-5_8

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-4471-7318-2

  • Online ISBN: 978-1-4471-7320-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics