The Role of Optimum Connectivity in Image Segmentation: Can the Algorithm Learn Object Information During the Process?

  • Alexandre FalcãoEmail author
  • Jordão BragantiniEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11414)


Image segmentation is one of the most investigated research topics in Computer Vision and yet presents challenges due to the difficulty of modeling all possible appearances of objects in images. In this sense, it is important to investigate methods that can learn object information before and during delineation. This paper addresses the problem by exploiting optimum connectivity between image elements (pixels and superpixels) in the image domain and feature space to improve segmentation. The study uses the Image Foresting Transform (IFT) framework to explain and implement all methods and describes some recent advances related to superpixel and object delineation. It provides a guideline to learn prior object information from the target image only based on seed pixels, superpixel clustering, and classification, evaluates the impact of using object information in several connectivity-based delineation methods using the segmentation by a deep neural network as baseline, and shows the potential of a new paradigm, namely Dynamic Trees, to learn object information from the target image only during delineation.


Superpixel and object segmentation Seed-based delineation algorithms Image Foresting Transform 


  1. 1.
    Achanta, R., et al.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2012)CrossRefGoogle Scholar
  2. 2.
    Amorim, W.P., Falcão, A.X., Papa, J.P., Carvalho, M.H.: Improving semi-supervised learning through optimum connectivity. Pattern Recogn. 60, 72–85 (2016)CrossRefGoogle Scholar
  3. 3.
    Amorim, W.P., Falcão, A.X., Papa, J.P.: Multi-label semi-supervised classification through optimum-path forest. Inf. Sci. 465, 86–104 (2018)MathSciNetCrossRefGoogle Scholar
  4. 4.
    Andrade, F., Carrera, E.V.: Supervised evaluation of seed-based interactive image segmentation algorithms. In: Symposium on Signal Processing, Images and Computer Vision, pp. 1–7 (2015)Google Scholar
  5. 5.
    Barreto, A.E., Chowdhury, A.S., Falcao, A.X., Miranda, P.A.V.: IFT-SLIC: a general framework for superpixel generation based on simple linear iterative clustering and image foresting transform. In: Conference on Graphics, Patterns and Images (SIBGRAPI), pp. 337–344 (2015)Google Scholar
  6. 6.
    Belém, F., Guimarães, S., Falcão, A.X.: Superpixel segmentation by object-based iterative spanning forest. In: 23rd Iberoamerican Congress on Pattern Recognition (2018, to appear)Google Scholar
  7. 7.
    Boykov, Y., Kolmogorov, V.: An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Trans. Pattern Anal. Mach. Intell. 26(9), 1124–1137 (2004)CrossRefGoogle Scholar
  8. 8.
    Bragantini, J., Martins, S.B., Castelo-Fernandez, C., Falcão, A.X.: Graph-based image segmentation using dynamic trees. In: 23rd Iberoamerican Congress on Pattern Recognition (2018, to appear)Google Scholar
  9. 9.
    Chen, J., Li, Z., Huang, B.: Linear spectral clustering superpixel. IEEE Trans. Image Process. 26(7), 3317–3330 (2017)MathSciNetCrossRefGoogle Scholar
  10. 10.
    Chen, L.C., Papandreou, G., Kokkinos, I., Murphy, K., Yuille, A.L.: DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans. Pattern Anal. Mach. Intell. 40(4), 834–848 (2018)CrossRefGoogle Scholar
  11. 11.
    Ciesielski, K.C., et al.: Joint graph cut and relative fuzzy connectedness image segmentation algorithm. Med. Image Anal. 17(8), 1046–1057 (2013)CrossRefGoogle Scholar
  12. 12.
    Ciesielski, K.C., et al.: Path-value functions for which Dijkstra’s algorithm returns optimal mapping. J. Math. Imaging Vis. 60(7), 1–12 (2018)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Ciesielski, K., Udupa, J., Falcão, A., Miranda, P.: Fuzzy connectedness image segmentation in graph cut formulation: a linear-time algorithm and a comparative analysis. J. Math. Imaging Vis. 44(3), 375–398 (2012)MathSciNetCrossRefGoogle Scholar
  14. 14.
    Condori, M.A.T., Cappabianco, F.A.M., Falcão, A.X., Miranda, P.A.V.: Extending the differential image foresting transform to root-based path-cost functions with application to superpixel segmentation. In: Conference on Graphics, Patterns and Images (SIBGRAPI), pp. 7–14 (2017)Google Scholar
  15. 15.
    Couprie, C., Grady, L., Najman, L., Talbot, H.: Power watershed: a unifying graph-based optimization framework. IEEE Trans. Pattern Anal. Mach. Intell. 33(7), 1384–1399 (2011)CrossRefGoogle Scholar
  16. 16.
    Cousty, J., Bertrand, G., Najman, L., Couprie, M.: Watershed cuts: minimum spanning forests and the drop of water principle. IEEE Trans. Pattern Anal. Mach. Intell. 31(8), 1362–1374 (2009)CrossRefGoogle Scholar
  17. 17.
    Falcão, A.X., Bergo, F.P.G.: Interactive volume segmentation with differential image foresting transforms. IEEE Trans. Med. Imaging 23(9), 1100–1108 (2004)CrossRefGoogle Scholar
  18. 18.
    Falcão, A.X., Spina, T.V., Martins, S.B., Phellan, R.: Medical image segmentation using object shape models. In: Invited Lecture in Proceedings of the ECCOMAS Thematic (VipIMAGE), pp. 9–15. CRC Press (2015)Google Scholar
  19. 19.
    Falcão, A.X., Stolfi, J., de Lotufo, R.A.: The image foresting transform: theory, algorithms, and applications. IEEE Trans. Pattern Anal. Mach. Intell. 26(1), 19–29 (2004)CrossRefGoogle Scholar
  20. 20.
    Falcão, A.X., Udupa, J.K., Samarasekera, S., Sharma, S., Hirsch, B.E., Lotufo, R.A.: User-steered image segmentation paradigms: live wire and live lane. Graph. Models Image Process. 60(4), 233–260 (1998)CrossRefGoogle Scholar
  21. 21.
    Galvão, F.L., Falcão, A.X., Chowdhury, A.S.: RISF: recursive iterative spanning forest for superpixel segmentation. In: Conference on Graphics, Patterns and Images (SIBGRAPI). IEEE Xplore (2018, to appear)Google Scholar
  22. 22.
    Gulshan, V., et al.: Geodesic star convexity for interactive image segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 3129–3136 (2010)Google Scholar
  23. 23.
    Leon, L.M.C., Miranda, P.A.V.: Multi-object segmentation by hierarchical layered oriented image foresting transform. In: Conference on Graphics, Patterns and Images (SIBGRAPI), pp. 79–86 (2017)Google Scholar
  24. 24.
    Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)Google Scholar
  25. 25.
    Maninis, K.K., et al.: Deep extreme cut: from extreme points to object segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition (2018)Google Scholar
  26. 26.
    Martins, S.B., Spina, T.V., Yasuda, C., Falcão, A.X.: A multi-object statistical atlas adaptive for deformable registration errors in anomalous medical image segmentation. In: SPIE on Medical Imaging: Image Processing, p. 101332G(2017)Google Scholar
  27. 27.
    Miranda, P.A.V., Falcão, A.X., Spina, T.V.: Riverbed: a novel user-steered image segmentation method based on optimum boundary tracking. IEEE Trans. Image Process. 21(6), 3042–3052 (2012)MathSciNetCrossRefGoogle Scholar
  28. 28.
    Miranda, P.A.V., Mansilla, L.A.C.: Oriented image foresting transform segmentation by seed competition. IEEE Trans. Image Process. 23(1), 389–398 (2014)MathSciNetCrossRefGoogle Scholar
  29. 29.
    Miranda, P.A., Falcão, A.X.: Links between image segmentation based on optimum-path forest and minimum cut in graph. J. Math. Imaging Vis. 35(2), 128–142 (2009)MathSciNetCrossRefGoogle Scholar
  30. 30.
    Papa, J., Falcão, A., de Albuquerque, V., Tavares, J.: Efficient supervised optimum-path forest classification for large datasets. Pattern Recogn. 45(1), 512–520 (2012)CrossRefGoogle Scholar
  31. 31.
    Phellan, R., Falcão, A.X., Udupa, J.K.: Medical image segmentation via atlases and fuzzy object models: improving efficacy through optimum object search and fewer models. Med. Phys. 43(1), 401–410 (2016)CrossRefGoogle Scholar
  32. 32.
    Rauber, P.E., Falcão, A.X., Spina, T.V., Rezende, P.J.: Interactive segmentation by image foresting transform on superpixel graphs. In: Conference on Graphics, Patterns and Images (SIBGRAPI), pp. 131–138 (2013)Google Scholar
  33. 33.
    Rocha, L., Cappabianco, F., Falcão, A.: Data clustering as an optimum-path forest problem with applications in image analysis. Int. J. Imaging Syst. Technol. 19(2), 50–68 (2009)CrossRefGoogle Scholar
  34. 34.
    Rother, C., Kolmogorov, V., Blake, A.: GrabCut: interactive foreground extraction using iterated graph cuts. ACM Trans. Graph. 23, 309–314 (2004)CrossRefGoogle Scholar
  35. 35.
    Spina, T.V., Miranda, P.A.V., Falcão, A.X.: Intelligent understanding of user interaction in image segmentation. Int. J. Pattern Recogn. Artif. Intell. 26(02), 1265001 (2012)MathSciNetCrossRefGoogle Scholar
  36. 36.
    Spina, T.V., Miranda, P.A.V., Falcão, A.: Hybrid approaches for interactive image segmentation using the live markers paradigm. IEEE Trans. Image Process. 23(12), 5756–5769 (2014)MathSciNetCrossRefGoogle Scholar
  37. 37.
    Spina, T.V., Stegmaier, J., Falcão, A.X., Meyerowitz, E., Cunha, A.: SEGMENT3D: a web-based application for collaborative segmentation of 3D images used in the shoot apical meristem. In: International Symposium on Biomedical Imaging (ISBI), pp. 391–395 (2018)Google Scholar
  38. 38.
    Tavares, A.C.M., Miranda, P.A.V., Spina, T.V., Falcão, A.X.: A supervoxel-based solution to resume segmentation for interactive correction by differential image-foresting transforms. In: Angulo, J., Velasco-Forero, S., Meyer, F. (eds.) ISMM 2017. LNCS, vol. 10225, pp. 107–118. Springer, Cham (2017). Scholar
  39. 39.
    Udupa, J.K., et al.: Body-wide hierarchical fuzzy modeling, recognition, and delineation of anatomy in medical images. Med. Image Anal. 18(5), 752–771 (2014)CrossRefGoogle Scholar
  40. 40.
    Vargas-Muñoz, J.E., et al.: An iterative spanning forest framework for superpixel segmentation. IEEE Trans. Image Process. (2019, to appear)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.University of CampinasCampinasBrazil

Personalised recommendations