Hierarchical Label Fusion with Multiscale Feature Representation and Label-Specific Patch Partition

  • Guorong Wu
  • Dinggang Shen
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8673)


Recently, patch-based label fusion methods have achieved many successes in medical imaging area. After registering atlas images to the target image, the label at each target image point can be subsequently determined by checking the patchwise similarities between the underlying target image patch and all atlas image patches. Apparently, the definition of patchwise similarity is critical in label fusion. However, current methods often simply use entire image patch with fixed patch size throughout the entire label fusion procedure, which could be insufficient to distinguish complex shape/appearance patterns of anatomical structures in medical imaging scenario. In this paper, we address the above limitations at three folds. First, we assign each image patch with multiscale feature representations such that both local and semi-local image information can be encoded to increase robustness of measuring patchwise similarity in label fusion. Second, since multiple variable neighboring structures could present in one image patch, simply computing patchwise similarity based on the entire image patch is not specific to the particular structure of interest under labeling and can be easily misled by the surrounding variable structures in the same image patch. Thus, we partition each atlas patch into a set of new label-specific atlas patches according to the existing label information in the atlas images. Then, the new label-specific atlas patches can be more specific and flexible for label fusion than using the entire image patch, since the complex image patch has now been semantically divided into several distinct patterns. Finally, in order to correct the possible mis-labeling, we hierarchically improve the label fusion result in a coarse-to-fine manner by iteratively repeating the label fusion procedure with the gradually-reduced patch size. More accurate label fusion results have been achieved by our hierarchical label fusion method with multiscale feature presentations upon label-specific atlas patches.


Patch Size Target Image Image Patch Sparsity Constraint Patch Center 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Coupe, P., Manjoh, J., Fonov, V., Pruessner, J., Robles, M., Collins, L.: Patch-based segmentation using expert priors: Application to hippocampus and ventricle segmentation. NeuroImage 54(2), 940–954 (2011)CrossRefGoogle Scholar
  2. 2.
    Rousseau, F., Habas, P.A., Studholme, C.: A Supervised Patch-Based Approach for Human Brain Labeling. IEEE Trans. Medical Imaging 30(10), 1852–1862 (2011)CrossRefGoogle Scholar
  3. 3.
    Tong, T., Wolz, R., Coupe, P., Hajnal, J., Ruecket, D.: Segmentation of MR images via discriminative dictionary learning and sparse coding: application to hippocampus labeling. NeuroImage 76, 11–23 (2013)CrossRefGoogle Scholar
  4. 4.
    Li, L., Su, H., Xing, E., Li, F.: Object Bank: A High-Level Image Representation for Scene Classification and Semantic Feature Sparsification. In: Proceedings of the Neural Information Processing System (NIPS) (2010)Google Scholar
  5. 5.
    Tong, T., et al.: Segmentation of Brain Images via Sparse Patch Representaion. In: MICCAI Workshop on Sparsity Techniques in Medical Imaging, Nice, France (2012)Google Scholar
  6. 6.
    Zhang, D., Guo, Q., Wu, G., Shen, D.: Sparse patch-based label fusion for multi-atlas segmentation. In: Yap, P.-T., Liu, T., Shen, D., Westin, C.-F., Shen, L. (eds.) MBIA 2012. LNCS, vol. 7509, pp. 94–102. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  7. 7.
    Vercauteren, T., Pennec, X., Perchant, A., Ayache, N.: Diffeomorphic demons: efficient non-parametric image registration. NeuroImage 45(suppl. 1), S61–S72 (2009)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Guorong Wu
    • 1
  • Dinggang Shen
    • 1
  1. 1.BRIC and Department of RadiologyUniversity of North Carolina at Chapel HillUSA

Personalised recommendations