Abstract
Purpose
Automated anatomical labeling facilitates the diagnostic process for physicians and radiologists. One of the challenges in automated anatomical labeling problems is the robustness to handle the large individual variability inherited in human anatomy. A novel deep neural network framework, referred to Tree Labeling Network (TreeLab-Net), is proposed to resolve this problem in this work.
Methods
A multi-layer perceptron (MLP) encoder network and a bidirectional tree-structural long short-term memory (Bi-TreeLSTM) are combined to construct the TreeLab-Net. Vessel spatial locations and directions are selected as features, where a spherical coordinate transform is utilized to normalize vessel spatial variations. The dataset includes 436 coronary computed tomography angiography images. Tenfold cross-validation is performed for evaluation.
Results
The precision–recall curve of TreeLab-Net shows that the four main branch classes, LM, LAD, LCX and RCA, have the area under the curve (AUC) higher than 97%. Other major side branch classes, D, OM, and R-PLB, also have AUC higher than 90%. Comparing with four other methods (i.e., AdaBoost, MLP, Up-to-Down and Down-to-Up TreeLSTM), the TreeLab-Net achieves higher F1 scores with less topological errors.
Conclusion
The TreeLab-Net is able to capture the characteristics of tree structures by learning the spatial and topological dependencies of blood vessels effectively. The results demonstrate that TreeLab-Net is able to yield competitive performances on a large dataset with great variance among subjects.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
Please note that some values are extracted from the figures or interpreted from the numbers reported in the paper for direct comparison.
TreeLab-Net is a general encoding–forecasting structure so that other deep neural networks can also be adopted as a building block for more complex structures; for example, CNN can be used as the encoder for more complex image input.
References
Akinyemi A, Murphy S, Poole I, Roberts C (2009) Automatic labelling of coronary arteries. In: 2009 17th European signal processing conference, pp 1562–1566
Cao Q, Broersen A, de Graaf MA, Kitslaar PH, Yang G, Scholte AJ, Lelieveldt B, Reiber J, Dijkstra J (2017) Automatic identification of coronary tree anatomy in coronary computed tomography angiography. Int J Cardiovasc Imaging 33:1809–1819. https://doi.org/10.1007/s10554-017-1169-0
Yang G, Broersen A, Petr R, Kitslaar PH, de Graaf MA, Bax JJ, Reiber J, Dijkstra J (2011) Automatic coronary artery tree labeling in coronary computed tomographic angiography datasets. In: 2011 Computing in cardiology, pp 109–112
Gülsün MA, Funka-Lea G, Zheng Y, Eckert M (2014) CTA coronary labeling through efficient geodesics between trees using anatomy priors. Med Image Comput Comput Assist Interv 17:521–528
Bilgel M, Roy S, Carass A, Nyquist PA, Prince JL (2013) Automated anatomical labeling of the cerebral arteries using belief propagation. Proc SPIE Int Soc Opt Eng. https://doi.org/10.1117/12.2006460
Bogunovic H, Pozo JM, Cárdenes R, San Román L, Frangi AF (2013) Anatomical labeling of the Circle of Willis using maximum a posteriori probability estimation. IEEE Trans Med Imaging 32:1587–1599. https://doi.org/10.1109/TMI.2013.2259595
Robben D, Türetken E, Sunaert S, Thijs V, Wilms G, Fua G, Maes F, Suetens P (2016) Simultaneous segmentation and anatomical labeling of the cerebral vasculature. Med Image Anal 32:201–215. https://doi.org/10.1016/j.media.2016.03.006
Hoang BH, Oda M, Jiang Z, Kitasaka T, Misawa K, Fujiwara M, Mori K (2011) A study on automated anatomical labeling to arteries concerning with colon from 3D abdominal CT images. In: Medical imaging 2011: image processing. International Society for Optics and Photonics, p 79623R
Kitasaka T, Kagajo M, Nimura Y, Hayashi Y, Oda M, Misawa K, Mori K (2017) Automatic anatomical labeling of arteries and veins using conditional random fields. Int J Comput Assist Radiol Surg 12:1041–1048. https://doi.org/10.1007/s11548-017-1549-x
Matsuzaki T, Oda M, Kitasaka T, Hayashi Y, Misawa K, Mori K (2014) Automated anatomical labeling of abdominal arteries and hepatic portal system extracted from abdominal CT volumes. Med Image Anal. https://doi.org/10.1016/j.media.2014.11.002
Zhang W, Liu J, Yao J, Summers RM (2013) Automatic anatomical labeling of abdominal arteries for small bowel evaluation on 3D CT scans. In: 2013 IEEE 10th international symposium on biomedical imaging, pp 210–213
Gu S, Wang Z, Siegfried JM, Wilson D, Bigbee WL, Pu J (2012) Automated lobe-based airway labeling. Int J Biomed Imaging. https://doi.org/10.1155/2012/382806
Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9:1735–1780
Tai KS, Socher R, Manning CD (2015) Improved semantic representations from tree-structured long short-term memory networks. arXiv:1503.00075 Cs
Graves A, Jaitly N, Mohamed A (2013) Hybrid speech recognition with Deep Bidirectional LSTM. In: 2013 IEEE workshop on automatic speech recognition and understanding, pp 273–278
Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Navab N, Hornegger J, Wells W, Frangi A (eds) Medical image computing and computer-assisted intervention (MICCAI 2015). Lecture notes in computer science, vol 9351. Springer, Cham, pp 234–241
Raff GL, Abidov A, Achenbach S, Berman DS, Boxt LM, Budoff MJ, Cheng V, Defrance T, Hellinger JC, Karlsberg RP (2009) SCCT guidelines for the interpretation and reporting of coronary computed tomographic angiography. J Cardiovasc Comput Tomogr 3:122–136
Acknowledgements
The work received supports from Shenzhen Municipal Government under the Grant KQTD2016112809330877.
Author information
Authors and Affiliations
Corresponding authors
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
All procedures performed in these studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards. For this type of study, formal consent is not required.
Rights and permissions
About this article
Cite this article
Wu, D., Wang, X., Bai, J. et al. Automated anatomical labeling of coronary arteries via bidirectional tree LSTMs. Int J CARS 14, 271–280 (2019). https://doi.org/10.1007/s11548-018-1884-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11548-018-1884-6