Advertisement

Extract Bone Parts Without Human Prior: End-to-end Convolutional Neural Network for Pediatric Bone Age Assessment

  • Chuanbin Liu
  • Hongtao XieEmail author
  • Yizhi Liu
  • Zhengjun Zha
  • Fanchao Lin
  • Yongdong Zhang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11769)

Abstract

Pediatric bone age assessment (BAA) is a common clinical practice to investigate endocrinology, genetic and growth disorders of children. The morphological characters of different specific bone parts, such as wrist and phalanx, have important reference significance in BAA. Previous deep learning approaches can be divided into two branches, (1) the single-stage structure ignores the attention on specific bone parts, thus it can be trained end-to-end but suffers from low accuracy, (2) the multi-stage structure extracts the bone parts with human prior, thus it exhibits high accuracy but suffers from model generalization and resource consumption problem. To enable an end-to-end training method extracting discriminative bone parts automatically without human prior, in this paper, we propose a novel single-stage Attention-Recognition Convolutional Neural Network (AR-CNN). The AR-CNN consists of one attention agent for discriminative bone parts proposing and one recognition agent for feature learning and age assessment. The attention agent can discover and extract bone parts automatically, meanwhile the recognition agent can learn the features from the proposing bone parts and assess the bone age. Furthermore, the assessment result will be fed back to attention agent for the optimization of bone parts extracting. Therefore, the two agents can reinforce each other mutually and the overall network can be trained end-to-end without human prior. To the best of our knowledge, this is the first end-to-end structure to extract bone parts for BAA without segmentation, detection and human prior. Experimental results show that our approach achieves state-of-the-art accuracy on the public RSNA datasets with mean absolute error(MAE) of 4.38 months.

Keywords

Bone age assessment Deep learning Object detection 

Notes

Acknowledgements

This work is supported by the Huawei-USTC Joint Innovation Project on Machine Vision Technology (FA2018111122). And we would like to thank Brain-inspired Technology Corporation (http://www.leinao.ai/) for its calculation support.

References

  1. 1.
    Gertych, A., Zhang, A., Sayre, J., Pospiech-Kurkowska, S., Huang, H.K.: Bone age assessment of children using a digital hand atlas. Comput. Med. Imaging Graph. 31(4–5), 322–331 (2007)CrossRefGoogle Scholar
  2. 2.
    Stern, D., Ebner, T., Bischof, H., Grassegger, S., Ehammer, T., Urschler, M.: Fully automatic bone age estimation from left hand MR images. In: Golland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds.) MICCAI 2014. LNCS, vol. 8674, pp. 220–227. Springer, Cham (2014).  https://doi.org/10.1007/978-3-319-10470-6_28CrossRefGoogle Scholar
  3. 3.
    Liu, A.A., Xu, N., Nie, W.Z., Su, Y.T., Wong, Y., Kankanhalli, M.: Benchmarking a multimodal and multiview and interactive dataset for human action recognition. IEEE Trans. Cybern. 47(7), 1781–1794 (2016)CrossRefGoogle Scholar
  4. 4.
    Xie, H., Yang, D., Sun, N., Chen, Z., Zhang, Y.: Automated pulmonary nodule detection in ct images using deep convolutional neural networks. Pattern Recogn. 85, 109–119 (2019)CrossRefGoogle Scholar
  5. 5.
    Min, S., Chen, X., Zha, Z.J., Wu, F., Zhang, Y.: A two-stream mutual attention network for semi-supervised biomedical segmentation with noisy labels. In: AAAI 2019 (2018)Google Scholar
  6. 6.
    Mutasa, S., Chang, P.D., Ruzal-Shapiro, C., Ayyala, R.: MABAL: a novel deep-learning architecture for machine-assisted bone age labeling. J. Digit. Imaging 31(4), 513–519 (2018)CrossRefGoogle Scholar
  7. 7.
    Spampinato, C., Palazzo, S., Giordano, D., Aldinucci, M., Leonardi, R.: Deep learning for automated skeletal bone age assessment in X-ray images. Med. Image Anal. 36, 41–51 (2017).  https://doi.org/10.1016/j.media.2016.10.010CrossRefGoogle Scholar
  8. 8.
    Larson, D.B., Chen, M.C., Lungren, M.P., Halabi, S.S., Stence, N.V., Langlotz, C.P.: Performance of a deep-learning neural network model in assessing skeletal maturity on pediatric hand radiographs. Radiology 287(1), 313–322 (2018)CrossRefGoogle Scholar
  9. 9.
    Ren, X., Li, T., Wang, Q.: Regression convolutional neural network for automated pediatric bone age assessment from hand radiograph. IEEE J. Biomed. Health Inform. pp(c), 1 (2018)Google Scholar
  10. 10.
    Wang, S., Shen, Y., Zeng, D., Hu, Y.: Bone age assessment using convolutional neural networks. In: 2018 International Conference on Artificial Intelligence and Big Data (ICAIBD), pp. 175–178. IEEE (2018)Google Scholar
  11. 11.
    Iglovikov, V.I., Rakhlin, A., Kalinin, A.A., Shvets, A.A.: Paediatric bone age assessment using deep convolutional neural networks. In: Stoyanov, D., et al. (eds.) DLMIA/ML-CDS -2018. LNCS, vol. 11045, pp. 300–308. Springer, Cham (2018).  https://doi.org/10.1007/978-3-030-00889-5_34CrossRefGoogle Scholar
  12. 12.
    Hao, P., Chen, Y., Chokuwa, S., Wu, F., Bai, C.: Skeletal bone age assessment based on deep convolutional neural networks. In: Hong, R., Cheng, W.-H., Yamasaki, T., Wang, M., Ngo, C.-W. (eds.) PCM 2018. LNCS, vol. 11165, pp. 408–417. Springer, Cham (2018).  https://doi.org/10.1007/978-3-030-00767-6_38CrossRefGoogle Scholar
  13. 13.
    Singh, K.K., Lee, Y.J.: Hide-and-seek: forcing a network to be meticulous for weakly-supervised object and action localization. In: ICCV, pp. 3544–3553. IEEE (2017)Google Scholar
  14. 14.
    Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Advances in neural information processing systems, pp. 91–99 (2015)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Chuanbin Liu
    • 1
  • Hongtao Xie
    • 1
    Email author
  • Yizhi Liu
    • 2
  • Zhengjun Zha
    • 1
  • Fanchao Lin
    • 1
  • Yongdong Zhang
    • 1
  1. 1.School of Information Science and TechnologyUniversity of Science and Technology of ChinaHefeiChina
  2. 2.Hunan University of Science and TechnologyXiangtanChina

Personalised recommendations