PRSNet: Part Relation and Selection Network for Bone Age Assessment

  • Yuanfeng Ji
  • Hao Chen
  • Dan Lin
  • Xiaohua Wu
  • Di LinEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11769)


Bone age is one of the most important indicators for assessing bone’s maturity, which can help to interpret human’s growth development level and potential progress. In the clinical practice, bone age assessment (BAA) of X-ray images requires the joint consideration of the appearance and location information of hand bones. These kinds of information can be effectively captured by the relation of different anatomical parts of hand bone. Recently developed methods differ mostly in how they model the part relation and choose useful parts for BAA. However, these methods neglect the mining of relationship among different parts, which can help to improve the assessment accuracy. In this paper, we propose a novel part relation module, which accurately discovers the underlying concurrency of parts by using multi-scale context information of deep learning feature representation. Furthermore, based on the part relation, we explore a new part selection module, which comprehensively measures the importance of parts and select the top ranking parts for assisting BAA. We jointly train our part relation and selection modules in an end-to-end way, achieving state-of-the-art performance on the public RSNA 2017 Pediatric Bone Age benchmark dataset and outperforming other competitive methods by a significant margin.



We thank the anonymous reviewers for their constructive comments. This work was supported in part by NSFC (61702338) and Shenzhen Science and Technology Program (No. JCYJ20180507182410327).


  1. 1.
    Bae, B.U., Bae, W., Jung, K.H.: Improved deep learning model for bone age assessment using triplet ranking loss (2018)Google Scholar
  2. 2.
    Bejnordi, B.E., et al.: Diagnostic assessment of deep learning algorithms for detection of lymph node metastases in women with breast cancer. JAMA 318(22), 2199–2210 (2017)CrossRefGoogle Scholar
  3. 3.
    Davis, L.M., Theobald, B.-J., Bagnall, A.: Automated bone age assessment using feature extraction. In: Yin, H., Costa, J.A.F., Barreto, G. (eds.) IDEAL 2012. LNCS, vol. 7435, pp. 43–51. Springer, Heidelberg (2012). Scholar
  4. 4.
    Dou, Q., et al.: Automatic detection of cerebral microbleeds from MR images via 3D convolutional neural networks. IEEE Trans. Med. Imaging 35(5), 1182–1195 (2016)CrossRefGoogle Scholar
  5. 5.
    Greulich, W.W., Pyle, S.I., Todd, T.W.: Radiographic Atlas of Skeletal Development of the Hand and Wrist, vol. 2. Stanford University Press, Stanford (1959)Google Scholar
  6. 6.
    Halabi, S.S., et al.: The RSNA pediatric bone age machine learning challenge. Radiology 290(2), 498–503 (2018)CrossRefGoogle Scholar
  7. 7.
    He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)Google Scholar
  8. 8.
    Iglovikov, V.I., Rakhlin, A., Kalinin, A.A., Shvets, A.A.: Paediatric bone age assessment using deep convolutional neural networks. In: Stoyanov, D., et al. (eds.) DLMIA/ML-CDS -2018. LNCS, vol. 11045, pp. 300–308. Springer, Cham (2018). Scholar
  9. 9.
    Larson, D.B., Chen, M.C., Lungren, M.P., Halabi, S.S., Stence, N.V., Langlotz, C.P.: Performance of a deep-learning neural network model in assessing skeletal maturity on pediatric hand radiographs. Radiology 287(1), 313–322 (2017)CrossRefGoogle Scholar
  10. 10.
    Lin, T.Y., Dollár, P., Girshick, R., He, K., Hariharan, B., Belongie, S.: Feature pyramid networks for object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2117–2125 (2017)Google Scholar
  11. 11.
    Spampinato, C., Palazzo, S., Giordano, D., Aldinucci, M., Leonardi, R.: Deep learning for automated skeletal bone age assessment in X-ray images. Med. Image Anal. 36, 41–51 (2017)CrossRefGoogle Scholar
  12. 12.
    Tanner, J.M., Whitehouse, R., Cameron, N., Marshall, W., Healy, M., Goldstein, H., et al.: Assessment of Skeletal Maturity and Prediction of Adult Height (TW2 Method), vol. 16. Academic press, London (1975)Google Scholar
  13. 13.
    Thodberg, H.H., Kreiborg, S., Juul, A., Pedersen, K.D.: The BoneXpert method for automated determination of skeletal maturity. IEEE Trans. Med. Imaging 28(1), 52–66 (2009)CrossRefGoogle Scholar
  14. 14.
    Wu, E., et al.: Residual attention based network for hand bone age assessment. arXiv preprint arXiv:1901.05876 (2018)
  15. 15.
    Yang, Z., Luo, T., Wang, D., Hu, Z., Gao, J., Wang, L.: Learning to navigate for fine-grained classification, pp. 420–435 (2018)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Yuanfeng Ji
    • 1
    • 2
  • Hao Chen
    • 1
  • Dan Lin
    • 3
  • Xiaohua Wu
    • 1
  • Di Lin
    • 2
    Email author
  1. 1.Imsight Medical Technology, Co., Ltd.ShenzhenChina
  2. 2.Shenzhen UniversityShenzhenChina
  3. 3.Department of Computer Science and EngineeringThe Chinese University of Hong KongSha TinHong Kong SAR, China

Personalised recommendations