Semi-automatic Cephalometric Landmark Detection on X-ray Images Using Deep Learning Method
Accurate quantitative cephalometry plays a significant role in both diagnosis and treatment. However, it is tedious work and time consuming to label cephalometric landmarks manually. It also requires professional doctors to implement. Deep learning has been a hot topic in recent years and has achieved great success in many image classification and image regression problems. In this paper, we propose a semi-automatic method for detection of cephalometric landmarks using deep learning. We first roughly extract an ROI region for each landmark manually. Then we utilize Resnet50, which is a state-of-the-art convolutional neural network, to detect the landmark in the ROI region. The network directly output the coordinates of the landmark. The dataset we used in this paper is a public dataset—ISBI 2015 grand challenge in dental x-ray image analysis. Experiments demonstrated that the proposed method achieved better results compared with state-of-the-art methods.
KeywordsCephalometric landmark X-ray Deep learning Resnet
This work was supported in part by the National Natural Science Foundation of China under the Grant No. 61603218, and in part by the Grant-in Aid for Scientific Research from the Japanese Ministry for Education, Science, Culture and Sports (MEXT) under the Grant No. 18H03267 and No. 17K00420.
- 7.Lindner, C., Cootes, T.F.: Fully automatic cephalometric evaluation using random forest regression-voting. In: IEEE International Symposium on Biomedical Imaging (2015)Google Scholar
- 8.Ibragimov, B., Likar, B., Pernus, F., Vrtovec, T.: Computerized cephalometry by game theory with shape-and appearance-based landmark refinement. In: Proceedings of International Symposium on Biomedical imaging (ISBI) (2015)Google Scholar
- 10.Ramanan, D., Zhu, X.: Face detection, pose estimation, and landmark localization in the wild. In: Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2879–2886 (2012)Google Scholar
- 12.Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
- 13.Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)Google Scholar
- 14.Ciresan, D.C., Meier, U., Masci, J., Gambardella, L.M., Schmidhuber, J.: Flexible, high performance convolutional neural networks for image classification. In: Twenty-Second International Joint Conference on Artificial Intelligence (2011)Google Scholar
- 15.Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)Google Scholar
- 16.Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 234–241. Springer, Cham (2015)Google Scholar
- 17.He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)Google Scholar