Skip to main content

Advertisement

SpringerLink
Log in

A Two-Step Approach for Longitudinal Registration of Retinal Images

  • Systems-Level Quality Improvement
  • Published:
Journal of Medical Systems Aims and scope Submit manuscript

Abstract

This paper presents a novel two step approach for longitudinal (over time) registration of retinal images. Longitudinal registration is an important preliminary step to analyse longitudinal changes on the retina including disease progression. While potential overlap and minimal geometric distortion are likely in longitudinal images, identification of reliable features over time is a potential challenge for longitudinal registration. Relying on the widely accepted phenomenon that retinal vessels are more reliable over time, the proposed method aims to accurately match bifurcation and cross-over points between different timestamp images. Binary robust independent elementary features (BRIEF) are computed around bifurcation points which are then matched based on Hamming distance. Prior to computing BRIEF descriptors, a preliminary registration is performed relying on SURF key-point matching. Experiments are conducted on different image datasets containing 109 longitudinal image pairs in total. The proposed method has been found to produce accurate registration (i.e. registration with zero alignment error) for 97 % cases, which is significantly higher than the other methods in comparison. The paper also reveals the finding that both the number and distributions of accurately matching key-points pairs are important for successful registration of image pairs.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Notes

  1. The maximal observed registration error for a matching key-point pair was 11 pixels. We considered an error margin of 15 pixels just to be in the same side.

References

  1. Zitova, B., and Flusser, J., Image registration methods: a survey. Image and vision computing. 21(11):977–1000, 2003.

    Article  Google Scholar 

  2. Aguilar, W., Frauel, Y., Escolano, F., Martinez-Perez, M.E., Espinosa-Romero, A., and Lozano, M.A., A robust graph transformation matching for non-rigid registration. Image and Vision Computing. 27(7):897–910, 2009.

    Article  Google Scholar 

  3. Stewart, C.V., Chia-Ling, T., and Roysam, B., The dual-bootstrap iterative closest point algorithm with application to retinal image registration. IEEE Transactions on Medical Imaging. 22(11):1379–1394, 2003.

    Article  PubMed  Google Scholar 

  4. Zheng, Y., Daniel, E., Hunter, A.A., Xiao, R., Gao, J., Li, H., Maguire, M.G., Brainard, D.H., and Gee, J.C., Landmark matching based retinal image alignment by enforcing sparsity in correspondence matrix. Medical image analysis. 18(6):903–913, 2014.

    Article  PubMed  Google Scholar 

  5. Taha, H.M., El-Bendary, N., Hassanien, A.E., Badr, Y., and Snasel, V., Retinal feature-based registration schema. In: Informatics engineering and information science. Springer, Berlin Heidelberg, pp. 26–36, 2011.

    Chapter  Google Scholar 

  6. Bay H, Tuytelaars T, Gool LV (2006) Surf: Speeded up robust features. Computer vision–ECCV 2006, pp. 404–417. Springer Berlin Heidelberg.

  7. Calonder M, Lepetit V, Strecha C, Fua P (2010) Brief: Binary robust independent elementary features. Computer Vision–ECCV 2010, pp. 778–792. Springer Berlin Heidelberg.

  8. Hernandez-Matas C, Zabulis X, Argyros AA (2015) Retinal image registration based on keypoint correspondences, spherical eye modeling and camera pose estimation. 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 5650–5654. IEEE.

  9. Xing, C., and Qiu, P., Intensity-based image registration by nonparametric local smoothing. IEEE Transactions on Pattern Analysis and Machine Intelligence. 33(10):2081–2092, 2011.

    Article  PubMed  Google Scholar 

  10. Can, A., Stewart, C.V., Roysam, B., and Tanenbaum, H.L., A feature-based, robust, hierarchical algorithm for registering pairs of images of the curved human retina. IEEE Transactions on Pattern Analysis and Machine Intelligence. 24(3):347–364, 2002.

    Article  Google Scholar 

  11. Heneghan C, Maguire P, Ryan N, Chazal PD (2002) Retinal image registration using control points. In Biomedical Imaging, 2002. Proceedings. 2002 I.E. International Symposium on, pp. 349–352. IEEE.

  12. Fang B, Hsu W, Lee ML (2004) Techniques for temporal registration of retinal images. 2004 International Conference on Image Processing, 2004, pp. 1089–1092. IEEE.

  13. Fang, B., and Tang, Y.Y., Elastic registration for retinal images based on reconstructed vascular trees. IEEE Transactions on Biomedical Engineering. 53(6):1183–1187, 2006.

    Article  PubMed  Google Scholar 

  14. Ryan, N., Heneghan, C., and Chazal, P., Registration of digital retinal images using landmark correspondence by expectation maximization. Image and Vision Computing. 22(11):883–898, 2004.

    Article  Google Scholar 

  15. Guo X, Hsu W, Lee ML, Wong TY (2006) A tree matching approach for the temporal registration of retinal images. 18th IEEE International Conference on Tools with Artificial Intelligence, pp. 632–642. IEEE.

  16. Chen J, Smith RT, Tian J, Laine AF (2008) A novel registration method for retinal images based on local features.” 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2008, pp. 2242–2245. IEEE.

  17. Troglio G, Benediktsson JA, Serpico SB, Moser G, Karlsson RA, Halldorsson GH, Stefansson E (2008) Automatic registration of retina images based on genetic techniques. 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2008, pp. 5419–5424. IEEE.

  18. Kolář R, Harabiš V (2009) Automatic rigid registration and analysis of colour fundus image in patients with diabetic retinopathy.” World Congress on Medical Physics and Biomedical Engineering, September 7–12, 2009, Munich, Germany, pp. 251–254. Springer Berlin Heidelberg.

  19. Kolar, R., Harabis, V., and Odstrcilik, J., Hybrid retinal image registration using phase correlation. The Imaging Science Journal. 61(4):369–384, 2013.

    Article  Google Scholar 

  20. Fernandes M, Gavet Y, Jean-Charles P (2009) A feature-based dense local registration of pairs of retinal images. 4th International Conference on Computer VISion Theory and APplications, VISAPP 2009, pp. 265–265. INSTICC-Institut for Systems and Technologies of Information Control and Communication.

  21. Andreou L, Achim A (2010) Temporal registration for low-quality retinal images of the murine eye. 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 6272–6275. IEEE.

  22. Deng, K., Tian, J., Zheng, J., Zhang, X., Dai, X., and Xu, M., Retinal fundus image registration via vascular structure graph matching. Journal of Biomedical Imaging. 2010:14, 2010.

    Google Scholar 

  23. Chen L, Xiang Y, Chen YJ, Zhang XL (2011) Retinal image registration using bifurcation structures. 18th IEEE International Conference on Image Processing (ICIP), 2011, pp. 2169–2172. IEEE.

  24. Chen L, Ju YY, Ding S, Liu X (2011) Topological vascular tree segmentation for retinal images using shortest path connection. 18th IEEE International Conference on Image Processing (ICIP), 2011, pp. 2137–2140. IEEE.

  25. Chen, L., Huang, X., and Tian, J., Retinal image registration using topological vascular tree segmentation and bifurcation structures. Biomedical Signal Processing and Control. 16:22–31, 2015.

    Article  Google Scholar 

  26. Taha HM, El-Bendary N, Hassanien EL, Badr Y, Snasel V (2011) Retinal Feature-Based Registration Schema. Informatics Engineering and Information Science, pp. 26–36. Springer Berlin Heidelberg.

  27. Pereira C, Martins N, Gonçalves L, Ferreira M (2012) Registration of retinal images by a MAS-ICP approach—A preliminary study. IEEE 2nd Portuguese Meeting in Bioengineering (ENBENG), 2012, pp. 1–4. IEEE.

  28. Xiao, D., Vignarajan, J., Lock, J., Frost, S., Tay-Kearney, M., and Kanagasingam, Y., Retinal image registration and comparison for clinical decision support. The Australasian medical journal. 5(9):507, 2012.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Lupascu CA, Tegolo D, Bellavia F, Valenti C (2013) Semi-automatic registration of retinal images based on line matching approach. IEEE 26th International Symposium on Computer-Based Medical Systems (CBMS), 2013, pp. 453–456. IEEE.

  30. Ghassabi, Z., Shanbehzadeh, J., Mohammadzadeh, A., and Ostadzadeh, S.S., Colour retinal fundus image registration by selecting stable extremum points in the scale-invariant feature transform detector. IET Image Processing. 9(10):889–900, 2015.

    Article  Google Scholar 

  31. Chen, J., Tian, J., Lee, N., Zheng, J., Smith, R.T., and Laine, A.F., A partial intensity invariant feature descriptor for multimodal retinal image registration. IEEE Transactions on Biomedical Engineering. 57(7):1707–1718, 2010.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Lowe, D., Distinctive image features from scale invariant keypoints. International Journal of Computer Vision. 60(2):91–110, 2004.

    Article  Google Scholar 

  33. Zana, F., and Klein, J.C., A multimodal registration algorithm of eye fundus images using vessels detection and Hough transform. IEEE Transactions on Medical Imaging. 18(5):419–428, 1999.

    Article  CAS  PubMed  Google Scholar 

  34. Kolar R, Kubecka L, Jan J (2008) Registration and fusion of the autofluorescent and infrared retinal images. International journal of biomedical imaging.

    Google Scholar 

  35. Can, A., Stewart, C.V., Roysam, B., and Tanenbaum, H.L., A feature-based, robust, hierarchical algorithm for registering pairs of images of the curved human retina. IEEE Transactions on Pattern Analysis and Machine Intelligence. 24(3):347–364, 2002.

    Article  Google Scholar 

  36. Chanwimaluang, T., Fan, G., and Fransen, S.R., Hybrid retinal image registration. IEEE Transactions on Information Technology in Biomedicine. 10(1):129–142, 2006.

    Article  PubMed  Google Scholar 

  37. Ghassabi, Z., Shanbehzadeh, J., and Mohammadzadeh, A., A structure-based region detector for high-resolution retinal fundus image registration. Biomedical Signal Processing and Control. 23:52–61, 2016.

    Article  Google Scholar 

  38. Besl PJ, McKay ND (1992) Method for registration of 3-D shapes. In Robotics-DL tentative, pp. 586–606. International Society for Optics and Photonics.

  39. Nguyen, U.T.V., Bhuiyan, A., Park, L.A.F., and Ramamohanarao, K., An effective retinal blood vessel segmentation method using multi-scale line detection. Pattern recognition. 46(3):703–715, 2013.

    Article  Google Scholar 

  40. Yang, G., Stewart, C.V., Sofka, M., and Tsai, C., Registration of challenging image pairs: initialization, estimation, and decision. IEEE Transactions on Pattern Analysis and Machine Intelligence. 29(11):1973–1989, 2007.

    Article  PubMed  Google Scholar 

  41. Saha S, Tahtali M, Lambert A, Pickering M (2012) Perceptual Dissimilarity: A Measure to Quantify the Degradation of Medical Images. 2012 International Conference on Digital Image Computing Techniques and Applications (DICTA), 2012, pp. 1–6. IEEE.

  42. Hamming, R.W., Error detecting and error correcting codes. Bell System Technical Journal. 29(2):147–160, 1950. doi:10.1002/j.1538-7305.1950.tb00463.x, MR 0035935.

    Article  Google Scholar 

  43. Zhu, Y.M., Mutual information-based registration of temporal and stereo retinal images using constrained optimization. Computer methods and programs in biomedicine. 86(3):210–215, 2007.

    Article  PubMed  Google Scholar 

  44. Rosman, M., Zheng, Y., Lamoureux, E., Saw, S.M., Aung, T., Tay, W.T., Wang, J.J., Mitchell, P., Tai, E.S., and Wong, T.Y., Review of key findings from the Singapore Malay eye study (SiMES-1). Singapore medical journal. 53(2):82–87, 2012.

    CAS  PubMed  Google Scholar 

  45. http://rcophth-website.www.premierithosting.com/docs/publications/published-guidelines/ENSPDR_Workbook_2009.pdf

Download references

Acknowledgments

The authors would like to thank Prof. Tien Y. Wong, MD, PhD, Provost Chair Professor & Medical Director of Singapore National Eye Centre for his valuable inputs.

Author information

Authors and Affiliations

  1. Australian E Health Research Centre, CSIRO, Perth, WA, 6014, Australia

    Sajib Kumar Saha, Di Xiao, Shaun Frost & Yogesan Kanagasingam

Authors
  1. Sajib Kumar Saha
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Di Xiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shaun Frost
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yogesan Kanagasingam
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sajib Kumar Saha.

Additional information

This article is part of the Topical Collection on Systems-Level Quality Improvement

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Saha, S.K., Xiao, D., Frost, S. et al. A Two-Step Approach for Longitudinal Registration of Retinal Images. J Med Syst 40, 277 (2016). https://doi.org/10.1007/s10916-016-0640-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10916-016-0640-0

Keywords

Search

Navigation