Abstract
This paper is aimed at assessing the initial performance of a computer-based system to detect the risk of diabetic macular edema (DME). The development of this tool was funded by the Health Ministry of the Andalusian Regional Government (Spain) with the purpose of being integrated into a complete system for early diagnosis of diabetic retinopathy (DR).
The algorithmic methods are based on the detection of retinal exudates (early ophthalmic signs of DME) by fundus image processing. It has been tested on a set of 1058 macula-centred retinographies from people with diabetes at risk for retinal diseases. Each of the images was rated on a 0–2 scale (from no DME risk to moderate-severe risk) created from the observations of ophthalmologic specialists of three Andalusian Health Service Medical Centres. Since these three sets of DME expert ratings showed a high agreement and consistency, a consensus diagnosis was built and used as a ground truth. System evaluation was carried out by measuring the sensitivity and specificity of automated DME risk detection regarding this clinical reference diagnosis. In addition, system failures in real cases of DME risk (false negatives) and its clinical importance were also measured.
The system showed several promising operation points, being able to work at a sensitivity level comparable to human experts, with no clinically-important failures, and enough specificity from a hypothetical practical implementation point of view. Thus, it demonstrated 0.9039 sensitivity per image (against 0.7948, 0.9345 and 0.8690 of specialists), with all false negatives graded as mild DME risk, and 0.7696 specificity. This last value indicates that over 75 % of the images with no apparent DME risk under consideration are correctly identified by the system.
Initial performance assessment shows that the presented system for the detection of DME risk is a suitable tool to be integrated into a complete DR pre-screening tool for the automated management of patients within a screening programme. Progress in this integration is definitely associated with the need to carry out a comprehensive system evaluation.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Goldenberg, R., Punthakee, Z.: Definition, classification and diagnosis of diabetes, prediabetes and metabolic syndrome. Can. J. Diabetes 37(Suppl. 1), S8–S11 (2013)
Klein, R., Meuer, S.M., Moss, S.E., Klein, B.E.: Retinal microaneurysm counts and 10-year progression of diabetic retinopathy. Arch. Ophthalmol. 113, 1386–1391 (1995)
Massin, P., Erginay, A., Gaudric, A.: Rétinopathie Diabétique. Elsevier, New York (2000)
Fong, D.S., Aiello, L., Gardner, T.W., King, G.L., Blankenship, G., Cavallerano, J.D., Ferris, F.L., Klein, R.: Diabetic retinopathy. Diab. Care 26, 226–229 (2003)
Sender, M.J., Bagur, S.M., Badia, X., Maseras, M., de la Puente, M.L., Foz, M.: Cámara de retina no midríatica: estudio de coste-efectividad en la detección temprana de la retinopatía diabética. Med. Clín. 121(12), 446–452 (2003)
Aptel, F., Denis, P., Rouberol, F., Thivolet, C.: Screening of diabetic retinopathy: effect of field number and mydriasis on sensitivity and specificity of digital fundus photography. Diab. Metab. 34(3), 290–293 (2008)
Guariguata, L., Whiting, D.R., Hambleton, I., Beagley, J., Linnenkamp, U., Shaw, J.E.: Global estimates of diabetes prevalence for 2013 and projections for 2035. Diab. Res. Clin. Pract. 103(2), 137–149 (2014)
Mookiah, M.R.K., Acharya, U.R., Chua, C.K., Lim, C.M., Ng, E.Y.K., Laude, A.: Computer-aided diagnosis of diabetic retinopathy: A review. Comput. Biol. Med. 43, 2136–2155 (2013)
Usher, D., Dumskyj, M., Himaga, M., Williamson, T., Nussey, S., Boyce, J.: Automated detection of diabetic retinopathy in digital retinal images: a tool for diabetic retinopathy screening. Diabet. Med. 21(1), 84–90 (2004)
Philip, S., Fleming, A.D., Goatman, K.A., Fonseca, S., Mcnamee, P., Scotland, G.S., Prescott, G.J., Sharp, P.F., Olson, J.A.: The efficacy of automated ‘‘disease/no disease’’ grading for diabetic retinopathy in a systematic screening programme. Br. J. Ophthalmol. 91, 1512–1517 (2007)
Abramoff, M.D., Niemeijer, M., Suttorp-Schulten, M.S.A., Viergever, M.A., Russell, S.R., van Ginneken, B.: Evaluation of a system for automatic detection of diabetic retinopathy from color fundus photographs in a large population of patients with diabetes. Diab. Care 31(2), 193–198 (2008)
Niemeijer, M., Abràmoff, M.D., van Ginneken, B.: Information fusion for diabetic retinopathy CAD in digital color fundus photographs. IEEE Trans. Med. Imag. 28(5), 775–785 (2009)
Dupas, B., Walter, T., Erginay, A., Ordonez, R., Deb-Joardar, N., Gain, P., Klein, J.C., Massin, P.: Evaluation of automated fundus photograph analysis algorithms for detecting microaneurysms, haemorrhages and exudates, and of a computer-assisted diagnostic system for grading diabetic retinopathy. Diab. Metab. 36, 213–220 (2010)
Abràmoff, M.D., Folk, J.C., Han, D.P., Walker, J.D., Williams, D.F., Russell, S.R., Massin, P., Cochener, B., Gain, P., Tang, L., Lamard, M., Moga, D.C., Quellec, G., Niemeijer, M.: Automated analysis of retinal images for detection of referable diabetic retinopathy. JAMA Ophthalmol. 131(3), 351–357 (2013)
Abràmoff, M.D., Suttorp-Schulten, M.S.A.: Web-based screening for diabetic retinopathy in a primary care population: The eye check project. Telemed. J. E Health 11(6), 668–674 (2005)
M.E. Gegundez-Arias, D. Marin, C. Ortega, J. Garrido, B. Ponte, F. Alvarez, J. M. Bravo, M.J. Vasallo, A tool for automated diabetic retinopathy pre-screening based on retinal image computer analysis, Submitted to Computers in Biology and Medicine
Nayak, J., Bhat, P.S., Acharya, U.R.: Automatic identification of diabetic maculopathy stages using fundus images. J. Med. Eng. Technol. 33(2), 119–129 (2009)
Giancardo, L., Meriaudeau, F., Karnowski, T.P., Li, Y., Garg, S., Tobin, K.W., Chaum, E.: Exudate-based diabetic macular detection in fundus images using publicly available datasets. Med. Image Anal. 16(1), 216–226 (2012)
MESSIDOR TECHNO-VISION Project, France, MESSIDOR: Digital Retinal Images, Available: (Download images section). http://messidor.crihan.fr/download-en.php
Massin, P., Angioi-Duprez, K., Bacin, F., Cathelineau, B., Cathelineau, G., Chaine, G., Coscas, G., Flament, J., Sahel, J., Turut, P., Guillausseau, P.J., Gaudric, A.: Recommandations de l’ALFEDIAM pour le d´epistage et la surveillance de la r´etinopathie diab´etique. Diab. Metab. 22, 203–209 (1996)
Massin, P., Angioi-Duprez, K., Bacin, F., Cathelineau, B., Cathelineau, G., Chaine, G., Coscas, G., Flament, J., Sahel, J., Turut, P., Guillausseau, P.J., Gaudric, A.: Recommandations de lALFEDIA Mpour le d´epistage et la surveillance de la r´etinopathiediab´etique. J. Fr. Ophtalmol. 20, 302–310 (1997)
Early Treatment Diabetic Retinopathy Study Research Group: Grading diabetic retinopathy from stereoscopic color fundus photographs an extension of the Modified Airlie House classification: ETDRS report number 10. Ophthalmology 98, 786–806 (1991)
Diabetic Retinopathy Screening Services in Scotland, 2003. Diabetic retinopathy screening:Annex E. Scottish diabetic retinopathy grading scheme. The Scottish Government Publications. http://www.scotland.gov.uk/Publications/2003/07/17638/23088
Shrout, P.E., Fleiss, J.L.: Intraclass correlations: Uses in assessing rater reliability. Psychol. Bull. 86(2), 420–428 (1979)
Cohen, J.: A coefficient of agreement for nominal scales. Educ. Psychol. Measur. 20(1), 37–46 (1960)
Fleiss, J.L.: Measuring nominal scale agreement among many raters. Psychol. Bull. 76(5), 378–382 (1971)
Cicchetti, D.V.: Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol. Assess. 6(4), 284–290 (1994)
Landis, J.R., Koch, G.G.: The measurement of observer agreement for categorical data. Biometrics 33(1), 159–174 (1977)
Acknowledgements
This work was carried out as part of the Project “Automatic System for Early Diabetic Retinopathy Detection by Retinal Digital Images Analysis”, supported and funded by the Health Ministry of the Andalusian Regional Government (Spain).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Marin, D., Gegundez-Arias, M.E., Ortega, C., Garrido, J., Ponte, B., Alvarez, F. (2016). Automated Detection of Diabetic Macular Edema Risk in Fundus Images. In: Ortuño, F., Rojas, I. (eds) Bioinformatics and Biomedical Engineering. IWBBIO 2016. Lecture Notes in Computer Science(), vol 9656. Springer, Cham. https://doi.org/10.1007/978-3-319-31744-1_34
Download citation
DOI: https://doi.org/10.1007/978-3-319-31744-1_34
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-31743-4
Online ISBN: 978-3-319-31744-1
eBook Packages: Computer ScienceComputer Science (R0)