Advertisement

Artificial Intelligence in Teledermatology

  • Mulin Xiong
  • Jacob Pfau
  • Albert T. Young
  • Maria L. WeiEmail author
Teledermatology (D Oh, Section Editor)
Part of the following topical collections:
  1. Topical Collection on Teledermatology

Abstract

Purpose of Review

This review summarizes current and prospective applications of artificial intelligence (AI) and smartphone technologies to automated diagnosis and teledermatology.

Recent Findings

Healthcare institutions are rapidly scaling up telehealth programs and embracing long-distance consultation. New developments in deep learning, a type of artificial intelligence, have reached dermatologist-level performance in diagnosing cases of melanoma from lesion images. The smartphone industry projects that next-generation devices and widespread adoption will put deep learning-capable hardware in the hands of consumers everywhere in the coming decade.

Summary

The expansion in teledermatology programs over the past decade is driven by efforts to lower cost of care, expand access to underserved areas, and improve the monitoring of chronic conditions. Although long-distance diagnosis still underperforms relative to traditional, in-person diagnosis, deep learning technologies have demonstrated the potential to achieve results on par with face-to-face care. Current mobile app diagnosis systems rely on unproven technologies which do not achieve the same standard of accuracy. Over the next few years, research in teledermatology must refine deep learning methods to work with highly variable smartphone images in order to achieve functional long-distance diagnoses.

Keywords

Machine learning Automated diagnosis Artificial intelligence Dermatology Teledermatology Smartphones 

Notes

Compliance with Ethics Guidelines

Conflict of Interest

Mulin Xiong, Jacob Pfau, Albert T. Young, and Maria L. Wei declare no conflict of interest.

Human and Animal Rights and Informed Consent

This article does not contain any studies with human or animal subjects performed by any of the authors.

References

Papers of particular interest, published recently, have been highlighted as: • Of importance

  1. 1.
    Codella NCF, Gutman D, Celebi ME et al. Skin lesion analysis toward melanoma detection: A challenge at the 2017 International symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC). 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018). 2018.  https://doi.org/10.1109/ISBI.2018.8363547.
  2. 2.
    Rastgoo M, Lemaître G, Morel O, et al. Classification of melanoma lesions using sparse coded features and random forests. SPIE Medical Imaging. 2016.  https://doi.org/10.1117/12.2216973.
  3. 3.
    • LeCun Y, Bengio Y, Hinton G. Deep learning. Nature. 2015;521:436–44. This survey provides a layman’s introduction to deep learning and gives an overview of the widespread success of CNN architectures particularly in setting the state-of-the-art in facial recognition and object detection. CrossRefGoogle Scholar
  4. 4.
    Coudray N, Ocampo PS, Sakellaropoulos T, Narula N, Snuderl M, Fenyö D, et al. Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning. Nat Med. 2018;24:1559–67.CrossRefGoogle Scholar
  5. 5.
    Pereira S, Pinto A, Alves V, Silva CA. Brain tumor segmentation using convolutional neural networks in MRI images. IEEE Trans Med Imaging. 2016;35:1240–51.CrossRefGoogle Scholar
  6. 6.
    Szegedy C, Ioffe S, Vanhoucke V, et al. Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning. Thirty-First AAAI Conference on Artificial Intelligence. 2017.Google Scholar
  7. 7.
    • Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature. 542:115–118 2017. This paper demonstrated dermatologist level performance, 91% AUC, on binary classification between malignant melanomas versus benign nevi using a pre-trained Google Inception v3 CNN architecture. CrossRefGoogle Scholar
  8. 8.
    Haenssle HA, Fink C, Schneiderbauer R, Toberer F, Buhl T, Blum A, et al. Man against machine: diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologists. Ann Oncol. 2018;29:1836–42.CrossRefGoogle Scholar
  9. 9.
    Masood A, Ali Al-Jumaily A. Computer aided diagnostic support system for skin cancer: a review of techniques and algorithms. Int J Biomed Imaging. 2013.  https://doi.org/10.1155/2013/323268.CrossRefGoogle Scholar
  10. 10.
    Han SS, Kim MS, Lim W, Park GH, Park I, Chang SE. Classification of the clinical images for benign and malignant cutaneous tumors using a deep learning algorithm. J Investig Dermatol. 2018;138:1529–38.CrossRefGoogle Scholar
  11. 11.
    Dorsey ER, Topol EJ. State of telehealth. N Engl J Med. 2016;375:154–61.CrossRefGoogle Scholar
  12. 12.
    Ray KN, Chari AV, Engberg J, Bertolet M, Mehrotra A. Disparities in time spent seeking medical care in the United States. JAMA Intern Med. 2015;175:1983–6.CrossRefGoogle Scholar
  13. 13.
    Levine SR, Gorman M. “Telestroke” : the application of telemedicine for stroke. Stroke. 1999;30:464–9.CrossRefGoogle Scholar
  14. 14.
    Glazer AM, Farberg AS, Winkelmann RR, Rigel DS. Analysis of trends in geographic distribution and density of US dermatologists. JAMA Dermatol. 2017;153:322–5.CrossRefGoogle Scholar
  15. 15.
    Finnane A, Dallest K, Janda M, Soyer HP. Teledermatology for the diagnosis and management of skin cancer: a systematic review. JAMA Dermatol. 2017;153:319–27.CrossRefGoogle Scholar
  16. 16.
    Rat C, Hild S, Rault Sérandour J, Gaultier A, Quereux G, Dreno B, et al. Use of smartphones for early detection of melanoma: systematic review. J Med Internet Res. 2018.  https://doi.org/10.2196/jmir.9392. This systematic review provides an overview of currently available teledermatology, mobile-based apps and concludes that that all studies done so far relied on heavily biased patient samples, and so no conclusion regarding the efficacy of these automated-diagnoses can be drawn. CrossRefGoogle Scholar
  17. 17.
    Yim KM, Florek AG, Oh DH, McKoy K, Armstrong AW. Teledermatology in the United States: an update in a dynamic era. Telemed e-Health. 2018;24:691–7.CrossRefGoogle Scholar
  18. 18.
    Done N, Oh DH, Weinstock MA, Whited JD, Jackson GL, King HA, et al. VA Telederm study: protocol for a stepped-wedge cluster randomised trial to compare access to care for a mobile app versus a workstation-based store-and-forward teledermatology process. BMJ Open. 2018;8:e022218.CrossRefGoogle Scholar
  19. 19.
    Snoswell C, Finnane A, Janda M, Soyer HP, Whitty JA. Cost-effectiveness of store-and-forward teledermatology: a systematic review. JAMA Dermatol. 2016;152:702–8.CrossRefGoogle Scholar
  20. 20.
    Fogel AL, Sarin KY. A survey of direct-to-consumer teledermatology services available to US patients: explosive growth, opportunities and controversy. J Telemed Telecare. 2017;23:19–25.CrossRefGoogle Scholar
  21. 21.
    American Hospital Association. Telehealth: helping hospitals deliver cost-effective care. Issue Brief. 2016;30:1–7.Google Scholar
  22. 22.
    Inova - World-Class Healthcare for Northern Virginia and the DC Metro Area. https://www.inova.org/. Accessed 5 Apr 2019.
  23. 23.
    Chous AP. Pros and cons of using an AI-based diagnosis for diabetic retinopathy. In: Optometry times. 2018. https://www.optometrytimes.com/article/pros-and-cons-using-ai-based-diagnosis-diabetic-retinopathy-0. Accessed 5 Apr 2019.
  24. 24.
    Ericsson Mobility Report November 2018 – Ericsson. In: Ericsson.com. https://www.ericsson.com/en/mobility-report/reports/november-2018. Accessed 27 Feb 2019.
  25. 25.
    AI smartphones will soon be standard, thanks to machine learning chip. In: Futurism. https://futurism.com/ai-smartphones-machine-learning-chip. Accessed 25 Feb 2019.
  26. 26.
    Bennis M. Smartphones will get even smarter with on-device machine learning. In: IEEE Spectrum: technology, engineering, and science news. https://spectrum.ieee.org/tech-talk/telecom/wireless/smartphones-will-get-even-smarter-with-ondevice-machine-learning. Accessed 25 Feb 2019.
  27. 27.
    Ngoo A, Finnane A, McMeniman E, Soyer HP, Janda M. Fighting melanoma with smartphones: a snapshot of where we are a decade after app stores opened their doors. Int J Med Inform. 2018;118:99–112.CrossRefGoogle Scholar
  28. 28.
    Health C for D and R Mobile Medical Applications. https://www.fda.gov/medical-devices/digital-health/mobile-medical-applications. Accessed 25 Feb 2019.
  29. 29.
    FDA permits marketing of artificial intelligence-based device to detect certain diabetes-related eye problems. In: FDA news releases. https://www.fda.gov/newsevents/newsroom/pressannouncements/ucm604357.htm. Accessed 5 Apr 2019.
  30. 30.
    Evans data corporation | global developer population and demographic study. 2018;2. https://evansdata.com/reports/viewRelease.php?reportID=9. Accessed 25 Feb 2019.
  31. 31.
    Thissen M, Udrea A, Hacking M, von Braunmuehl T, Ruzicka T. mHealth app for risk assessment of pigmented and nonpigmented skin lesions—a study on sensitivity and specificity in detecting malignancy. Telemed e-Health. 2017;23:948–54.CrossRefGoogle Scholar
  32. 32.
    Maier T, Kulichova D, Schotten K, Astrid R, Ruzicka T, Berking C, et al. Accuracy of a smartphone application using fractal image analysis of pigmented moles compared to clinical diagnosis and histological result. J Eur Acad Dermatol Venereol. 2015;29:663–7.CrossRefGoogle Scholar
  33. 33.
    Izadi S, Mirikharaji Z, Kawahara J, et al. Generative adversarial networks to segment skin lesions. 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) 2018;881–4.Google Scholar
  34. 34.
    Navarro F, Escudero-Vinolo M, Bescos J. Accurate segmentation and registration of skin lesion images to evaluate lesion change. IEEE Journal of Biomedical and Health Informatics. 2018;23:501–8.  https://doi.org/10.1109/jbhi.2018.2825251.CrossRefGoogle Scholar
  35. 35.
    Rizzi M, D’Aloia M, Cice G. Computer aided evaluation (CAE) of morphologic changes in pigmented skin lesions. In: Murino V, Puppo E, Sona D, Cristani M, Sansone C (eds) New trends in image analysis and processing -- ICIAP 2015 workshops. Springer International Publishing; 2015. p. 250–257.Google Scholar
  36. 36.
    Mirzaalian H, Lee TK, Hamarneh G. Skin lesion tracking using structured graphical models. Med Image Anal. 2016;27:84–92.CrossRefGoogle Scholar
  37. 37.
    Büchi M, Just N, Latzer M. Modeling the second-level digital divide: a five-country study of social differences in internet use. New Media Soc. 2015;18:2703–22.  https://doi.org/10.1177/1461444815604154.CrossRefGoogle Scholar
  38. 38.
    Narla A, Kuprel B, Sarin K, Novoa R, Ko J. Automated classification of skin lesions: from pixels to practice. J Investig Dermatol. 2018;138:2108–10.CrossRefGoogle Scholar
  39. 39.
    Mueller J, Jay C, Harper S, Davies A, Vega J, Todd C. Web use for symptom appraisal of physical health conditions: a systematic review. J Med Internet Res. 2017;19:e202.CrossRefGoogle Scholar
  40. 40.
    Shah SJ, Schwamm LH, Cohen AB, Simoni MR, Estrada J, Matiello M, et al. Virtual visits partially replaced in-person visits in an ACO-based medical specialty practice. Health Aff. 2018;37:2045–51.CrossRefGoogle Scholar

Copyright information

© This is a U.S. Government work and not under copyright protection in the US; foreign copyright protection may apply 2019

Authors and Affiliations

  • Mulin Xiong
    • 1
  • Jacob Pfau
    • 2
  • Albert T. Young
    • 3
    • 4
  • Maria L. Wei
    • 3
    • 4
    • 5
    Email author
  1. 1.Michigan State University College of Human MedicineEast LansingUSA
  2. 2.Department of Computer ScienceEcole PolytechniquePalaiseauFrance
  3. 3.Department of DermatologyUniversity of CaliforniaSan FranciscoUSA
  4. 4.Dermatology Service, Veterans Affairs Medical CenterSan FranciscoUSA
  5. 5.Helen Diller Family Comprehensive Cancer CenterUniversity of CaliforniaSan FranciscoUSA

Personalised recommendations