Skip to main content

Artificial Intelligence and Automatic Image Interpretation in Modern Medicine

  • Chapter
  • First Online:

Part of the book series: Translational Medicine Research ((TRAMERE))

Abstract

The need for intelligent computerized systems in medicine has increased over recent years; artificial neural networks (ANN) have become increasingly popular for various classification tasks during diagnosis procedures.

One of the most dynamic branches of modern diagnosis is medical imaging, with the emergence of various new methods for finding disease, especially cancer. Quantifying and interpreting the results represents a constant challenge for the already overburdened physician.

Gastroenterology is a dynamic field of medicine with many recent advances in imaging methods for cancer diagnosis. Computerized systems have gained significant traction in the last few years, with promising future prospects of reducing diagnosis time and workload on the performing physicians.

We describe here two image analysis systems that take advantage of the latest accomplishments in ANN and computerized decision making. The first system describes a computerized diagnosis system that takes into account a blend of both clinical and biological set of parameters, combining them with advanced image analysis of contrast-enhanced ultrasound imagery in an attempt to diagnose and classify primary liver malignancies.

The second part of the chapter is dedicated to another advanced imaging method in gastroenterology – wireless videocapsule endoscopy. The combination of different novel image analysis techniques described here greatly reduces interpretation times of an extensive investigation and helps doctors in the decision-making process.

CT Streba and M Ionescu have equally contributed to preparing the manuscript and share first authorship.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Aihara H, Ikeda K, Tajiri H. Image-enhanced capsule endoscopy based on the diagnosis of vascularity when using a new type of capsule. Gastrointest Endosc. 2011;73(6):1274–9.

    Article  PubMed  Google Scholar 

  • Albrecht T, Blomley M, Bolondi L, et al. EFSUMB Study Group. Guidelines for the use of contrast agents in ultrasound. Ultraschall Med. 2004;25:249–56.

    Article  CAS  PubMed  Google Scholar 

  • Bolondi L, Gaiani S, Celli N, Golfieri R, Grigioni WF, Leoni S, Venturi AM, Piscaglia F. Characterization of small nodules in cirrhosis by assessment of vascularity: the problem of hypovascular hepatocellular carcinoma. Hepatology. 2005;42:27–34.

    Article  PubMed  Google Scholar 

  • Bourbakis N, Makrogiannis S, Kavraki D. A neural network-based detection of bleeding in sequences of WCE images. In: IEEE international symposium on bioinformatic and bioengineering, Minneapolis, USA. Oct. 2005. p. 324–7; 2005.

    Google Scholar 

  • Brown G, Fraser C, Schofield G, Taylor S, Bartram C, Phillips R, Saunders B. Video capsule endoscopy in peutz-jeghers syndrome: a blinded comparison with barium follow-through for detection of small-bowel polyps. Endoscopy. 2006;38(4):385–90.

    Article  CAS  PubMed  Google Scholar 

  • Bruix J, Sherman M. Management of hepatocellular carcinoma: an update. Hepatology. 2011;53(3):1020–2.

    Article  PubMed  PubMed Central  Google Scholar 

  • Catalano O, Nunziata A, Lobianco R, Siani A. Real-time harmonic contrast material-specific US of focal liver lesions. Radiographics. 2005;25:333.

    Article  PubMed  Google Scholar 

  • Caturelli E, Solmi L, Anti M, Fusilli S, Roselli P, Andriulli A, Fornari F, Del Vecchio BC, de Sio I. Ultrasound guided fine needle biopsy of early hepatocellular carcinoma complicating liver cirrhosis: a multicentre study. Gut. 2004;53:1356–62.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Chechik G, Sharma V, Shalit U, Bengio S. Large scale online learning of image similarity through ranking. J Mach Learn Res. 2010;11:1109–35.

    Google Scholar 

  • Chen CC, Chu HT. Similarity measurement between images. in COMPSAC-W’05. In: Proceedings of the 29th annual international conference on computer software and applications conference. p. 41–42; 2005.

    Google Scholar 

  • Chiu JS, Wang YF, Su YC, Wei LH, Liao JG, Li YC. Artificial neural network to predict skeletal metastasis in patients with prostate cancer. J Med Syst. 2009;33:91–100.

    Article  PubMed  Google Scholar 

  • Colli A, Fraquelli M, Casazza G, et al. Characterization of small nodules in cirrhosis by assessment of vascularity: the problem of hypovascular hepatocellular carcinoma. Hepatology. 2005;42:27–34.

    Google Scholar 

  • Cucchetti A, Piscaglia F, Grigioni AD, et al. Preoperative prediction of hepatocellular carcinoma tumour grade and micro-vascular invasion by means of artificial neural network: a pilot study. J Hepatol. 2010;52(6):880–8.

    Article  PubMed  Google Scholar 

  • Dietrich CF. Characterization of focal liver lesions with contrast enhanced ultrasonography. Eur J Radiol. 2004;51S:S9.

    Article  Google Scholar 

  • El-Serag HB. Hepatocellular Carcinoma. N Engl J Med. 2011;365:1118–27.

    Article  CAS  PubMed  Google Scholar 

  • El-Serag HB, Rudolph L. Hepatocellular carcinoma: epidemiology and molecular carcinogenesis. Gastroenterology. 2007;132:2557–76.

    Article  CAS  PubMed  Google Scholar 

  • European Association for the Study of the Liver, European Organisation for Research and Treatment of Cancer. EASL-EORTC clinical practice guidelines: management of hepatocellular carcinoma. J Hepatol. 2012;56:908–43.

    Article  Google Scholar 

  • Ferlay J, Shin HR, Bray F, Forman D, Mathers C, Parkin DM. GLOBOCAN 2008 v1.2, cancer incidence and mortality worldwide: IARC CancerBase No. 10 [Internet]. Lyon, France: International Agency for Research on Cancer; 2010. http://globocan.iarc.fr. Accessed 10 Apr 2012.

  • Filip D, Yadid-Pecht O, Andrews CN, Mintchev MP. Design, implementation, and testing of a miniature self-stabilizing capsule endoscope with wireless image transmission capabilities. Int J Inf Technol Knowledge. 2011;5(1):3–24.

    Google Scholar 

  • Forner A, Vilana R, Ayuso C, Bianchi L, Solé M, Ayuso JR, Boix L, Sala M, Varela M, Llovet JM, Brú C, Bruix J. Diagnosis of hepatic nodules 20 mm or smaller in cirrhosis: prospective validation of the noninvasive diagnostic criteria for hepatocellular carcinoma. Hepatology. 2008;47:97–104.

    Article  PubMed  Google Scholar 

  • Gao M, Hu C, Chen Z, Zhang H, Liu S. Design and fabrication of a magnetic propulsion system for self-propelled capsule endoscope. IEEE Trans Biomed Eng. 2010;57(12):2891–902.

    Article  PubMed  Google Scholar 

  • Gay G, Delvaux M, Rey J. The role of video capsule endoscopy in the diagnosis of digestive diseases: a review of current possibilities. Endoscopy. 2004;36:913–20.

    Article  CAS  PubMed  Google Scholar 

  • Gheonea DI, Streba CT, Ciurea T, Saftoiu A. Quantitative low mechanical index contrast-enhanced endoscopic ultrasound for the differential diagnosis of chronic pseudotumoral pancreatitis and pancreatic cancer. BMC Gastroenterol. 2013;13:2.

    Article  PubMed  PubMed Central  Google Scholar 

  • Goertz RS, Bernatik T, Strobel D, Hahn EG, Haendl T. Software-based quantification of contrast-enhanced ultrasound in focal liver lesions – a feasibility study. Eur J Radiol. 2010;75(2):e22–6.

    Article  PubMed  Google Scholar 

  • Goldberger J, Gordon S, Greenspan H. An efficient image similarity measure based on approximations of KL-divergence between two gaussian mixtures. In: Proceedings of ninth IEEE international conference on computer vision. vol 1, p. 487–93; 2003.

    Google Scholar 

  • Goodband JH, Haas OCL, Mills JA. A comparison of neural network approaches for on-line prediction in IGRT. Med Phys. 2008;35:1113–22.

    Article  CAS  PubMed  Google Scholar 

  • Grossi E, Mancini A, Buscema M. International experience on the use of artificial neural networks in gastroenterology. Dig Liver Dis. 2007;39(3):278–85.

    Article  CAS  PubMed  Google Scholar 

  • Guo D, Qiu T, Bian J, Kang W, Zhang L. A computer-aided diagnostic system to discriminate SPIO-enhanced magnetic resonance hepatocellular carcinoma by a neural network classifier. Comput Med Imaging Graph. 2009;33(8):588–92.

    Article  PubMed  Google Scholar 

  • Hadithi M, Heine GD, Jacobs MA, van Bodegraven AA, Mulder CJ. A prospective study comparing video capsule endoscopy with double-balloon enteroscopy in patients with obscure gastrointestinal bleeding. Gastroenterology. 2006;131(1):327–9.

    Article  Google Scholar 

  • Hansen T, Gegenfurtner KR. Higher level chromatic mechanisms for image segmentation. J Vis. 2006;6:239–59.

    PubMed  Google Scholar 

  • Huang-Wei C, Bleuzen A, Bourlier P, Roumy J, Bouakaz A, Pourcelot L, Tranquart F. Differential diagnosis of focal nodular hyperplasia with quantitative parametric analysis in contrast-enhanced sonography. Investig Radiol. 2006;41(3):363–8.

    Article  Google Scholar 

  • Hwang S. Bag-of-visual-words approach based on SURF features to polyp detection in wireless capsule endoscopy videos. In: ISVC’11 Proceedings of the 7th international conference on advances in visual computing. Berlin/Heidelberg: Springer-Verlag. p. 320–7; 2011. Part II.

    Google Scholar 

  • Iddan G, Meron G, Glu-khovsky A, Swain P. Wireless capsule endoscopy. Nature. 2000;405:725–9.

    Article  Google Scholar 

  • Ignee A, Jedrejczyk M, Schuessler G, Jakubowski W, Dietrich CF. Quantitative contrast enhanced ultrasound of the liver for time intensity curves-Reliability and potential sources of errors. Eur J Radiol. 2010;73(1):153–8.

    Article  PubMed  Google Scholar 

  • Jiang J, Trundle P, Ren J. Medical image analysis with artificial neural networks. Comput Med Imaging Graph. 2010;34:617–31.

    Article  CAS  PubMed  Google Scholar 

  • Karargyris A, Bourbakis N. A methodology for detecting blood-based abnormalities in wireless capsule endoscopy videos. In: 8th IEEE international conference on bioinformatics and bioengineering. p. 1–6; 2008.

    Google Scholar 

  • Karargyris A, Bourbakis N. Detection of small bowel polyps and ulcers in wireless capsule endoscopy videos. IEEE Trans Biomed Eng. 2011;58(10):2777–86.

    Article  PubMed  Google Scholar 

  • Kim TK, Choi BI, Han JK, Hong HS, Park SH, Moon SG. Hepatic tumours: contrast agent enhancement patterns with pulse-inversion harmonic US. Radiology. 2000;216:411.

    Article  CAS  PubMed  Google Scholar 

  • Kim SH, Lee JM, Lee JY, Han JK, An SK, Han CJ, Lee KH, Hwang SS, Choi BI. Value of contrast-enhanced sonography for the characterization of focal hepatic lesions in patients with diffuse liver disease: receiver operating characteristic analysis. AJR Am J Roentgenol. 2005;184(4):1077–84.

    Article  PubMed  Google Scholar 

  • Kondo C, Kondo T, Ueno J. Three-dimensional medical image analysis of the heart by the revised GMDH-type neural network self-selecting optimum neural network architecture. Artif Life Robot. 2009;14(2):123–8.

    Article  Google Scholar 

  • Kornbluth A, Legnani P, Lewis BS. Video capsule endoscopy in inflammatory bowel disease: past, present, and future. Inflamm Bowel Dis. 2004;10:278–85.

    Article  PubMed  Google Scholar 

  • Kosa G, Jakab P, Jolesz F, Hata N. Swimming capsule endoscope using static and rf magnetic field of mri for propulsion. In: IEEE International Conference Robotics and Automation, ICRA. 2008; p. 2922–7.

    Google Scholar 

  • Lau PY, Correia PL. Analyzing gastrointestinal tissue images using multiple features. In: 6th Conference on telecommunications Peniche. p. 435–8; 2007.

    Google Scholar 

  • Leen E, Ceccotti P, Kalogeropoulou C, Angerson WJ, Moug SJ, Horgan PG. Prospective multicenter trial evaluating a novel method of characterizing focal liver lesions using contrast-enhanced sonography. Am J Roentgenol. 2006;186:1551.

    Article  Google Scholar 

  • Lenaerts B, Puers R. An omnidirectional transcutaneous power link for capsule endoscopy. In: Proceedings of international workshop on wearable and implantable body sensor networks. 2006; p. 46–9.

    Google Scholar 

  • Lencioni R, Piscaglia F, Bolondi L. Contrast-enhanced ultrasound in the diagnosis of hepatocellular carcinoma. J Hepatol. 2008a;48:848–57.

    Article  PubMed  Google Scholar 

  • Lencioni R, Piscaglia F, Bolondi L. Contrast-enhanced ultrasound in the diagnosis of hepatocellular carcinoma. J Hepatol. 2008b;48:848–57.

    Article  PubMed  Google Scholar 

  • Lisboa PJ, Taktak AF. The use of artificial neural networks in decision support in cancer: a systematic review. Neural Netw. 2006;19(4):408–15.

    Article  PubMed  Google Scholar 

  • Lv G, Yan G, Wang Z. Bleeding detection in wireless capsule endoscopy images based on colour invariants and spatial pyramids using support vector machines. In: 33rd annual international conference of the IEEE EMBS. September 2011; 2011.

    Google Scholar 

  • Mackiewicz M. Capsule endoscopy – state of the technology and computer vision tools after the first decade. In: Pascu O, Seicean A, editors. New techniques in gastrointestinal endoscopy. Croatia: InTech Open; 2011. p. 103–24.

    Google Scholar 

  • Mackiewicz M, Fisher M, Jamieson C. Bleeding detection in wireless capsule endoscopy using adaptive colour histogram model and support vector classification. In: Medical imaging image processing, Proceedings of SPIE, 69140R; 2008.

    Google Scholar 

  • Mang OY, et al. Multiple LEDs luminous system in capsule endoscope. In: Proceedings SPIE the International Society for Optical Engineering. Feb. 6 2008;8(7).

    Google Scholar 

  • Markaki VE, Asvestas PA, Matsopoulos GK. Application of Kohonen network for automatic point correspondence in 2D medical images. Comput Biol Med. 2009;39:630–5.

    Article  PubMed  Google Scholar 

  • Meron GD. The development of a swallowable video-capsule (M2A). Gastrointest Endosc. 2000;52:817–9.

    Article  CAS  PubMed  Google Scholar 

  • Mittal D, Kumar V, Saxena SC, Khandelwal N, Kalra N. Neural network based focal liver lesion diagnosis using ultrasound images. Comput Med Imaging Graph. 2011;35(4):315–23.

    Article  PubMed  Google Scholar 

  • Pan G, Yan G, Song X, Qiu X. BP neural network classification for bleeding detection in wireless capsule endoscopy. J Med Eng Technol. 2009;33(7):575–81.

    Article  CAS  PubMed  Google Scholar 

  • Pan G, Yan G, Song X, Qiu X. Bleeding detection from wireless capsule endoscopy images using improved euler distance in CIELab. J Shanghai Jiaotong Univ (Science) 2010;15(2):218–23.

    Google Scholar 

  • Qian Z, Meng MQH. Polyp detection in wireless capsule endoscopy images using novel color texture features. In: 9th World Congress on Intelligent Control and Automation (WCICA). p. 948–52; 2011.

    Google Scholar 

  • Quirini M, Ill RW, Menciassi A, Dario P. Design of a pill-sized 12-legged endoscopic capsule robot. In: Proceedings of IEEE international conference on robotics and automation. 2007; p. 1856–62.

    Google Scholar 

  • Rettenbacher T. Focal liver lesions: role of contrast-enhanced ultrasound. Eur J Radiol. 2007;64:173–82.

    Article  PubMed  Google Scholar 

  • Rimola J, Forner A, Reig M, Vilana R, de Lope CR, Ayuso C, et al. Cholangiocarcinoma in cirrhosis: absence of contrast washout in delayed phases by magnetic resonance imaging avoids misdiagnosis of hepatocellular carcinoma. Hepatology. 2009;50:791–8.

    Article  PubMed  Google Scholar 

  • Saarela TP, Landy MS. Combination of texture and color cues in visual segmentation. Vis Res. 2007;58:59–67.

    Article  Google Scholar 

  • Săftoiu A, Vilmann P, Gorunescu F, Gheonea DI, Gorunescu M, Ciurea T, Popescu GL, Iordache A, Hassan H, Iordache S. Neural network analysis of dynamic sequences of EUS elastography used for the differential diagnosis of chronic pancreatitis and pancreatic cancer. Gastrointest Endosc. 2008;68(6):1086–94.

    Article  PubMed  Google Scholar 

  • Săftoiu A, Vilmann P, Gorunescu F, Janssen J, Hocke M, Larsen M, Iglesias-Garcia J, Arcidiacono P, Will U, Giovannini M, Dietrich CF, Havre R, Gheorghe C, McKay C, Gheonea DI, Ciurea T, European EUS Elastography Multicentric Study Group. Efficacy of an artificial neural network-based approach to endoscopic ultrasound elastography in diagnosis of focal pancreatic masses. Clin Gastroenterol Hepatol. 2012;10(1):84–90.

    Article  PubMed  Google Scholar 

  • Salvatore V, Borghi A, Sagrini E, Galassi M, Gianstefani A, Bolondi L, Piscaglia F. Quantification of enhancement of focal liver lesions during contrast-enhanced ultrasound (CEUS). Analysis of ten selected frames is more simple but as reliable as the analysis of the entire loop for most parameters. Eur J Radiol. 2012;81:709–13.

    Article  PubMed  Google Scholar 

  • Shah SK, Rajauria PP, Lee J, Celebi ME. Classification of bleeding images in wireless capsule endoscopy using HIS colour domain and region segmentation. In: URI- NE ASEE conference; 2007.

    Google Scholar 

  • Signorelli C, Villa F, Rondonotti E, Abbiati C, Beccari G, de Franchis R. Sensitivity and specificity of the suspected blood identification system in video capsule enteroscopy. Endoscopy. 2005;37:1170–3.

    Article  CAS  PubMed  Google Scholar 

  • Singh P, Erickson RA, Mukhopadhyay P, Gopal S, Kiss A, Khan A, Ulf WT. EUS for detection of the hepatocellular carcinoma: results of a prospective study. Gastrointest Endosc. 2007;66:65–273.

    Google Scholar 

  • Streba CT, Gheonea DI, Sandulescu L, Ciurea T, Saftoiu A, Vere CC, Rogoveanu I. Using contrast-enhanced ultrasonography (CEUS) time-intensity curves (TICs) as classifiers in neural network diagnosis of focal liver lesions. Gastroenterology. 2011;142(5, Suppl 1):S-1004.

    Article  Google Scholar 

  • Streba CT, Ionescu M, Gheonea D, et al. Using contrast-enhanced ultrasonography time-intensity curves as classifiers in neural network diagnosis of focal liver lesions. World J Gastroenterol. 2012a;18(32):4427–34.

    Article  PubMed  PubMed Central  Google Scholar 

  • Streba CT, Sandulescu L, Vere CC, Saftoiu A, Gheonea IA, Streba L, Rogoveanu I. Quantitative analysis of dynamic image modalities represents the best classifiers of focal liver lesions in an artificial neural network approach. United European Gastroenterology Week, Amsterdam, Olanda. Gut/Endoscopy. 2012b; 60(Suppl. II):A45.

    Google Scholar 

  • Streba CT, Sandulescu L, Vere CC, Streba L, Rogoveanu I. Computer aided differentiation model for automatic classification of focal liver lesions based on contrast-enhanced ultrasonography (CEUS) time intensity curve (TIC) analysis. J Hepatol. 2012c;56(Suppl. 2):S296.

    Article  Google Scholar 

  • Tirilly P, Mu X, Huang C, Xie I, Jeong W, Zhang J. Image similarity as assessed by users: a quantitative study. Proc Am Soc Inf Sci Technol. 2010;49:1–10.

    Article  Google Scholar 

  • van Wijk C, van Ravesteijn VF, Vos FM, Truyen R, de Vries AH, Stoker J, van Vliet LJ. Detection of protrusions in curved folded surfaces applied to automated polyp detection in CT colonography. Berlin Heidelberg: Springer-Verlag; 2006. p. 471–8. MICCAI 2006. LNCS 4191.

    Google Scholar 

  • Olympus capsule endoscope system, User Manual ver 1.5, 2007.

    Google Scholar 

  • Vere CC, Foarfă C, Streba CT, Cazacu S, Pîrvu D, Ciurea T. Videocapsule endoscopy and single balloon enteroscopy: novel diagnostic techniques in small bowel pathology. Rom J Morphol Embryol. 2009;50(3):467–74.

    CAS  PubMed  Google Scholar 

  • Vere CC, Rogoveanu I, Streba CT, Popescu A, Ciocalteu A, Ciurea T. The role of capsule endoscopy in the detection of small bowel disease. Chirurgia (Bucharest). 2012a;107(3):352–60.

    CAS  Google Scholar 

  • Vere CC, Streba CT, Rogoveanu I, Georgescu M, Pirvu D, Iordache S, Gheonea DI, Saftoiu A, Ciurea T. The contribution of the video capsule endoscopy in establishing the indication of surgical treatment in the tumoral pathology of the small bowel. Curr Health Sci J. 2012b;2(38):69–72.

    Google Scholar 

  • Verma B, McLeod P, Klevansky A. A novel soft cluster neural network for the classification of suspicious areas in digital mammograms. Pattern Recogn. 2009;42(9):1845–52.

    Article  Google Scholar 

  • Youk JH, Kim CS, Lee JM. Contrast-enhanced agent detection imaging: value in the characterization of focal hepatic lesions. J Ultrasound Med. 2003;22:897.

    Article  PubMed  Google Scholar 

  • Zhang X, Fujita H, Qin T, et al. CAD on Liver Using CT and MRI. MIMI LNCS. 2008;4987:367–76.

    Google Scholar 

  • Zhang X, Kanematsu M, Fujita H, Zhou X, Hara T, Yokoyama R, Hoshi H. Application of an artificial neural network to the computer-aided differentiation of focal liver disease in MR imaging. Radiol Phys Technol. 2009;2(2):175–82.

    Article  PubMed  Google Scholar 

  • Zhao Q, Dassopoulos T, Mullin GE, Meng MQH, Kumar R. A decision fusion strategy for polyp detection in capsule endoscopy. Stud Health Technol Inform. 2012;173:559–65.

    PubMed  Google Scholar 

Download references

Acknowledgments

The research presented here was partially financed by the following scientific grants: CNCS – UEFISCDI: Partnership project VIP SYSTEM, ID: 2011–3,2-0503, CNCS-UEFISCDI Partnership project, ID: PN-II-PT-PCCA-2013-4-1931 and CNCS-UEFISCDI Partnership project ID: PN-II-PT-PCCA-2013-4-1930.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Cristin Constantin Vere .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Shanghai Jiao Tong University Press, Shanghai and Springer Science+Business Media Dordrecht

About this chapter

Cite this chapter

Streba, C.T., Ionescu, M., Vere, C.C., Rogoveanu, I. (2017). Artificial Intelligence and Automatic Image Interpretation in Modern Medicine. In: Wei, DQ., Ma, Y., Cho, W., Xu, Q., Zhou, F. (eds) Translational Bioinformatics and Its Application. Translational Medicine Research. Springer, Dordrecht. https://doi.org/10.1007/978-94-024-1045-7_16

Download citation

Publish with us

Policies and ethics