Abstract
The need for intelligent computerized systems in medicine has increased over recent years; artificial neural networks (ANN) have become increasingly popular for various classification tasks during diagnosis procedures.
One of the most dynamic branches of modern diagnosis is medical imaging, with the emergence of various new methods for finding disease, especially cancer. Quantifying and interpreting the results represents a constant challenge for the already overburdened physician.
Gastroenterology is a dynamic field of medicine with many recent advances in imaging methods for cancer diagnosis. Computerized systems have gained significant traction in the last few years, with promising future prospects of reducing diagnosis time and workload on the performing physicians.
We describe here two image analysis systems that take advantage of the latest accomplishments in ANN and computerized decision making. The first system describes a computerized diagnosis system that takes into account a blend of both clinical and biological set of parameters, combining them with advanced image analysis of contrast-enhanced ultrasound imagery in an attempt to diagnose and classify primary liver malignancies.
The second part of the chapter is dedicated to another advanced imaging method in gastroenterology – wireless videocapsule endoscopy. The combination of different novel image analysis techniques described here greatly reduces interpretation times of an extensive investigation and helps doctors in the decision-making process.
CT Streba and M Ionescu have equally contributed to preparing the manuscript and share first authorship.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Aihara H, Ikeda K, Tajiri H. Image-enhanced capsule endoscopy based on the diagnosis of vascularity when using a new type of capsule. Gastrointest Endosc. 2011;73(6):1274–9.
Albrecht T, Blomley M, Bolondi L, et al. EFSUMB Study Group. Guidelines for the use of contrast agents in ultrasound. Ultraschall Med. 2004;25:249–56.
Bolondi L, Gaiani S, Celli N, Golfieri R, Grigioni WF, Leoni S, Venturi AM, Piscaglia F. Characterization of small nodules in cirrhosis by assessment of vascularity: the problem of hypovascular hepatocellular carcinoma. Hepatology. 2005;42:27–34.
Bourbakis N, Makrogiannis S, Kavraki D. A neural network-based detection of bleeding in sequences of WCE images. In: IEEE international symposium on bioinformatic and bioengineering, Minneapolis, USA. Oct. 2005. p. 324–7; 2005.
Brown G, Fraser C, Schofield G, Taylor S, Bartram C, Phillips R, Saunders B. Video capsule endoscopy in peutz-jeghers syndrome: a blinded comparison with barium follow-through for detection of small-bowel polyps. Endoscopy. 2006;38(4):385–90.
Bruix J, Sherman M. Management of hepatocellular carcinoma: an update. Hepatology. 2011;53(3):1020–2.
Catalano O, Nunziata A, Lobianco R, Siani A. Real-time harmonic contrast material-specific US of focal liver lesions. Radiographics. 2005;25:333.
Caturelli E, Solmi L, Anti M, Fusilli S, Roselli P, Andriulli A, Fornari F, Del Vecchio BC, de Sio I. Ultrasound guided fine needle biopsy of early hepatocellular carcinoma complicating liver cirrhosis: a multicentre study. Gut. 2004;53:1356–62.
Chechik G, Sharma V, Shalit U, Bengio S. Large scale online learning of image similarity through ranking. J Mach Learn Res. 2010;11:1109–35.
Chen CC, Chu HT. Similarity measurement between images. in COMPSAC-W’05. In: Proceedings of the 29th annual international conference on computer software and applications conference. p. 41–42; 2005.
Chiu JS, Wang YF, Su YC, Wei LH, Liao JG, Li YC. Artificial neural network to predict skeletal metastasis in patients with prostate cancer. J Med Syst. 2009;33:91–100.
Colli A, Fraquelli M, Casazza G, et al. Characterization of small nodules in cirrhosis by assessment of vascularity: the problem of hypovascular hepatocellular carcinoma. Hepatology. 2005;42:27–34.
Cucchetti A, Piscaglia F, Grigioni AD, et al. Preoperative prediction of hepatocellular carcinoma tumour grade and micro-vascular invasion by means of artificial neural network: a pilot study. J Hepatol. 2010;52(6):880–8.
Dietrich CF. Characterization of focal liver lesions with contrast enhanced ultrasonography. Eur J Radiol. 2004;51S:S9.
El-Serag HB. Hepatocellular Carcinoma. N Engl J Med. 2011;365:1118–27.
El-Serag HB, Rudolph L. Hepatocellular carcinoma: epidemiology and molecular carcinogenesis. Gastroenterology. 2007;132:2557–76.
European Association for the Study of the Liver, European Organisation for Research and Treatment of Cancer. EASL-EORTC clinical practice guidelines: management of hepatocellular carcinoma. J Hepatol. 2012;56:908–43.
Ferlay J, Shin HR, Bray F, Forman D, Mathers C, Parkin DM. GLOBOCAN 2008 v1.2, cancer incidence and mortality worldwide: IARC CancerBase No. 10 [Internet]. Lyon, France: International Agency for Research on Cancer; 2010. http://globocan.iarc.fr. Accessed 10 Apr 2012.
Filip D, Yadid-Pecht O, Andrews CN, Mintchev MP. Design, implementation, and testing of a miniature self-stabilizing capsule endoscope with wireless image transmission capabilities. Int J Inf Technol Knowledge. 2011;5(1):3–24.
Forner A, Vilana R, Ayuso C, Bianchi L, Solé M, Ayuso JR, Boix L, Sala M, Varela M, Llovet JM, Brú C, Bruix J. Diagnosis of hepatic nodules 20 mm or smaller in cirrhosis: prospective validation of the noninvasive diagnostic criteria for hepatocellular carcinoma. Hepatology. 2008;47:97–104.
Gao M, Hu C, Chen Z, Zhang H, Liu S. Design and fabrication of a magnetic propulsion system for self-propelled capsule endoscope. IEEE Trans Biomed Eng. 2010;57(12):2891–902.
Gay G, Delvaux M, Rey J. The role of video capsule endoscopy in the diagnosis of digestive diseases: a review of current possibilities. Endoscopy. 2004;36:913–20.
Gheonea DI, Streba CT, Ciurea T, Saftoiu A. Quantitative low mechanical index contrast-enhanced endoscopic ultrasound for the differential diagnosis of chronic pseudotumoral pancreatitis and pancreatic cancer. BMC Gastroenterol. 2013;13:2.
Goertz RS, Bernatik T, Strobel D, Hahn EG, Haendl T. Software-based quantification of contrast-enhanced ultrasound in focal liver lesions – a feasibility study. Eur J Radiol. 2010;75(2):e22–6.
Goldberger J, Gordon S, Greenspan H. An efficient image similarity measure based on approximations of KL-divergence between two gaussian mixtures. In: Proceedings of ninth IEEE international conference on computer vision. vol 1, p. 487–93; 2003.
Goodband JH, Haas OCL, Mills JA. A comparison of neural network approaches for on-line prediction in IGRT. Med Phys. 2008;35:1113–22.
Grossi E, Mancini A, Buscema M. International experience on the use of artificial neural networks in gastroenterology. Dig Liver Dis. 2007;39(3):278–85.
Guo D, Qiu T, Bian J, Kang W, Zhang L. A computer-aided diagnostic system to discriminate SPIO-enhanced magnetic resonance hepatocellular carcinoma by a neural network classifier. Comput Med Imaging Graph. 2009;33(8):588–92.
Hadithi M, Heine GD, Jacobs MA, van Bodegraven AA, Mulder CJ. A prospective study comparing video capsule endoscopy with double-balloon enteroscopy in patients with obscure gastrointestinal bleeding. Gastroenterology. 2006;131(1):327–9.
Hansen T, Gegenfurtner KR. Higher level chromatic mechanisms for image segmentation. J Vis. 2006;6:239–59.
Huang-Wei C, Bleuzen A, Bourlier P, Roumy J, Bouakaz A, Pourcelot L, Tranquart F. Differential diagnosis of focal nodular hyperplasia with quantitative parametric analysis in contrast-enhanced sonography. Investig Radiol. 2006;41(3):363–8.
Hwang S. Bag-of-visual-words approach based on SURF features to polyp detection in wireless capsule endoscopy videos. In: ISVC’11 Proceedings of the 7th international conference on advances in visual computing. Berlin/Heidelberg: Springer-Verlag. p. 320–7; 2011. Part II.
Iddan G, Meron G, Glu-khovsky A, Swain P. Wireless capsule endoscopy. Nature. 2000;405:725–9.
Ignee A, Jedrejczyk M, Schuessler G, Jakubowski W, Dietrich CF. Quantitative contrast enhanced ultrasound of the liver for time intensity curves-Reliability and potential sources of errors. Eur J Radiol. 2010;73(1):153–8.
Jiang J, Trundle P, Ren J. Medical image analysis with artificial neural networks. Comput Med Imaging Graph. 2010;34:617–31.
Karargyris A, Bourbakis N. A methodology for detecting blood-based abnormalities in wireless capsule endoscopy videos. In: 8th IEEE international conference on bioinformatics and bioengineering. p. 1–6; 2008.
Karargyris A, Bourbakis N. Detection of small bowel polyps and ulcers in wireless capsule endoscopy videos. IEEE Trans Biomed Eng. 2011;58(10):2777–86.
Kim TK, Choi BI, Han JK, Hong HS, Park SH, Moon SG. Hepatic tumours: contrast agent enhancement patterns with pulse-inversion harmonic US. Radiology. 2000;216:411.
Kim SH, Lee JM, Lee JY, Han JK, An SK, Han CJ, Lee KH, Hwang SS, Choi BI. Value of contrast-enhanced sonography for the characterization of focal hepatic lesions in patients with diffuse liver disease: receiver operating characteristic analysis. AJR Am J Roentgenol. 2005;184(4):1077–84.
Kondo C, Kondo T, Ueno J. Three-dimensional medical image analysis of the heart by the revised GMDH-type neural network self-selecting optimum neural network architecture. Artif Life Robot. 2009;14(2):123–8.
Kornbluth A, Legnani P, Lewis BS. Video capsule endoscopy in inflammatory bowel disease: past, present, and future. Inflamm Bowel Dis. 2004;10:278–85.
Kosa G, Jakab P, Jolesz F, Hata N. Swimming capsule endoscope using static and rf magnetic field of mri for propulsion. In: IEEE International Conference Robotics and Automation, ICRA. 2008; p. 2922–7.
Lau PY, Correia PL. Analyzing gastrointestinal tissue images using multiple features. In: 6th Conference on telecommunications Peniche. p. 435–8; 2007.
Leen E, Ceccotti P, Kalogeropoulou C, Angerson WJ, Moug SJ, Horgan PG. Prospective multicenter trial evaluating a novel method of characterizing focal liver lesions using contrast-enhanced sonography. Am J Roentgenol. 2006;186:1551.
Lenaerts B, Puers R. An omnidirectional transcutaneous power link for capsule endoscopy. In: Proceedings of international workshop on wearable and implantable body sensor networks. 2006; p. 46–9.
Lencioni R, Piscaglia F, Bolondi L. Contrast-enhanced ultrasound in the diagnosis of hepatocellular carcinoma. J Hepatol. 2008a;48:848–57.
Lencioni R, Piscaglia F, Bolondi L. Contrast-enhanced ultrasound in the diagnosis of hepatocellular carcinoma. J Hepatol. 2008b;48:848–57.
Lisboa PJ, Taktak AF. The use of artificial neural networks in decision support in cancer: a systematic review. Neural Netw. 2006;19(4):408–15.
Lv G, Yan G, Wang Z. Bleeding detection in wireless capsule endoscopy images based on colour invariants and spatial pyramids using support vector machines. In: 33rd annual international conference of the IEEE EMBS. September 2011; 2011.
Mackiewicz M. Capsule endoscopy – state of the technology and computer vision tools after the first decade. In: Pascu O, Seicean A, editors. New techniques in gastrointestinal endoscopy. Croatia: InTech Open; 2011. p. 103–24.
Mackiewicz M, Fisher M, Jamieson C. Bleeding detection in wireless capsule endoscopy using adaptive colour histogram model and support vector classification. In: Medical imaging image processing, Proceedings of SPIE, 69140R; 2008.
Mang OY, et al. Multiple LEDs luminous system in capsule endoscope. In: Proceedings SPIE the International Society for Optical Engineering. Feb. 6 2008;8(7).
Markaki VE, Asvestas PA, Matsopoulos GK. Application of Kohonen network for automatic point correspondence in 2D medical images. Comput Biol Med. 2009;39:630–5.
Meron GD. The development of a swallowable video-capsule (M2A). Gastrointest Endosc. 2000;52:817–9.
Mittal D, Kumar V, Saxena SC, Khandelwal N, Kalra N. Neural network based focal liver lesion diagnosis using ultrasound images. Comput Med Imaging Graph. 2011;35(4):315–23.
Pan G, Yan G, Song X, Qiu X. BP neural network classification for bleeding detection in wireless capsule endoscopy. J Med Eng Technol. 2009;33(7):575–81.
Pan G, Yan G, Song X, Qiu X. Bleeding detection from wireless capsule endoscopy images using improved euler distance in CIELab. J Shanghai Jiaotong Univ (Science) 2010;15(2):218–23.
Qian Z, Meng MQH. Polyp detection in wireless capsule endoscopy images using novel color texture features. In: 9th World Congress on Intelligent Control and Automation (WCICA). p. 948–52; 2011.
Quirini M, Ill RW, Menciassi A, Dario P. Design of a pill-sized 12-legged endoscopic capsule robot. In: Proceedings of IEEE international conference on robotics and automation. 2007; p. 1856–62.
Rettenbacher T. Focal liver lesions: role of contrast-enhanced ultrasound. Eur J Radiol. 2007;64:173–82.
Rimola J, Forner A, Reig M, Vilana R, de Lope CR, Ayuso C, et al. Cholangiocarcinoma in cirrhosis: absence of contrast washout in delayed phases by magnetic resonance imaging avoids misdiagnosis of hepatocellular carcinoma. Hepatology. 2009;50:791–8.
Saarela TP, Landy MS. Combination of texture and color cues in visual segmentation. Vis Res. 2007;58:59–67.
Săftoiu A, Vilmann P, Gorunescu F, Gheonea DI, Gorunescu M, Ciurea T, Popescu GL, Iordache A, Hassan H, Iordache S. Neural network analysis of dynamic sequences of EUS elastography used for the differential diagnosis of chronic pancreatitis and pancreatic cancer. Gastrointest Endosc. 2008;68(6):1086–94.
Săftoiu A, Vilmann P, Gorunescu F, Janssen J, Hocke M, Larsen M, Iglesias-Garcia J, Arcidiacono P, Will U, Giovannini M, Dietrich CF, Havre R, Gheorghe C, McKay C, Gheonea DI, Ciurea T, European EUS Elastography Multicentric Study Group. Efficacy of an artificial neural network-based approach to endoscopic ultrasound elastography in diagnosis of focal pancreatic masses. Clin Gastroenterol Hepatol. 2012;10(1):84–90.
Salvatore V, Borghi A, Sagrini E, Galassi M, Gianstefani A, Bolondi L, Piscaglia F. Quantification of enhancement of focal liver lesions during contrast-enhanced ultrasound (CEUS). Analysis of ten selected frames is more simple but as reliable as the analysis of the entire loop for most parameters. Eur J Radiol. 2012;81:709–13.
Shah SK, Rajauria PP, Lee J, Celebi ME. Classification of bleeding images in wireless capsule endoscopy using HIS colour domain and region segmentation. In: URI- NE ASEE conference; 2007.
Signorelli C, Villa F, Rondonotti E, Abbiati C, Beccari G, de Franchis R. Sensitivity and specificity of the suspected blood identification system in video capsule enteroscopy. Endoscopy. 2005;37:1170–3.
Singh P, Erickson RA, Mukhopadhyay P, Gopal S, Kiss A, Khan A, Ulf WT. EUS for detection of the hepatocellular carcinoma: results of a prospective study. Gastrointest Endosc. 2007;66:65–273.
Streba CT, Gheonea DI, Sandulescu L, Ciurea T, Saftoiu A, Vere CC, Rogoveanu I. Using contrast-enhanced ultrasonography (CEUS) time-intensity curves (TICs) as classifiers in neural network diagnosis of focal liver lesions. Gastroenterology. 2011;142(5, Suppl 1):S-1004.
Streba CT, Ionescu M, Gheonea D, et al. Using contrast-enhanced ultrasonography time-intensity curves as classifiers in neural network diagnosis of focal liver lesions. World J Gastroenterol. 2012a;18(32):4427–34.
Streba CT, Sandulescu L, Vere CC, Saftoiu A, Gheonea IA, Streba L, Rogoveanu I. Quantitative analysis of dynamic image modalities represents the best classifiers of focal liver lesions in an artificial neural network approach. United European Gastroenterology Week, Amsterdam, Olanda. Gut/Endoscopy. 2012b; 60(Suppl. II):A45.
Streba CT, Sandulescu L, Vere CC, Streba L, Rogoveanu I. Computer aided differentiation model for automatic classification of focal liver lesions based on contrast-enhanced ultrasonography (CEUS) time intensity curve (TIC) analysis. J Hepatol. 2012c;56(Suppl. 2):S296.
Tirilly P, Mu X, Huang C, Xie I, Jeong W, Zhang J. Image similarity as assessed by users: a quantitative study. Proc Am Soc Inf Sci Technol. 2010;49:1–10.
van Wijk C, van Ravesteijn VF, Vos FM, Truyen R, de Vries AH, Stoker J, van Vliet LJ. Detection of protrusions in curved folded surfaces applied to automated polyp detection in CT colonography. Berlin Heidelberg: Springer-Verlag; 2006. p. 471–8. MICCAI 2006. LNCS 4191.
Olympus capsule endoscope system, User Manual ver 1.5, 2007.
Vere CC, Foarfă C, Streba CT, Cazacu S, Pîrvu D, Ciurea T. Videocapsule endoscopy and single balloon enteroscopy: novel diagnostic techniques in small bowel pathology. Rom J Morphol Embryol. 2009;50(3):467–74.
Vere CC, Rogoveanu I, Streba CT, Popescu A, Ciocalteu A, Ciurea T. The role of capsule endoscopy in the detection of small bowel disease. Chirurgia (Bucharest). 2012a;107(3):352–60.
Vere CC, Streba CT, Rogoveanu I, Georgescu M, Pirvu D, Iordache S, Gheonea DI, Saftoiu A, Ciurea T. The contribution of the video capsule endoscopy in establishing the indication of surgical treatment in the tumoral pathology of the small bowel. Curr Health Sci J. 2012b;2(38):69–72.
Verma B, McLeod P, Klevansky A. A novel soft cluster neural network for the classification of suspicious areas in digital mammograms. Pattern Recogn. 2009;42(9):1845–52.
Youk JH, Kim CS, Lee JM. Contrast-enhanced agent detection imaging: value in the characterization of focal hepatic lesions. J Ultrasound Med. 2003;22:897.
Zhang X, Fujita H, Qin T, et al. CAD on Liver Using CT and MRI. MIMI LNCS. 2008;4987:367–76.
Zhang X, Kanematsu M, Fujita H, Zhou X, Hara T, Yokoyama R, Hoshi H. Application of an artificial neural network to the computer-aided differentiation of focal liver disease in MR imaging. Radiol Phys Technol. 2009;2(2):175–82.
Zhao Q, Dassopoulos T, Mullin GE, Meng MQH, Kumar R. A decision fusion strategy for polyp detection in capsule endoscopy. Stud Health Technol Inform. 2012;173:559–65.
Acknowledgments
The research presented here was partially financed by the following scientific grants: CNCS – UEFISCDI: Partnership project VIP SYSTEM, ID: 2011–3,2-0503, CNCS-UEFISCDI Partnership project, ID: PN-II-PT-PCCA-2013-4-1931 and CNCS-UEFISCDI Partnership project ID: PN-II-PT-PCCA-2013-4-1930.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Shanghai Jiao Tong University Press, Shanghai and Springer Science+Business Media Dordrecht
About this chapter
Cite this chapter
Streba, C.T., Ionescu, M., Vere, C.C., Rogoveanu, I. (2017). Artificial Intelligence and Automatic Image Interpretation in Modern Medicine. In: Wei, DQ., Ma, Y., Cho, W., Xu, Q., Zhou, F. (eds) Translational Bioinformatics and Its Application. Translational Medicine Research. Springer, Dordrecht. https://doi.org/10.1007/978-94-024-1045-7_16
Download citation
DOI: https://doi.org/10.1007/978-94-024-1045-7_16
Published:
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-024-1043-3
Online ISBN: 978-94-024-1045-7
eBook Packages: Biomedical and Life SciencesBiomedical and Life Sciences (R0)