Advertisement

Multimedia Tools and Applications

, Volume 78, Issue 24, pp 35211–35236 | Cite as

A robust medical image retrieval system based on wavelet optimization and adaptive block truncation coding

  • H. KasbanEmail author
  • D. H. Salama
Article
  • 70 Downloads

Abstract

This paper presents a proposed method for medical image retrieval in order to search in a database for an image that is similar to a query image. The proposed Medical Image Retrieval System (MIRS) consists of two phases; enrollment phase and querying phase. In enrollment phase, the Discrete Wavelet Transform (DWT) coefficients are computed from every incoming image. Four wavelet types; Haar, Daubechies, Coiflet, and Symlet wavelets with different decomposition levels have been tested and compared in order to determine the most suitable wavelet type for the retrieval approach. Then, the Block Truncation Codes (BTCs) are extracted from the wavelet coefficients. To make the proposed image retrieval system robust, the BTC is adaptive by dividing the image into sub-blocks using one of four different scanning methods; raster, zigzag, Morton or Hilbert scanning. Finally, the extracted codes are stored as features vectors database. In querying phase, the BTCs are extracted from the wavelet coefficients of the query image. The similarity measurement between the features vector of the query images and the features vectors stored in the features vectors database is carried out using 8 different distance metrics to select the most suitable one. The proposed MIRS has been tested with a medical image database consists of 7500 CT brain images collected from a teaching hospital in Egypt. The results demonstrated that the proposed approach gives good results with extracting the BTCs with Morton scanning from the DB2 DWT. Moreover, Manhattan distance achieved the best similarity measurement results. The performance of the proposed MIRS has been compared with the published medical image retrieval approaches for VIA-ELCAP and Kvasir databases. The results indicated that, the proposed MIRS is robust and efficient for different medical image databases due to the advantages of dividing the image into blocks and each block can be retrieved separately according to its variance.

Keywords

Image retrieval Discrete wavelet transform Block truncation codes 

Notes

References

  1. 1.
    Abuturab MR (2019) Securing multiple information using wavelet transform and Yang-Gu mixture amplitude-phase retrieval algorithm. Opt Laser Eng 118:42–51Google Scholar
  2. 2.
    Ahmad J, Muhammad K, Baik SW (2018) Medical image retrieval with compact binary codes generated in frequency domain using highly reactive convolutional features. J Med Syst 42:24.  https://doi.org/10.1007/s10916-017-0875-4 CrossRefGoogle Scholar
  3. 3.
    Arora S, Brar YS, Kumar S (2014) HAAR wavelet transform for solution of image retrieval. IJACMS 5(2):27–31Google Scholar
  4. 4.
    Bashar MK, Ohnishi N, Matsumoto T, Takeuchi Y, Kudo H, Agusa K (2015) Image retrieval by pattern categorization using wavelet domain perceptual features with LVQ neural network. Pattern Recogn Lett 26:2315–2335Google Scholar
  5. 5.
    Bhandari KA, Ramchandra M (2016) Some innovative remote sensing image retrieval techniques based on Haar wavelet-LTRP and ANFIS. Proc Comput Sci 79:391–401Google Scholar
  6. 6.
    Bressan RS, Bugatti PH, Saito PTM (2019) Breast cancer diagnosis through active learning in content-based image retrieval. Neurocomputing.  https://doi.org/10.1016/j.neucom.2019.05.041 Google Scholar
  7. 7.
    Cai Y, Li Y, Qiu C, Ma J, Gao X (2019) Medical image retrieval based on convolutional neural network and supervised hashing. IEEE Access 7:51877–51885Google Scholar
  8. 8.
    Chandy DA, Christinal AH, Theodore AJ, Selvan SE (2017) Neighbourhood search feature selection method for content based mammogram retrieval. Med Biol Eng Comput 55:493–505Google Scholar
  9. 9.
    Chen YH, Chang CC, Lin CC, Hsu CY (2019) Content-based color image retrieval using block truncation coding based on binary ant colony optimization. Symmetry 11(1):21Google Scholar
  10. 10.
    Conjeti S, Paschali M, Katouzian A, Navab N (2017) Deep multiple instance hashing for scalable medical image retrieval. Med Image Comput Comput Assist Interv 10435:550–558Google Scholar
  11. 11.
    Deep G, Kaur L, Gupta S (2016) Directional local ternary quantized Extrema pattern: a new descriptor for biomedical image indexing and retrieval. Eng Sci Techn Int J 19(4):1895–1909Google Scholar
  12. 12.
    Deep G, Kaur L, Gupta S (2018) Biomedical image retrieval using microscopic configuration with local structural information. Sadhana 43:20MathSciNetzbMATHGoogle Scholar
  13. 13.
    Delp EJ, Mitchell OR (1979) Image compression using block truncation coding. IEEE Trans Commun 27(9):133–1342Google Scholar
  14. 14.
    Dubey SR, Singh SK, Singh RK (2015) Local wavelet pattern: a new feature descriptor for image retrieval in medical CT databases. IEEE Trans Image Process 24(12):5892–5903MathSciNetzbMATHGoogle Scholar
  15. 15.
    Galshetwar GM, Waghmare LM, Gonde AB, Murala S (2018) Multi-dimensionalmulti-directional mask maximum edge pattern for bio-medical image retrieval. Int J Multimed Inf Retr 7:231–239Google Scholar
  16. 16.
    Gao Z, Xuan HZ, Zhang H, Wan SH, Choo KR (2019) Adaptive fusion and category-level dictionary learning model for multi-view human action recognition. IEEE Internet Things J.  https://doi.org/10.1109/JIOT.2019.2911669
  17. 17.
    Gao Z, Wangc DY, Wanb SH, Zhang H, Wanga YL (2019) Cognitive-inspired class-statistic matching with triple-constrain for camera free 3D object retrieval. Fut Gener Comp Sy 94:641–653Google Scholar
  18. 18.
    Giveki D, Soltanshahi MA, Montazer GA (2017) A new image feature descriptor for content-based image retrieval using scale invariant feature transform and local derivative pattern. Optik 131:242–254Google Scholar
  19. 19.
    Guo JM, Prasetyo H (2015) Content-based image retrieval using features extracted from halftoning-based block truncation coding. IEEE Trans Image Process 24(3):1010–1024MathSciNetzbMATHGoogle Scholar
  20. 20.
    Guo JM, Prasetyo H, Chen JH (2015) Content-based image retrieval using error diffusion block truncation coding features. IEEE Trans Circ Syst Video Technol 25(3):466–481Google Scholar
  21. 21.
    Guo JM, Prasetyo H, Lee H, Yao CC (2016) Image retrieval using indexed histogram of void-and-cluster block truncation coding. Signal Process 123:143–156Google Scholar
  22. 22.
    Jenitta A, Ravindran RS (2017) Image retrieval based on local mesh vector co-occurrence pattern for medical diagnosis from MRI brain images. J Med Syst 41:157Google Scholar
  23. 23.
    Joshi SS (2016) Ordered dither block truncation coding for content based image retrieval using relevance feedback. IJECS 5(12):19339–19343Google Scholar
  24. 24.
    Joshi SS, Durugkar SR (2015) A review on ordered dither block truncation coding for content based image retrieval using relevance feedback. IJSER 6(11):491Google Scholar
  25. 25.
    Kandasamy A, Sundaram M (2018) Multi-layer multi-level color distribution –user feedback model with wavelet analysis for color image retrieval. Comput Electr Eng 67:825–835Google Scholar
  26. 26.
    Karine A, El Maliani AD, Hassouni ME (2018) A novel statistical model for content based stereo image retrieval in the complex wavelet domain. J Vis Commun Image Represent 50:27–39Google Scholar
  27. 27.
    Kasban H (2008) Detection of buried objects using acoustic waves. M. Sc. Thesis, Faculty of Electronic Engineering, Menoufia UniversityGoogle Scholar
  28. 28.
    Kasban H, Hashima S (2019) Adaptive radiographic image compression technique using hierarchical vector quantization and Huffman encoding. J Ambient Intell Humaniz Comput 10:2855–2867Google Scholar
  29. 29.
    Kasban H, Zahran O, Arafa H, El-Kordy M, Elaraby SMS, Abd El-Samie FM (2012) Quantitative and qualitative evaluation for gamma radiographic image enhancement. Int J Signal Proc Image Proc Patt Rec 5(2):73–87Google Scholar
  30. 30.
    Kato T (1992) Database architecture for content-based image retrieval. Proc SPIE Int Soc Optic Eng 16:112–113Google Scholar
  31. 31.
    Kaur J, Kaur R (2013) Biomedical images denoising using Symlet wavelet with wiener filter. IJERA 3(3):548–550Google Scholar
  32. 32.
    Kaur KP, Singh C (2016) A fast and efficient image retrieval system based on color and texture features. J Vis Commun Image Represent 41:225–238Google Scholar
  33. 33.
    Kekre HB, Thepade SD, Sanas SP (2010) Improved CBIR using multileveled block truncation coding. Int J Electron Comput Sci Eng 2(7):2471–2476Google Scholar
  34. 34.
    Khatami A, Babaie M, Tizhoosh HR, Khosravi A, Nguyen T, Nahavandi S (2018) A sequential search-space shrinking using CNN transfer learning and a radon projection pool for medical image retrieval. Expert Syst Appl 100:224–233Google Scholar
  35. 35.
    Khatami A, Babaie M, Khosravi A, Tizhoosh HR, Nahavandi S (2018) Parallel deep solutions for image retrieval from imbalanced medical imaging archives. Appl Soft Comput 63:197–205Google Scholar
  36. 36.
    Khemakhema MT, Gasmib K (2019) Document/query expansion based on selecting significant concepts for context based retrieval of medical images J Biomed Inform 95. doi: https://doi.org/10.1016/j.jbi.2019.103210 Google Scholar
  37. 37.
    Kitanovski I, Strezoski G, Dimitrovski I, Madjarov G, Loskovska S (2017) Multimodal medical image retrieval system. Multimed Tools Appl 76(2):2955–2978Google Scholar
  38. 38.
    Kumar A, Nette F, Klein K, Fulham M, Kim J (2015) A visual analytics approach using the exploration of multi-dimensional feature spaces for content-based medical image retrieval. IEEE J Biomed Health Inform 19(5):1734–1746Google Scholar
  39. 39.
    Kumar A, Dyer S, Kim J, Li C, Leong PHW, Fulham M, Feng D (2016) Adapting content-based image retrieval techniques for the semantic annotation of medical images. Comput Med Imag Grap 49:37–45Google Scholar
  40. 40.
    Kumara Y, Aggarwalb A, Tiwarib S, Singhc K (2018) An efficient and robust approach for biomedical image retrieval using Zernike moments. Biomed Signal Process Control 39:459–473Google Scholar
  41. 41.
    Kvasir database (2019) Available at https://datasets.simula.no/kvasir/ accessed 25 May 2019
  42. 42.
    Lan R, Wang H, Zhong S, Liu Z, Luo X (2018) An integrated scattering feature with application to medical image retrieval. Comput Electr Eng 69:669–675Google Scholar
  43. 43.
    Li C, Huang Y, Zhu L (2017) Color texture image retrieval based on Gaussian copula models of Gabor wavelets. Pattern Recogn 64:118–129Google Scholar
  44. 44.
    Liu Y, Pan Y, Lai H, Liu C, Yin J (2016) Margin-based two-stage supervised hashing for image retrieval. Neurocomputing 214:894–901Google Scholar
  45. 45.
    Mahajan VR, Khade A (2018) A survey: content based image retrieval using block truncation coding. Int J Adv Res Comput Sci Softw Eng 7(12):46–51Google Scholar
  46. 46.
    Mandal M, Chaudhary M, Vipparthi SK, Murala S, Gonde AB, Nagar SK (2019) ANTIC: antithetic isomeric cluster patterns for medical image retrieval and change detection. IET Comput Vis 13(1):31–43Google Scholar
  47. 47.
    Pogorelov K, Randel KR, Griwodz C, Eskeland SL, de Lange T, Johansen D, Spampinato C, Dang-Nguyen DT, Lux M, Schmidt PT (2017) Kvasir: a multi-class image dataset for computer aided gastrointestinal disease detection. Proceedings of the 8th ACM on multimedia systems conference, ACM, pp 164–169Google Scholar
  48. 48.
    Prasad BE, Gupta A, Toong HM, Madnick SE (1987) A microcomputer-based image database management system. IEEE Trans Ind Electron 34(1):83–88Google Scholar
  49. 49.
    Qayyum A, Anwar SM, Awais M, Majid M (2017) Medical image retrieval using deep convolutional neural network. Neurocomputing 266:8–20Google Scholar
  50. 50.
    Quellec G, Lamard M, Cazuguel G, Cochener B, Roux C (2010) Wavelet optimization for content-based image retrieval in medical databases. Med Image Anal 14:227–241zbMATHGoogle Scholar
  51. 51.
    Raghuwanshi G, Tyagi V (2016) Texture image retrieval using adaptive Tetrolet transforms. Digit Signal Proc 48:50–57MathSciNetGoogle Scholar
  52. 52.
    Reeves AP, Xie Y, Liu S (2017) Large-scale image region documentation for fully automated image biomarker algorithm development and evaluation. J Med Imaging 4(2):024505Google Scholar
  53. 53.
    Sakr NA, ELdesouky AI, Arafat H (2016) An efficient fast-response content-based image retrieval framework for big data. Comput Electr Eng 54:522–538Google Scholar
  54. 54.
    Shamna P, Govindan VK, Abdul Nazeer KA (2019) Content based medical image retrieval using topic and location model J Biomed Inform 91 doi: https://doi.org/10.1016/j.jbi.2019.103112 Google Scholar
  55. 55.
    Shinde A, Rahulkar A, Patil C (2019) Content based medical image retrieval based on new efficient local neighborhood wavelet feature descriptor. Biomed Eng Lett.  https://doi.org/10.1007/s13534-019-00112-0 Google Scholar
  56. 56.
    Singh VP, Srivastava R (2018) Automated and effective content-based mammogram retrieval using wavelet based CS-LBP feature and self-organizing map. Biocybern Biomed Eng 38(1):90–105Google Scholar
  57. 57.
    Song J, Guo Y, Gao L, Li X, Hanjalic A, Shen HT (2015) From deterministic to generative: multi-modal stochastic RNNs for video captioning. J Latex Class Files 14(8):1–10Google Scholar
  58. 58.
    Song J, Zhang H, Li X, Gao L, Wang M, Hong R (2018) Self-supervised video hashing with hierarchical binary auto-encoder. IEEE Trans Image Process 27(7):3210–3221MathSciNetzbMATHGoogle Scholar
  59. 59.
    Song J, He T, Gao L, Xu X, Hanjalic A, Shen HT (2018) Binary generative adversarial networks for image retrieval. In: Proceedings of the thirty-second AAAI conference on artificial intelligence, New Orleans, Louisiana, USA: 394–401Google Scholar
  60. 60.
    Srivastava P, Khare A (2017) Integration of wavelet transform, local binary patterns and moments for content-based image retrieval. J Vis Commun Image Represent 42:78–103Google Scholar
  61. 61.
    Strang G, Nguyen T (1997) Wavelets and filter banks”, Wellesley-Cambridge PressGoogle Scholar
  62. 62.
    Tang Q, Yang J, Xia X (2018) Medical image retrieval using multi-texton assignment. J Digit Imaging 31:107–116Google Scholar
  63. 63.
    Thangarasu J, Geetha P (2017) Content based image retrieval using quad tree block truncation coding with color co-occurrence feature for the big data platform. J Comput Theor Nanos 14(8):3874–3886Google Scholar
  64. 64.
    VIA ELCAP database (2019) Available at http://www.via.cornell.edu/lungdb.html accessed 25 May 2019
  65. 65.
    Vo A, Oraintara S (2010) A study of relative phase in complex wavelet domain: property, statistics and applications in texture image retrieval and segmentation. Signal Process Image Commun 25:28–46Google Scholar
  66. 66.
    Wang J, Wiederhold G, Firschein O, Wei S (1997) Content based image indexing and searching using Daubechies wavelets. Int J Digit Libr 4:311–328Google Scholar
  67. 67.
    Wang XY, Liang LL, Li WY, Li DM, Yang HY (2016) A new SVM-based relevance feedback image retrieval using probabilistic feature and weighted kernel function. J Vis Commun Image Represent 38:256–275Google Scholar
  68. 68.
    Wang X, Gao L, Wang P, Sun X, Liu X (2018) Two-stream 3D ConvNet fusion for action recognition in videos with arbitrary size and length. IEEE Trans Multimedia 20(3):634–644Google Scholar
  69. 69.
    Wang Y, Huang L, Guo S, Gong L, Bai T (2019) A novel MEDLINE topic indexing method using image presentation. J Vis Commun Image Represent 58:130–137Google Scholar
  70. 70.
    Wu H, Yan S (2016) Computing invariants of Tchebichef moments for shape based image retrieval. Neurocomputing 215:110–117Google Scholar
  71. 71.
    Yildizer E, Balci AM, Jarada TN, Alhajj R (2012) Integrating wavelets with clustering and indexing for effective content-based image retrieval. Knowl Based Syst 31:55–66Google Scholar
  72. 72.
    Zhou J, Liu X, Liu W, Gan J (2018) image retrieval based on effective feature extraction and diffusion process. Multimed Tools Appl, in press, 2018Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Engineering Department, Nuclear Research CenterAtomic Energy AuthorityCairoEgypt
  2. 2.National Center for Radiation Research and TechnologyAtomic Energy AuthorityCairoEgypt

Personalised recommendations