Environmental microorganism classification using optimized deep learning model

Abstract

Rapid environmental microorganism (EM) classification under microscopic images would help considerably identify water quality. Because of the development of artificial intelligence, a deep convolutional neural network (CNN) has become a major solution for image classification. Three popular CNNs, referred to as ResNet50, Vgg16, and Inception-v3, were transferred to identify the EM images present on the Environmental Microorganism Dataset (EMDS), and EMAD was the small dataset, which only has 294 EM images with 21 EM classes. Besides data augmentation, optimizing the fully connected layer of CNN, i.e., both optimally fine-tuned neuron number and dropout rate, was adopted to enhance the performance produced by CNN. The discussions on the causes of the accuracy improved by optimization are also provided. The results showed that the Inception-v3 model obtained 84.9% of the accuracy and performed better than the other two famous CNNs. Also, the implement of data augmentation enhanced the performance of Inception-v3 on EMDS. To add to that, the optimized Inception-v3 model archived 90.5% of the accuracy, and this result demonstrated the improvement effect obtained by using genetic algorithm (GA) to optimize the fully connected layer of the Inception-v3. Therefore, the optimize Inception-v3 with data augmentation process obtained the accuracy of 92.9% and improved almost 21% higher than that obtained from the famous Vgg16. In addition, the optimized Inception-v3 would need less neurons, when compared with that of the optimized Vgg16 possibly. This optimized Inception-v3 could provide a solution to the EM classification in microscope with a digital camera system.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Data availability

Not applicable.

References

  1. Aggarwal CC (2015) Outlier analysis, Data mining. Springer, pp.:237–263

  2. Al-Hyari A, Areibi S (2017) Design space exploration of convolutional neural networks based on evolutionary algorithms. Journal of Computational Vision and Imaging Systems:3

  3. Chen H-W, Chen W-Y, Wang C-T, Lin Y-H, Deng M-J, Chiang C-Y (2019): Managing water quality in a river basin with uncertainty. International Journal of Environmental Science and Technology, 1-12

  4. Chen J, Chen J, Zhang D, Sun Y, Nanehkaran YA (2020) Using deep transfer learning for image-based plant disease identification. Computers and Electronics in Agriculture 173:105393

    Article  Google Scholar 

  5. Ju Y, Sun G, Chen Q, Zhang M, Zhu H, Rehman MU (2019) A model combining convolutional neural network and LightGBM algorithm for ultra-short-term wind power forecasting. IEEE Access 7:28309–28318

    Article  Google Scholar 

  6. Kornblith S, Lee H, Chen T, Norouzi M (2020): What's in a loss function for image classification? arXiv preprint arXiv:2010.16402

  7. Kosov S, Shirahama K, Li C, Grzegorzek M (2018) Environmental microorganism classification using conditional random fields and deep convolutional neural networks. Pattern Recognition 77:248–261

    Article  Google Scholar 

  8. Kylili K, Kyriakides I, Artusi A, Hadjistassou C (2019) Identifying floating plastic marine debris using a deep learning approach. Environmental Science and Pollution Research 26:17091–17099

    Article  Google Scholar 

  9. Kylili K, Hadjistassou C, Artusi A (2020) An intelligent way for discerning plastics at the shorelines and the seas. Environmental Science and Pollution Research:1–13

  10. Lee B, Yoon S, Lee JW, Kim Y, Chang J, Yun J, Ro JC, Lee J-S, Lee JH (2020): Statistical characterization of the morphologies of nanoparticles through machine learning based electron microscopy image analysis. ACS nano

    Google Scholar 

  11. Mao W-L, Chen W-C, Wang C-T, Lin Y-H (2021) Recycling waste classification using optimized convolutional neural network. Resources, Conservation and Recycling 164:105132

    Article  Google Scholar 

  12. Nag S, Mondal A, Roy DN, Bar N, Das SK (2018) Sustainable bioremediation of Cd(II) from aqueous solution using natural waste materials: kinetics, equilibrium, thermodynamics, toxicity studies and GA-ANN hybrid modelling. Environmental Technology & Innovation 11:83–104

    Article  Google Scholar 

  13. Pan SJ, Yang Q (2009) A survey on transfer learning. IEEE Transactions on knowledge and data engineering 22:1345–1359

    Article  Google Scholar 

  14. Pereira S, Pinto A, Alves V, Silva CA (2015) Deep convolutional neural networks for the segmentation of gliomas in multi-sequence MRI, BrainLes 2015. Springer, pp.:131–143

  15. Perez L, Wang J (2017) The effectiveness of data augmentation in image classification using deep learning. arXiv preprint arXiv:1712.04621

  16. Połap D, Woźniak M (2019): Bacteria shape classification by the use of region covariance and convolutional neural network, 2019 International Joint Conference on Neural Networks (IJCNN). IEEE, pp. 1-7

  17. Połap D (2020) An adaptive genetic algorithm as a supporting mechanism for microscopy image analysis in a cascade of convolution neural networks. Applied Soft Computing 97:106824

    Article  Google Scholar 

  18. Qu Z, Yuan S, Chi R, Chang L, Zhao L (2019) Genetic optimization method of pantograph and catenary comprehensive monitor status prediction model based on adadelta deep neural network. IEEE Access 7:23210–23221

    Article  Google Scholar 

  19. Rattanavorragant R, Jewajinda Y (2019): A hyper-parameter optimization for deep neural network using an island-based genetic algorithm, 2019 16th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON). IEEE, pp. 73-76

  20. Sajadi S, Fathi A (2020) Genetic algorithm based local and global spectral features extraction for ear recognition. Expert Systems with Applications 159:113639

    Article  Google Scholar 

  21. Sun L, Yan H, Xin K, Tao T (2019) Contamination source identification in water distribution networks using convolutional neural network. Environmental Science and Pollution Research 26:36786–36797

    Article  Google Scholar 

  22. Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016): Rethinking the inception architecture for computer vision, Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2818-2826

  23. Theckedath D, Sedamkar R (2020) Detecting affect states using VGG16, ResNet50 and SE-ResNet50 networks. SN Computer Science 1:1–7

    Article  Google Scholar 

  24. Wang C, Chen D, Hao L, Liu X, Zeng Y, Chen J, Zhang G (2019) Pulmonary image classification based on inception-v3 transfer learning model. IEEE Access 7:146533–146541

    Article  Google Scholar 

  25. Xu G, Zhu X, Fu D, Dong J, Xiao X (2017) Automatic land cover classification of geo-tagged field photos by deep learning. Environmental Modelling & Software 91:127–134

    Article  Google Scholar 

  26. Zeiler MD (2012): ADADELTA: an adaptive learning rate method. arXiv preprint arXiv:1212.5701

  27. Zhang Z, Sabuncu M (2018) Generalized cross entropy loss for training deep neural networks with noisy labels. Advances in neural information processing systems 31:8778–8788

    Google Scholar 

  28. Zhao B, Huang B, Zhong Y (2017) Transfer learning with fully pretrained deep convolution networks for land-use classification. IEEE Geoscience and Remote Sensing Letters 14:1436–1440

    Article  Google Scholar 

  29. Zou Y, Li C, Shirahama K, Jiang T, Grzegorzek M (2016): Environmental microorganism image retrieval using multiple colour channels fusion and particle swarm optimisation, 2016 IEEE International Conference on Image Processing (ICIP). IEEE, pp. 2475-2479

Download references

Acknowledgments

I owe a debt of gratitude and thanks to Dr. Ping-Yu Liu, who provided me with the help related to the editorial assistance and the English language editing.

Funding

The authors would like to extend special thanks to the National Science Council of Taiwan for the partial financial support of this research under Project MOST 108-2218-E-224-004-MY3.

Author information

Affiliations

Authors

Contributions

Conceptualization: Chih-Ming Liang, and Yu-Hao Lin

Investigation: Chih-Ming Liang, and Yu-Hao Lin

Methodology: Chih-Ming Liang, Chun-Chi Lai, Szu-Hong Wang, and Yu-Hao Lin

Software: Yu-Hao Lin, and Szu-Hong Wang

Supervision: Yu-Hao Lin

Validation: Chun-Chi Lai, and Szu-Hong Wang

Resources: Chun-Chi Lai, Szu-Hong Wang, and Yu-Hao Lin

Writing—Original draft: Chih-Ming Liang

Writing—Review and editing: Chun-Chi Lai, and Yu-Hao Lin

Corresponding author

Correspondence to Yu-Hao Lin.

Ethics declarations

Ethics approval

Not applicable.

Consent to participate

Not applicable.

Consent for publication

Not applicable.

Conflict of interest

The authors declare no competing interests.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Responsible Editor: Robert Duran

Supplementary Information

ESM 1

(DOCX 116 kb)

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Liang, CM., Lai, CC., Wang, SH. et al. Environmental microorganism classification using optimized deep learning model. Environ Sci Pollut Res (2021). https://doi.org/10.1007/s11356-021-13010-9

Download citation

Keywords

  • Deep learning
  • Genetic algorithm (GA)
  • Convolutional neural network (CNN)
  • Transfer learning
  • Environmental microorganism
  • Artificial intelligence (AI)