Deep Convolutional Neural Networks for Automated Diagnosis of Alzheimer’s Disease and Mild Cognitive Impairment Using 3D Brain MRI

  • Jyoti IslamEmail author
  • Yanqing Zhang
  • for the Alzheimer’s Disease Neuroimaging Initiative*
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11309)


We consider the automated diagnosis of Alzheimer’s Disease (AD) and Mild Cognitive Impairment (MCI) in 3D structural MRI brain scans. We develop an efficient deep convolutional neural network (CNN) based classifier by analyzing 3D brain MRI. The proposed model extracts features from the MRI scans and learns significant information related to Alzheimer’s Disease (AD) and Mild Cognitive Impairment (MCI). We perform motion correction, non-uniform intensity normalization, Talairach transform, intensity normalization, and skull-stripping in the raw MRI scans. After that several 2D slices are generated, and center patch is cropped from the slices before passing them to the CNN classifier. Besides, we demonstrate ways to improve the performance of a CNN classifier for AD and MCI diagnosis. We conduct experiments using Alzheimer’s Disease Neuroimaging Initiative (ADNI) dataset for classification of the AD, MCI and CN (normal/healthy controls) to evaluate the proposed model. The proposed model achieves 94.97% accuracy for AD/CN classification and 91.98% accuracy for AD/MCI classification outperforming baseline models and several competing methods from other studies.


Deep learning Convolutional neural network Alzheimer’s Disease MRI Brain imaging 



This study was supported by Brains and Behavior (B&B) Fellowship program from Neuroscience Institute of Georgia State University.

Data collection and sharing for this project was funded by the Alzheimer’s Disease Neuroimaging Initiative (ADNI) (National Institutes of Health Grant U01 AG024904) and DOD ADNI (Department of Defense award number W81XWH–12–2–0012). ADNI is funded by the National Institute on Aging, the National Institute of Biomedical Imaging and Bioengineering, and through generous contributions from the following: AbbVie, Alzheimer’s Association; Alzheimer’s Drug Discovery Foundation; Araclon Biotech; BioClinica, Inc.; Biogen; Bristol-Myers Squibb Company; CereSpir, Inc.; Cogstate; Eisai Inc.; Elan Pharmaceuticals, Inc.; Eli Lilly and Company; EuroImmun; F. Hoffmann-La Roche Ltd and its affiliated company Genentech, Inc.; Fujirebio; GE Healthcare; IXICO Ltd.; Janssen Alzheimer Immunotherapy Research & Development, LLC.; Johnson & Johnson Pharmaceutical Research & Development LLC.; Lumosity; Lundbeck; Merck & Co., Inc.; Meso Scale Diagnostics, LLC.; NeuroRx Research; Neurotrack Technologies; Novartis Pharmaceuticals Corporation; Pfizer Inc.; Piramal Imaging; Servier; Takeda Pharmaceutical Company; and Transition Therapeutics. The Canadian Institutes of Health Research is providing funds to support ADNI clinical sites in Canada. Private sector contributions are facilitated by the Foundation for the National Institutes of Health ( The grantee organization is the Northern California Institute for Research and Education, and the study is coordinated by the Alzheimer’s Therapeutic Research Institute at the University of Southern California. ADNI data are disseminated by the Laboratory for Neuro Imaging at the University of Southern California.


  1. 1.
    Aderghal, K., Benois-Pineau, J., Afdel, K.: Classification of SMRI for Alzheimer’s disease diagnosis with CNN: single Siamese networks with 2d+? approach and fusion on ADNI. In: Proceedings of the 2017 ACM on International Conference on Multimedia Retrieval, pp. 494–498. ACM (2017)Google Scholar
  2. 2.
    Beheshti, I., Demirel, H., Matsuda, H., Initiative, A.D.N., et al.: Classification of Alzheimer’s disease and prediction of mild cognitive impairment-to-Alzheimer’s conversion from structural magnetic resource imaging using feature ranking and a genetic algorithm. Comput. Biol. Med. 83, 109–119 (2017)CrossRefGoogle Scholar
  3. 3.
    Brosch, T., Tam, R., For the Alzheimer’s Disease Neuroimaging Initiative: Manifold learning of brain MRIs by deep learning. In: Mori, K., Sakuma, I., Sato, Y., Barillot, C., Navab, N. (eds.) MICCAI 2013. LNCS, vol. 8150, pp. 633–640. Springer, Heidelberg (2013). Scholar
  4. 4.
    Cárdenas-Peña, D., Collazos-Huertas, D., Castellanos-Dominguez, G.: Centered kernel alignment enhancing neural network pretraining for MRI-based dementia diagnosis. Comput. Math. Methods Med. 2016, 10 pages (2016)Google Scholar
  5. 5.
    Gupta, A., Ayhan, M., Maida, A.: Natural image bases to represent neuroimaging data. In: International Conference on Machine Learning, pp. 987–994 (2013)Google Scholar
  6. 6.
    Hosseini-Asl, E., Keynton, R., El-Baz, A.: Alzheimer’s disease diagnostics by adaptation of 3d convolutional network. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 126–130. IEEE (2016)Google Scholar
  7. 7.
    Huang, G., Liu, Z., van der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017)Google Scholar
  8. 8.
    Islam, J., Zhang, Y.: Brain MRI analysis for Alzheimer’s disease diagnosis using an ensemble system of deep convolutional neural networks. Brain Inform. 5(2), 2 (2018)CrossRefGoogle Scholar
  9. 9.
    Islam, J., Zhang, Y.: Visual sentiment analysis for social images using transfer learning approach. In: 2016 IEEE International Conferences on Big Data and Cloud Computing (BDCloud), Social Computing and Networking (SocialCom), Sustainable Computing and Communications (SustainCom) (BDCloud-SocialCom-SustainCom), pp. 124–130. IEEE (2016)Google Scholar
  10. 10.
    Islam, J., Zhang, Y.: An ensemble of deep convolutional neural networks for Alzheimer’s disease detection and classification. arXiv preprint arXiv:1712.01675 (2017)
  11. 11.
    Islam, J., Zhang, Y.: A novel deep learning based multi-class classification method for Alzheimer’s Disease detection using brain MRI data. In: Zeng, Y., et al. (eds.) BI 2017. LNCS, vol. 10654, pp. 213–222. Springer, Cham (2017). Scholar
  12. 12.
    Islam, J., Zhang, Y.: Early diagnosis of Alzheimer’s disease: a neuroimaging study with deep learning architectures. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 1881–1883 (2018)Google Scholar
  13. 13.
    Jack, C.R., et al.: The Alzheimer’s disease neuroimaging initiative (ADNI): MRI methods. J. Magn. Reson. Imaging 27(4), 685–691 (2008)CrossRefGoogle Scholar
  14. 14.
    Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)
  15. 15.
    Korolev, S., Safiullin, A., Belyaev, M., Dodonova, Y.: Residual and plain convolutional neural networks for 3d brain MRI classification. In: 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017), pp. 835–838. IEEE (2017)Google Scholar
  16. 16.
    Liu, F., Shen, C.: Learning deep convolutional features for MRI based Alzheimer’s disease classification. arXiv preprint arXiv:1404.3366 (2014)
  17. 17.
    Liu, M., Zhang, D., Shen, D., Alzheimer’s Disease Neuroimaging Initiative: Hierarchical fusion of features and classifier decisions for Alzheimer’s disease diagnosis. Hum. Brain Mapp. 35(4), 1305–1319 (2014)Google Scholar
  18. 18.
    Marcus, D.S., Wang, T.H., Parker, J., Csernansky, J.G., Morris, J.C., Buckner, R.L.: Open access series of imaging studies (OASIS): cross-sectional MRI data in young, middle aged, nondemented, and demented older adults. J. Cogn. Neurosci. 19(9), 1498–1507 (2007)CrossRefGoogle Scholar
  19. 19.
    Payan, A., Montana, G.: Predicting Alzheimer’s disease: a neuroimaging study with 3d convolutional neural networks. arXiv preprint arXiv:1502.02506 (2015)
  20. 20.
    Russakovsky, O., et al.: ImageNet large scale visual recognition challenge. Int. J. Comput. Vis. (IJCV) 115(3), 211–252 (2015)MathSciNetCrossRefGoogle Scholar
  21. 21.
    Sarraf, S., Anderson, J., Tofighi, G.: DeepAD: Alzheimer’s disease classification via deep convolutional neural networks using MRI and fMRI. bioRxiv, p. 070441 (2016)Google Scholar
  22. 22.
    Sarraf, S., Tofighi, G.: Classification of Alzheimer’s disease using fMRI data and deep learning convolutional neural networks. arXiv preprint arXiv:1603.08631 (2016)
  23. 23.
    Shi, B., et al.: Nonlinear feature transformation and deep fusion for Alzheimer’s disease staging analysis. Pattern Recognit. 63, 487–498 (2017)CrossRefGoogle Scholar
  24. 24.
    Suk, H.I., Lee, S.W., Shen, D.: Deep ensemble learning of sparse regression models for brain disease diagnosis. Med. Image Anal. 37, 101–113 (2017)CrossRefGoogle Scholar
  25. 25.
    Suk, H.I., Lee, S.W., Shen, D., Alzheimer’s Disease Neuroimaging Initiative: Hierarchical feature representation and multimodal fusion with deep learning for ad/MCI diagnosis. NeuroImage 101, 569–582 (2014)CrossRefGoogle Scholar
  26. 26.
    Suk, H.-I., Shen, D., Alzheimer’s Disease Neuroimaging Initiative: Deep learning in diagnosis of brain disorders. In: Lee, S.-W., Bülthoff, H.H., Müller, K.-R. (eds.) Recent Progress in Brain and Cognitive Engineering. TAHP, vol. 5, pp. 203–213. Springer, Dordrecht (2015). Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Jyoti Islam
    • 1
    Email author
  • Yanqing Zhang
    • 1
  • for the Alzheimer’s Disease Neuroimaging Initiative*
  1. 1.Georgia State UniversityAtlantaUSA

Personalised recommendations