Abstract
Computer-aided prediction of dementia status (e.g., clinical scores of cognitive tests) from brain MRI is of great clinical value, as it can help assess pathological stage and predict disease progression. Existing learning-based approaches typically preselect dementia-sensitive regions from the whole-brain MRI for feature extraction and prediction model construction, which might be sub-optimal due to potential heterogeneities between different steps. Also, based on anatomical prior knowledge (e.g., brain atlas) and time-consuming nonlinear registration, these preselected brain regions are usually the same across all subjects, ignoring their individual specificities in dementia progression. In this paper, we propose a multi-task weakly-supervised attention network (MWAN) to jointly predict multiple clinical scores from the baseline MRI data, by explicitly considering individual specificities of different subjects. Leveraging a fully-trainable dementia attention block, our MWAN method can automatically identify subject-specific discriminative locations from the whole-brain MRI for end-to-end feature learning and multi-task regression. We evaluated our MWAN method by cross-validation on two public datasets (i.e., ADNI-1 and ADNI-2). Experimental results demonstrate that the proposed method performs well in both the tasks of clinical score prediction and weakly-supervised discriminative localization in brain MR images.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
References
Baron, J., et al.: In vivo mapping of gray matter loss with voxel-based morphometry in mild Alzheimer’s disease. NeuroImage 14(2), 298–309 (2001)
Frisoni, G.B., et al.: The clinical use of structural MRI in Alzheimer disease. Nat. Rev. Neurol. 6(2), 67 (2010)
Jagust, W.: Vulnerable neural systems and the borderland of brain aging and neurodegeneration. Neuron 77(2), 219–234 (2013)
Lian, C., et al.: Hierarchical fully convolutional network for joint atrophy localization and Alzheimer’s disease diagnosis using structural MRI. IEEE Trans. Pattern Anal. Mach. Intell. (2019, in press). https://doi.org/10.1109/TPAMI.2018.2889096
Liu, M., et al.: Joint classification and regression via deep multi-taskmulti-channel learning for Alzheimer’s disease diagnosis. IEEE Trans. Biomed. Eng. 66, 1195–1206 (2018)
Liu, M., et al.: Weakly supervised deep learning for brain disease prognosis using MRI and incomplete clinical scores. IEEE Trans. Cybern. (2019, in press). https://doi.org/10.1109/TCYB.2019.2904186
O’Bryant, S.E., et al.: Staging dementia using clinical dementia rating scale sum of boxes scores: a Texas Alzheimer’s research consortium study. Arch. Neurol. 65(8), 1091–1095 (2008)
Rathore, S., et al.: A review on neuroimaging-based classification studies and associated feature extraction methods for Alzheimer’s disease and its prodromal stages. NeuroImage 155, 530–548 (2017)
Sabuncu, M.R., et al.: Clinical prediction from structural brain MRI scans: a large-scale empirical study. Neuroinformatics 13(1), 31–46 (2015)
Yang, J., et al.: Weakly supervised coupled networks for visual sentiment analysis. In: CVPR, pp. 7584–7592 (2018)
Zhang, J., et al.: Detecting anatomical landmarks for fast Alzheimer’s disease diagnosis. IEEE Trans. Med. Imaging 35(12), 2524–2533 (2016)
Zhou, B., et al.: Learning deep features for discriminative localization. In: CVPR, pp. 2921–2929. IEEE (2016)
Zhou, J., et al.: Modeling disease progression via multi-task learning. NeuroImage 78, 233–248 (2013)
Acknowledgements
This work was supported in part by NIH grants (EB008374, AG041721, AG042599, and EB022880).
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Lian, C., Liu, M., Wang, L., Shen, D. (2019). End-to-End Dementia Status Prediction from Brain MRI Using Multi-task Weakly-Supervised Attention Network. In: Shen, D., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. MICCAI 2019. Lecture Notes in Computer Science(), vol 11767. Springer, Cham. https://doi.org/10.1007/978-3-030-32251-9_18
Download citation
DOI: https://doi.org/10.1007/978-3-030-32251-9_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32250-2
Online ISBN: 978-3-030-32251-9
eBook Packages: Computer ScienceComputer Science (R0)