Abstract
Behavioral Partial-Least Squares (pls) is often used to analyze ill-posed functional Magnetic Resonance Imaging (f mri) datasets, for which the number of variables are far larger than the number of observations. This procedure generates a latent variable (LV) brain map, showing brain regions that are most correlated with behavioral measures. The strength of the behavioral relationship is measured by the correlation between behavior and LV scores in the data. For standard behavioral pls, bootstrap resampling is used to evaluate the reliability of the brain LV and its behavioral correlations. However, the bootstrap may provide biased measures of the generalizability of results across independent datasets. We used split-half resampling to obtain unbiased measures of brain-LV reproducibility and behavioral prediction of the pls model, for independent data. We show that bootstrapped pls gives biased measures of behavioral correlations, whereas split-half resampling identifies highly stable activation peaks across single resampling splits. The ill-posed pls solution can also be improved by regularization; we consistently improve the prediction accuracy and spatial reproducibility of behavioral estimates by (1) projecting f mri data onto an optimized pca basis, and (2) optimizing data preprocessing on an individual subject basis. These results show that significant improvements in generalizability and brain pattern stability are obtained with split-half versus bootstrapped resampling of pls results, and that model performance can be further improved by regularizing the input data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
D. Wilkinson, and P. Halligan, “The relevance of behavioral measures for functional-imaging studies of cognition,” Nature Review Neuroscience 5, pp. 67–73, 2004.
A. R. McIntosh, “Mapping cognition to the brain through neural interactions,” Memory 7, pp. 523–548, 1999.
A. Krishnan, L. J. Williams, A. R. McIntosh, and H. Abdi, “Partial Least Squares (PLS) methods for neuroimaging: A tutorial and review,” Neuroimage 56, pp. 455–475, 2011.
N. Morch, L. K. Hansen, S. C. Strother, C. Svarer, D. A. Rottenberg, B. Lautrup, R. Savoy, and O. B. Paulson, “Nonlinear versus linear models in functional neuroimaging: Learning curves and generalization crossover,” Information Processing in Medical Imaging, J. Duncan and G. Gindi, eds.; Springer-Verlag, New York, pp. 259–270, 1997.
A. J. O’Toole, F. Jiang, H. Abdi, N. Pénard, J. P. Dunlop, and M. A. Parent, “Theoretical, statistical, and practical perspectives on pattern-based classification approaches to the analysis of functional neuroimaging data,” Journal of Cognitive Neuroscience 19, pp. 1735–1752, 2007.
S. C. Strother, J. Anderson, L. K. Hansen, U. Kjems, R. Kustra, J. Sidtis, S. Frutiger, S. Muley, S. LaConte, and D. Rottenberg, “The quantitative evaluation of functional neuroimaging experiments: the npairs data analysis framework,” Neuroimage 15, pp. 747–771, 2002.
S. C. Strother, S. LaConte, L. K. Hansen, J. Anderson, J. Zhang, S. Pulapura, and D. Rottenberg, “Optimizing the f mri data-processing pipeline using prediction and reproducibility performance metrics: I. A preliminary group analysis,” Neuroimage 23 Suppl 1, pp. S196–S207, 2004.
S. C. Strother, “Evaluating fMRI preprocessing pipelines,” IEEE Engineering in Medicine and Biology Magazine 25, pp. 27–41, 2006
H. Abdi, J. P. Dunlop, and L. J. Williams, “How to compute reliability estimates and display confidence and tolerance intervals for pattern classifiers using the Bootstrap and 3-way multidimensional scaling (DISTATIS),” Neuroimage 45, pp. 89–95, 2009.
S. Strother, A. Oder, R. Spring, and C. Grady, “The npairs Computational statistics framework for data analysis in neuroimaging,” presented at the 19th International Conference on Computational Statistics, Paris, France, 2010.
R. Kustra, and S. C. Strother, “Penalized discriminant analysis of [15O]-water PET brain images with prediction error selection of smoothness and regularization hyperparameters,” IEEE Transactions in Medical Imaging 20, pp. 376–387, 2001.
N. Meinshausen, and P. Bühlmann, “Stability selection,” Journal of the Royal Statistical Society: Series B (Statistical Methodology) 72, pp. 417–473, 2010.
K. V. Mardia, J. T. Kent, and J. M. Bibby, Multivariate Analysis, Academic Press, London, 1979.
H. Abdi, “Partial least squares regression and projection on latent structure regression (PLS Regression),” WIREs Computational Statistics 2, pp. 97–106, 2010.
J. G. Snodgrass, and M. Vanderwart, “A standardized set of 260 pictures: norms for name agreement, image agreement, familiarity, and visual complexity,” Journal of Experimental Psychology: Human Learning 6, pp. 174–215, 1980.
C. Grady, M. Springer, D. Hongwanishkul, A. R. McIntosh, and G. Winocur, “Age-related changes in brain activity across the adult fifespan: A failure of inhibition?,” Journal of Cognitive Neuroscience 18, pp. 227–241, 2006.
F. Tam, N. W. Churchill, S. C. Strother, and S. J. Graham, “A new tablet for writing and drawing during functional MRI,” Human Brain Mapping 32, pp. 240–248, 2011.
N. W. Churchill, A. Oder, H. Abdi, F. Tam, W. Lee, C. Thomas, J. E. Ween, S. J. Graham, and S. C. Strother, “Optimizing preprocessing and analysis pipelines for single-subject f mri: I. Standard temporal motion and physiological noise correction methods,” Human Brain Mapping 33, pp. 609–627, 2012.
N. W. Churchill, G. Yourganov, A. Oder, F. Tam, S. J. Graham, and S. C. Strother, “Optimizing preprocessing and analysis pipelines for single-subject fMRI: 2. Interactions with ICA, PCA, task contrast and inter-subject heterogeneity,” PLoS One 7, (e31147), 2012.
H. Abdi, “Singular value decomposition (svd) and generalized singular value decomposition (gsvd),” in Encyclopedia of Measurement and Statistics, N. Salkind, ed., pp. 907–912, Sage, Thousand Oaks, 2007.
K. A. Bollen, and R. W. Jackman, “Regression diagnostics: An expository treatment of outliers and influential cases,” in J. Fox, and J.S. Long, (eds.), Modern Methods of Data Analysis, pp. 257–291. Sage, Newbury Park, 2012.
P. M. Rasmussen, L. K. Hansen, K. H. Madsen, N. W. Churchill, and S. C. Strother, “Pattern reproducibility, interpretability, and sparsity in classification models in neuroimaging,” Pattern Recognition 45, pp. 2085–2100, 2012.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer Science+Business Media New York
About this paper
Cite this paper
Churchill, N., Spring, R., Abdi, H., Kovacevic, N., McIntosh, A.R., Strother, S. (2013). The Stability of Behavioral PLS Results in Ill-Posed Neuroimaging Problems. In: Abdi, H., Chin, W., Esposito Vinzi, V., Russolillo, G., Trinchera, L. (eds) New Perspectives in Partial Least Squares and Related Methods. Springer Proceedings in Mathematics & Statistics, vol 56. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-8283-3_11
Download citation
DOI: https://doi.org/10.1007/978-1-4614-8283-3_11
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-8282-6
Online ISBN: 978-1-4614-8283-3
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)