Feature Selection for Decoding of Cognitive States in Multiple-Subject Functional Magnetic Resonance Imaging Data

Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 174)


The last two decades have seen a surge in the interest in research based on Functional Magnetic Resonance Imaging (fMRI) data. Decoding of cognitive states based on fMRI activation profiles has become a very active topic in this area. fMRI data is very high dimensional and noisy. However, there is a dearth of datasets to work on. Sharing of learning by analyzing datasets drawn across multiple subjects in an experiment can help in increasing the amount of data we have for analysis. Decoding of cognitive states using classifiers trained across multiple subjects is a challenging task because of differences in anatomy and cognition. Selecting features to analyze from the dataset is a key step in the analysis of fMRI data. In this paper we apply PCA, ICA and five non-linear dimensionality reduction techniques to the fMRI data. The aim of this work is to analyze which technique can provide the best feature selection to capture the commonality across multiple subjects. The reduced datasets are then used to train classifiers to solve a multiple-subject decoding problem.


Feature Selection Independent Component Analysis Cognitive State Canonical Correlation Analysis Feature Selection Method 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Cox, D.D., Savoy, R.L.: Functional magnetic resonance imaging (fMRI) ‘brain reading’: detecting and classifying distributed patterns of fMRI activity in human visual cortex. Neuroimage 19, 261–270 (2003)CrossRefGoogle Scholar
  2. 2.
    Davatzikos, C., et al.: Classifying spatial patterns of brain activity with machine learning methods: application to lie detection. Neuroimage 28, 663–668 (2005)CrossRefGoogle Scholar
  3. 3.
    Haynes, J., Rees, G.: Decoding mental states from brain activity in humans. Nature Reviews Neuroscience 7, 523–534 (2006)CrossRefGoogle Scholar
  4. 4.
    Haynes, J.D., Rees, G.: Predicting the orientation of invisible stimuli from activity in human primary visual cortex. Nature Neuroscience 8, 686–691 (2005)CrossRefGoogle Scholar
  5. 5.
    Hyvarinen, A.: Fast and Robust Fixed-Point Algorithms for Independent Component Analysis. IEEE Transactions on Neural Networks 10(3), 626–634 (1999), http://research.ics.tkk.fi/ica/fastica/ (accessed March 15, 2012)CrossRefGoogle Scholar
  6. 6.
    Rustandi, I., Just, M.A., Mitchell, T.M.: Integrating multiple- study multiple-subject fMRI datasets using canonical correlation analysis. In: Proceedings of the MICCAI Workshop: Statistical Modeling and Detection Issues in Intra- and Inter-Subject Functional MRI Data Analysis (2009)Google Scholar
  7. 7.
    Just, M.A., Cherkassky, V.L., Aryal, S., Mitchell, T.M.: A Neurosemantic Theory of Concrete Noun Representation Based on the Underlying Brain Codes. PLoS ONE 5(1), e8622 (2010)Google Scholar
  8. 8.
    Chang, K.K., et al.: Quantitative modeling of the neural representation of adjective-noun phrases to account for fMRI activation. In: Proceedings of the 47th Annual Meeting of the ACL and the 4th IJCNLP of the AFNLP, pp. 638–646 (2009)Google Scholar
  9. 9.
    Kamitani, Y., Tong, F.: Decoding the visual and subjective contents of the human brain. Nature Neuroscience 8, 679–685 (2005)CrossRefGoogle Scholar
  10. 10.
    Kamitani, Y., Tong, F.: Decoding seen and attended motion directions from activity in the human visual cortex. Current Biology 16, 1096–1102 (2006)CrossRefGoogle Scholar
  11. 11.
    Kay, K.N., et al.: Identifying natural images from human brain activity. Nature 452, 352 (2008)CrossRefGoogle Scholar
  12. 12.
    Knops, A., et al.: Recruitment of an area involved in eye movements during mental arithmetic. Science 324, 1583–1585 (2009)CrossRefGoogle Scholar
  13. 13.
    Mitchell, T.M., et al.: Learning to decode cognitive states from brain images. Machine Learning 5, 145–175 (2004)CrossRefGoogle Scholar
  14. 14.
    Mitchell, T.M., et al.: Predicting human brain activity associated with the meanings of nouns. Science 320, 1191 (2008)CrossRefGoogle Scholar
  15. 15.
    Miyawaki, Y., et al.: Visual image reconstruction from human brain activity using a combination of multiscale local image decoders. Neuron 60, 915–929 (2008), doi:10.1016/j.neuron.2008.11.004CrossRefGoogle Scholar
  16. 16.
    Nishimoto, et al.: Reconstructing Visual Experiences from Brain Activity Evoked by Natural Movies. Current Biology (2011), doi:10.1016/j.cub.2011.08.031 Google Scholar
  17. 17.
    Norman, K.A., Polyn, S.M., Detre, G.J., Haxby, J.V.: Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends in Cognitive. Science 10, 424–430 (2006)CrossRefGoogle Scholar
  18. 18.
    Otoole, A.J., et al.: Theoretical, statistical, and practical perspectives on pattern-based classification approaches to functional neuroimaging analysis. Journal of Cognitive Neuroscience 19, 1735–1752 (2007)CrossRefGoogle Scholar
  19. 19.
    Palatucci, M., Pomerleau, D., Hinton, G., Mitchell, T.: Zero-shot learning with semantic output codes. In: NIPS 2009 (2009)Google Scholar
  20. 20.
    Pessoa, L., Padmala, S.: Quantitative prediction of perceptual decisions during near-threshold fear detection. Proceedings of the National Academy of Sciences, USA 102, 5612–5617 (2005)CrossRefGoogle Scholar
  21. 21.
    Roweis, S., Saul, L.: Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500), 2323–2326 (2000), http://cs.nyu.edu/~roweis/lle/ (accessed March 8, 2012)CrossRefGoogle Scholar
  22. 22.
    Shinkareva, S.V., et al.: Using fMRI Brain Activation to Identify Cognitive States Associated with Perception of Tools and Dwellings. PLoS ONE 3(1), e1394 (2008), doi:10.1371/journal.pone.0001394 Google Scholar
  23. 23.
    Tenenbaum, J.B., de Silva, V., Langford, J.C.: A Global Geometric Framework for Nonlinear Dimensionality Reduction. Science 290(5500), 2319–2323 (2000), http://isomap.stanford.edu/ (accessed March 10, 2012)CrossRefGoogle Scholar
  24. 24.
    Thirion, B., et al.: Inverse retinotopy: inferring the visual content of images from brain activation patterns. Neuroimage 33, 1104–1116 (2006)CrossRefGoogle Scholar
  25. 25.
    Van der Maaten, L.J.P., Postma, E.O., Van den Herik, H.J.: Dimensionality reduction: A comparative review, Technical Report TiCC TR 2009-005Google Scholar
  26. 26.
    Wang, X., Hutchinson, R., Mitchel, T.M.: Training fMRI Classifiers to Detect Cognitive States across Multiple Human Subjects. In: NIPS 2003 (2003)Google Scholar

Copyright information

© Springer India 2013

Authors and Affiliations

  1. 1.BMS Research CenterB M S C EBangaloreIndia

Personalised recommendations