Skip to main content

Multi-Class Sparse Bayesian Regression for Neuroimaging Data Analysis

  • Conference paper
Machine Learning in Medical Imaging (MLMI 2010)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 6357))

Included in the following conference series:

Abstract

The use of machine learning tools is gaining popularity in neuroimaging, as it provides a sensitive assessment of the information conveyed by brain images. In particular, finding regions of the brain whose functional signal reliably predicts some behavioral information makes it possible to better understand how this information is encoded or processed in the brain. However, such a prediction is performed through regression or classification algorithms that suffer from the curse of dimensionality, because a huge number of features (i.e. voxels) are available to fit some target, with very few samples (i.e. scans) to learn the informative regions. A commonly used solution is to regularize the weights of the parametric prediction function. However, model specification needs a careful design to balance adaptiveness and sparsity. In this paper, we introduce a novel method, Multi − Class Sparse Bayesian Regression(MCBR), that generalizes classical approaches such as Ridge regression and Automatic Relevance Determination. Our approach is based on a grouping of the features into several classes, where each class is regularized with specific parameters. We apply our algorithm to the prediction of a behavioral variable from brain activation images. The method presented here achieves similar prediction accuracies than reference methods, and yields more interpretable feature loadings.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bishop, C.M., Tipping, M.E.: Variational relevance vector machines. In: UAI 2000: 16th Conference on Uncertainty in Artificial Intelligence, pp. 46–53 (2000)

    Google Scholar 

  2. Carroll, M.K., Cecchi, G.A., Rish, I., Garg, R., Rao, A.R.: Prediction and interpretation of distributed neural activity with sparse models. NeuroImage 44(1), 112–122 (2009)

    Article  Google Scholar 

  3. Chib, S., Jeliazkov, I.: Marginal likelihood from the metropolis-hastings output. Journal of the American Statistical Association 96, 270–281 (2001)

    Article  MATH  MathSciNet  Google Scholar 

  4. Cortes, C., Vapnik, V.: Support vector networks. Machine Learning 20, 273–297 (1995)

    MATH  Google Scholar 

  5. Cox, D., Savoy, R.: Functional magnetic resonance imaging (fMRI) ”brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex. NeuroImage 19(2), 261–270 (2003)

    Article  Google Scholar 

  6. Dayan, P., Abbott, L.: Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems. The MIT Press, Cambridge (2001)

    MATH  Google Scholar 

  7. Eger, E., Kell, C., Kleinschmidt, A.: Graded size sensitivity of object exemplar evoked activity patterns in human loc subregions. Journal of Neurophysiology 100(4), 2038–2047 (2008)

    Article  Google Scholar 

  8. Friston, K., Chu, C., Mourao-Miranda, J., Hulme, O., Rees, G., Penny, W., Ashburner, J.: Bayesian decoding of brain images. NeuroImage 39, 181–205 (2008)

    Article  Google Scholar 

  9. Qi, Y., Minka, T.P., Picard, R.W., Ghahramani, Z.: Predictive automatic relevance determination by expectation propagation. In: ICML 2004: Proceedings of the twenty-first international conference on Machine learning. ACM Press, New York (2004)

    Google Scholar 

  10. Tipping, M.: The relevance vector machine. In: Advances in Neural Information Processing Systems, San Mateo, CA (2000)

    Google Scholar 

  11. Ward, J.H.: Hierarchical grouping to optimize an objective function. Journal of the American Statistical Association 58(301), 236–244 (1963)

    Article  MathSciNet  Google Scholar 

  12. Yamashita, O., aki Sato, M., Yoshioka, T., Tong, F., Kamitani, Y.: Sparse estimation automatically selects voxels relevant for the decoding of fMRI activity patterns. NeuroImage 42(4), 1414–1429 (2008)

    Article  Google Scholar 

  13. Yuan, M., Yuan, M., Lin, Y., Lin, Y.: Model selection and estimation in regression with grouped variables. Journal of the Royal Statistical Society, Series B 68, 49–67 (2006)

    Article  MATH  MathSciNet  Google Scholar 

  14. Zou, H., Hastie, T.: Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society B 67, 301–320 (2005)

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Michel, V., Eger, E., Keribin, C., Thirion, B. (2010). Multi-Class Sparse Bayesian Regression for Neuroimaging Data Analysis. In: Wang, F., Yan, P., Suzuki, K., Shen, D. (eds) Machine Learning in Medical Imaging. MLMI 2010. Lecture Notes in Computer Science, vol 6357. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15948-0_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-15948-0_7

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-15947-3

  • Online ISBN: 978-3-642-15948-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics