An Improved Optimization Method for the Relevance Voxel Machine
In this paper, we will re-visit the Relevance Voxel Machine (RVoxM), a recently developed sparse Bayesian framework used for predicting biological markers, e.g., presence of disease, from high-dimensional image data, e.g., brain MRI volumes. The proposed improvement, called IRVoxM, mitigates the shortcomings of the greedy optimization scheme of the original RVoxM algorithm by exploiting the form of the marginal likelihood function. In addition, it allows voxels to be added and deleted from the model during the optimization. In our experiments we show that IRVoxM outperforms RVoxM on synthetic data, achieving a better training cost and test root mean square error while yielding sparser models. We further evaluated IRVoxM’s performance on real brain MRI scans from the OASIS data set, and observed the same behavior - IRVoxM retains good prediction performance while yielding much sparser models than RVoxM.
KeywordsRoot Mean Square Error Synthetic Data Marginal Likelihood Relevance Vector Machine Sparse Model
Unable to display preview. Download preview PDF.
- 1.Duarte, J.V., Ribeiro, M.J., Violante, I.R., Cunha, G., Silva, E., Castelo-Branco, M.: Multivariate pattern analysis reveals subtle brain anomalies relevant to the cognitive phenotype in neurofibromatosis type 1. Human Brain Mapping (2012)Google Scholar
- 5.Tipping, M.E., Faul, A.: Fast marginal likelihood maximisation for sparse bayesian models. In: Proceedings of the Ninth International Workshop on Artificial Intelligence and Statistics, pp. 3–6 (2003)Google Scholar
- 7.Ganz, M., Sabuncu, M.R., van Leemput, K.: The improved relevance voxel machine. Technical Report DTU Compute-2013-10, Institute for Mathematical Modeling, DTU (2013)Google Scholar
- 9.Michel, V., Eger, E., Keribin, C., Thirion, B.: Multiclass sparse bayesian regression for fmri-based prediction. Journal of Biomedical Imaging 2011, 2 (2011)Google Scholar