Structured Variable Selection for Regularized Generalized Canonical Correlation Analysis
Regularized Generalized Canonical Correlation Analysis (RGCCA) extends regularized canonical correlation analysis to more than two sets of variables. Sparse GCCA (SGCCA) was recently proposed to address the issue of variable selection. However, the variable selection scheme offered by SGCCA is limited to the covariance (τ = 1) link between blocks. In this paper we go beyond the covariance link by proposing an extension of SGCCA for the full RGCCA model (τ ∈ [0, 1]). In addition, we also propose an extension of SGCCA that exploits pre-given structural relationships between variables within blocks. Specifically, we propose an algorithm that allows structured and sparsity-inducing penalties to be included in the RGCCA optimization problem.
KeywordsRGCCA Variable selection Structured penalty Sparse penalty
This work was supported by grants from the French National Research Agency: ANR IA BRAINOMICS (ANR-10-BINF-04), and a European Commission grant: MESCOG (FP6 ERA-NET NEURON 01 EW1207).
- Combettes, P.L., Pesquet, J.C.: Proximal splitting methods in signal processing. In: Bauschke, H.H., Burachik, R.S., Combettes, P.L., Elser, V., Luke, D.R., Wolkowicz, H. (eds.) Fixed-Point Algorithms for Inverse Problems in Science and Engineering, pp. 185–212. Springer, New York (2011)CrossRefGoogle Scholar
- Hadj-Selem, F., Löfstedt, T., Duchesnay, E., Frouin, V., Guillemot, V.: Iterative Smoothing Algorithm for Regression with Structured Sparsity (2016, Submitted paper)Google Scholar
- Parikh, N., Boyd, S.: Proximal Algorithms. Now Publishers Inc., New York (2013)Google Scholar
- Philippe, C., Puget, S., Bax, D.A., Job, B., Varlet, P., Junier, M.P., Andreiuolo, F., Carvalho, D., Reis, R., Guerrini-Rousseau, L., Roujeau, T., Dessen, P., Richon, C., Lazar, V., Le Teuff, G., Sainte-Rose, C., Geoerger, B., Vassal, G., Jones, C., Grill, J.: Mesenchymal transition and PDGFRA amplification/mutation are key distinct oncogenic events in pediatric diffuse intrinsic pontine gliomas. PloS one 7, 1–14 (2012)Google Scholar
- Schmidt, M., Le Roux, N., Bach, F.: Convergence rates of inexact proximal-gradient methods for convex optimization (2011). ArXiv:1109.2415Google Scholar
- van den Berg, E., Schmidt, M., Friedlander, M.P., Murphy, K.: Group sparsity via linear-time projection. Technical report TR-2008-09, Department of Computer Science, University of British Columbia, Vancouver (2008)Google Scholar