Fast Implementation of ℓ1-Greedy Algorithm
We present an algorithm for finding sparse solutions of the system of linear equations A x = b with the rectangular matrix A of size n ×N, where n < N. The algorithm basic constructive block is one iteration of the standard interior-point linear programming algorithm. To find the sparse representation we modify (reweight) each iteration in the spirit of Petukhov (Fast implementation of orthogonal greedy algorithm for tight wavelet frames. Signal Process. 86, 471–479 (2006)). However, the weights are selected according to the ℓ 1-greedy strategy developed in Kozlov and Petukhov (Sparse solutions for underdetermined systems of linear equations. In: Freeden, W., Nashed, M.Z., Sonar, T. (eds.) Handbook of Geomathematics, pp. 1243–1259. Springer, Berlin (2010)). Our algorithm combines computational complexity close to plain ℓ 1-minimization with the significantly higher efficiency of the sparse representations recovery than the reweighted ℓ 1-minimization (Candes et al.: Enhancing sparsity by reweighted ℓ 1 minimization. J. Fourier Anal. Appl. 14, 877–905 (2008) (special issue on sparsity)), approaching the capacity of the ℓ 1-greedy algorithm.
KeywordsGreedy Algorithm Sparse Representation Wavelet Frame Orthogonal Match Pursuit Sparse Solution
- 3.Candes, E.J., Wakin, M.B., Boyd, S.: Enhancing sparsity by reweighted ℓ 1 minimization. J. Fourier Anal. Appl. 14, 877–905 (2008) (special issue on sparsity)Google Scholar
- 4.Chartrand, R., Yin, W.: Iteratively reweighted algorithms for compressive sensing. In: Proceedings of International Conference on Acoustics, Speech, Signal Processing (ICASSP), pp. 3869–3872 (2008)Google Scholar
- 7.Donoho, D., Tsaig, Y., Drori, I., Starck, J.: Sparse solutions of underdetermined linear equations by stagewise orthogonal matching pursuit. Report, Stanford University (2006)Google Scholar