Nonnegative Tensor Train Decompositions for Multi-domain Feature Extraction and Clustering
Tensor train (TT) is one of the modern tensor decomposition models for low-rank approximation of high-order tensors. For nonnegative multiway array data analysis, we propose a nonnegative TT (NTT) decomposition algorithm for the NTT model and a hybrid model called the NTT-Tucker model. By employing the hierarchical alternating least squares approach, each fiber vector of core tensors is optimized efficiently at each iteration. We compared the performances of the proposed method with a standard nonnegative Tucker decomposition (NTD) algorithm by using benchmark data sets including event-related potential data and facial image data in multi-domain feature extraction and clustering tasks. It is illustrated that the proposed algorithm extracts physically meaningful features with relatively low storage and computational costs compared to the standard NTD model.
KeywordsEEG Feature extraction HALS Tucker decomposition
- 3.Cong, F., Phan, A.-H., Astikainen, P., Zhao, Q., Wu, Q., Hietanen, J.K., Ristaniemi, T., Cichocki, A.: Multi-domain feature extraction for small event-related potentials through nonnegative multi-way array decomposition from low dense array EEG. Int. J. Neural Syst. 23, 1350006 (2013)CrossRefGoogle Scholar
- 8.Lee, N., Cichocki, A.: Fundamental tensor operations for large-scale data analysis in tensor train formats. ArXiv preprint arXiv:1405.7786 (2014)
- 11.Samaria, F.S., Harter, A.C.: Parameterisation of a stochastic model for human face identification. In: Proceedings of the Second IEEE Workshop on Applications of Computer Vision, pp. 138–142. lEEE Computer Society Press (1994)Google Scholar