Missing Elements Recovery Using Low-Rank Tensor Completion and Total Variation Minimization

  • Jinglin Zhang
  • Mengjie Qin
  • Cong Bai
  • Jianwei ZhengEmail author
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 1181)


The Low-rank (LR) and total variation (TV) are two most popular regularizations for image processing problems and have sparked a tremendous number of researches, particularly for moving from scalar to vector, matrix or even high-order based functions. However, discretization schemes commonly used for TV regularization often ignore the difference of the intrinsic properties, which is not effective enough to exploit the local smoothness, let alone the problem of edge blurring. To address this issue, in this paper, we consider the color image as three-dimensional tensors, then measure the smoothness of these tensors by TV norm along the different dimensions. The three-order tensor is then recovered by Tucker decomposition factorization. Specifically, we propose integrating Shannon total variation (STV) into low-rank tensor completion (LRTC). Moreover, due to the suboptimality of nuclear norm, we propose a new nonconvex low-rank constraint for closer rank approximation, namely truncated \(\gamma \)-norm. We solve the cost function using the alternating direction method of multipliers (ADMM) method. Experiments on color image inpainting tasks demonstrate that the proposed method enhances the details of the recovered images.


Tensor completion Low-rank Shannon total variation 



This research is funded by Natural Science Foundation of China under Grant Nos. 61702275, 61976192, 61602413, 41775008, and by Zhejiang Provincial Natural Science Foundation of China under Grant Nos. LY18F020032 and LY19F030016.


  1. 1.
    Guillemot, C., Le Meur, O.: Image inpainting: overview and recent advances. IEEE Sig. Process. Mag. 31(1), 127–144 (2014)CrossRefGoogle Scholar
  2. 2.
    Bertalmio, M., Sapiro, G., Caselles, V., Ballester, C.: Image inpainting. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 417–424. ACM Press/Addison-Wesley Publishing Co. (2000)Google Scholar
  3. 3.
    Komodakis, N.: Image completion using global optimization. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2006, vol. 1, pp. 442–452. IEEE (2006)Google Scholar
  4. 4.
    Candès, E.J., Tao, T.: The power of convex relaxation: near-optimal matrix completion. arXiv preprint arXiv:0903.1476
  5. 5.
    Gandy, S., Recht, B., Yamada, I.: Tensor completion and low-n-rank tensor recovery via convex optimization. Inverse Probl. 27(2), 025010 (2011)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Jidesh, P., Febin, I.: Estimation of noise using non-local regularization frameworks for image denoising and analysis. Arab. J. Sci. Eng. 44(4), 3425–3437 (2019)CrossRefGoogle Scholar
  7. 7.
    Bini, A.: Image restoration via dost and total variation regularisation. IET Image Process. 13(3), 458–468 (2018)CrossRefGoogle Scholar
  8. 8.
    Fan, J., Li, R.: Variable selection via nonconcave penalized likelihood and its oracle properties. J. Am. Stat. Assoc. 96(456), 1348–1360 (2001)MathSciNetCrossRefGoogle Scholar
  9. 9.
    Markovsky, I.: Applications of structured low-rank approximation. IFAC Proc. Vol. 42(10), 1121–1126 (2009)CrossRefGoogle Scholar
  10. 10.
    Candés, E.J., Recht, B.: Exact matrix completion via convex optimization. Found. Comput. Math. 9(6), 7–17 (2009)MathSciNetCrossRefGoogle Scholar
  11. 11.
    Chartrand, R.: Exact reconstruction of sparse signals via nonconvex minimization. IEEE Sig. Process. Lett. 14(10), 707–710 (2007)CrossRefGoogle Scholar
  12. 12.
    Shang, F., Liu, Y., Cheng, J.: Scalable algorithms for tractable Schatten quasi-norm minimization. In: Thirtieth AAAI Conference on Artificial Intelligence (2016)Google Scholar
  13. 13.
    Chen, Y., Guo, Y., Wang, Y., et al.: Denoising of hyperspectral images using nonconvex low rank matrix approximation. IEEE Trans. Geosci. Remote Sens. 55(9), 5366–5380 (2017)CrossRefGoogle Scholar
  14. 14.
    Liu, J., Musialski, P., Wonka, P., Ye, J.: Tensor completion for estimating missing values in visual data. IEEE Trans. Pattern Anal. Mach. Intell. 35(1), 208–220 (2013)CrossRefGoogle Scholar
  15. 15.
    Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J., et al.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends R Mach. Learn. 3(1), 1–122 (2011)zbMATHGoogle Scholar
  16. 16.
    Tomioka, R., Hayashi, K., Kashima, H.: Estimation of low-rank tensors via convex optimization. arXiv preprint arXiv:1010.0789
  17. 17.
    Li, X., Ye, Y., Xu, X.: Low-rank tensor completion with total variation for visual data inpainting. In: Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, vol. 419, pp. 2210–2216 (2017)Google Scholar
  18. 18.
    Chen, Y.-L., Hsu, C.-T., Liao, H.-Y.: Simultaneous tensor decomposition and completion using factor priors. IEEE Trans. Pattern Anal. Mach. Intell. 36(3), 577–591 (2014)CrossRefGoogle Scholar
  19. 19.
    Recht, B., Fazel, M., Parrilo, P.A.: Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization. SIAM Rev. 52(3), 471–501 (2010)MathSciNetCrossRefGoogle Scholar
  20. 20.
    Abergel, R., Moisan, L.: The shannon total variation. J. Math. Imaging Vis. 59(2), 341–370 (2017) MathSciNetCrossRefGoogle Scholar
  21. 21.
    Xu, J., Zhang, L., Zhang, D., Feng, X.: Multi-channel weighted nuclear norm minimization for real color image denoising, pp. 1096–1104. CoRR (2017)Google Scholar
  22. 22.
    Ji, T.Y., Huang, T.Z., Zhao, X.L., Ma, T.H., Liu, G.: Tensor completion using total variation and low-rank matrix factorization. Inf. Sci. 326, 243–257 (2016)MathSciNetCrossRefGoogle Scholar
  23. 23.
    Zhou, L., Tang, J.: Fraction-order total variation blind image restoration based on \(l_{1}\)-norm. Appl. Math. Model. 51, 469–476 (2017)MathSciNetCrossRefGoogle Scholar
  24. 24.
    Chambolle, A., Pock, T.: A first-order primal-dual algorithm for convex problems with applications to imaging. J. Math. Imaging Vis. 40(1), 120–145 (2011)MathSciNetCrossRefGoogle Scholar
  25. 25.
    Zhao, Q., Zhang, L., Cichocki, A.: Bayesian CP factorization of incomplete tensors with automatic rank determination. IEEE Trans. Pattern Anal. Mach. Intel. 37(9), 1751–1763 (2015)CrossRefGoogle Scholar
  26. 26.
    Li, X., Ye, Y., Xu, X.: Low-rank tensor completion with total variation for visual data inpainting. In: 2017 Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, pp. 2210–2216 (2017)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2020

Authors and Affiliations

  • Jinglin Zhang
    • 1
  • Mengjie Qin
    • 2
  • Cong Bai
    • 2
  • Jianwei Zheng
    • 2
    Email author
  1. 1.School of Atmospheric ScienceNanjing University of Information ScienceNanjingChina
  2. 2.College of Computer ScienceZhejiang University of TechnologyHangzhouChina

Personalised recommendations