Magnifying micro-movements of natural videos that are undetectable by human eye has recently received considerable interests, due to its impact in numerous applications. In this paper, we use dual tree complex wavelet transform (DT-CWT), to analyze video frames in order to detect and magnify micro-movements to make them visible. We use DT-CWT, due to its excellent edge-preserving and nearly-shift invariant features. In order to detect any minor change in object’s spatial position, the paper proposes to modify the phases of the CWT coefficients decomposition of successive video frames. Furthermore, the paper applies Radon transform to track frame micro-movements without any temporal band-pass filtering. The paper starts by presenting a simple technique to design orthogonal filters that construct this CWT system. Next, it is shown that modifying the phase differences between the CWT coefficients of arbitrary frame and a reference one results in image spatial magnification. This in turn, makes these micro-movements seen and observable. Several simulation results are given, to show that the proposed technique competes very well to the existing micro-magnification approaches. In fact, as it manages to yield superior video quality in far less computation time.
This is a preview of subscription content, log in to check access.
Buy single article
Instant unlimited access to the full article PDF.
Price includes VAT for USA
Subscribe to journal
Immediate online access to all issues from 2019. Subscription will auto renew annually.
This is the net price. Taxes to be calculated in checkout.
Wang, J., Drucker, S.M., Agrawala, M., Cohen, M.F.: The cartoon animation filter. ACM Trans. Graph. 25, 1169–1173 (2006)
Poh, M.Z., McDuff, D.J., Picard, R.W.: Non-contact, automated cardiac pulse measurements using video imaging and blind source separation. Opt. Express 18(10), 10762–10774 (2010)
Fuchs, M., Chen, T., Wang, O., Raskar, R., Seidel, H.P., Lensch, H.P.: Real-time temporal shaping of high-speed video streams. Comput. Graph, 34(5), 575–584 (2010)
Liu, C., Torralba, A., Freeman, W.T., Durand, F., Adelson, E.H.: Motion magnification. ACM Trans. Graph. 24(3), 519–526 (2005)
Wu, H.Y., Rubinstein, M., Shih, E., Guttag, J., Durand, F., Freeman, W.: Eulerian video magnification for revealing subtle changes in the world. ACM Trans. Graph. 31(4), 1 (2012)
Wadhwal, N., Rubinstein, M., Durand, F., Freeman, W.T.: Phase-based video motion processing. ACM Trans. Graph. 32(4), 80 (2013)
Simoncelli, P.E., Freeman, W.T.: The steerable pyramid: a flexible architecture for multi-scae derivative computation. IEEE Int. Conf. Image Proces. 3, 444–447 (1995)
Freeman, W.T., Adelson, E.H., et al.: The design and use of steerable filters. IEEE Trans. Pattern Anal. Mach. Intell. 13(9), 891–906 (1991)
Fahmy, G., Fahmy, O.M., Fahmy, M.F.: Micro movement magnification in video signals using complex wavelet analysis. IET Image Process. 11(11), 986–993 (2017)
Kingsbury, N.: A dual-tree complex wavelet transform with improved orthogonality and symmetry properties. IEEE Int. Conf. Image Proces. 2, 375–378 (2000)
Kingsbury, N.G.: Complex wavelets for shift invariant analysis and filtering of signals. Appl. Comput. Harmonic Anal. 10(3), 234–253 (2001)
Selesnick, I.W., Baraniuk, R., Kingsbury, N.G.: The dual-tree complex wavelet transform. IEEE Signal Process. Mag. 22(6), 123–151 (2005)
Smith, M.J., Docef, A.: A Study Guide for Digital Image Processing. Scientific Publishers, Jodhpur (1997)
Kingston, A.: Orthogonal discrete Radon transform over pn \(\times \) PN images. Signal Process. 86(8), 2040–2050 (2006)
Fahmy, O.M., Fahmy, M.F.: An enhanced denoising technique using dual tree complex wavelet transform. In: National Radio Science Conference NRSC, AASRT, Aswan, Egypt (2016)
Fahmy, O.M., Fahmy, M.F.: An efficient bivariate image denoising technique using new orthogonal CWT filters. IET Image Process. J. 10(1049), 1117 (2018)
Vaidyanathan, P.: Multirate Systems and Filter Banks. Pearson Education India, London (1993)
Abdelnour, A.F., Selesnick, I.W.: Nearly symmetric orthogonal wavelet bases. In: IEEE International Conference on Acoustics, Speech, Signal Processing (ICASSP) (2001 May)
Kingsbury, N.G.: Complex wavelets for shift invariant analysis and filtering of signals. J. Appl. Comput. Harmonic Anal. 10(3), 234–253 (2001)
Miller, M.A., Kingsbury, N.G.: Image modeling using inter scale phase properties of complex wavelet coefficients. IEEE Trans. Image Process. 17(9), 1491–99 (2008)
Funding was provided by Deanship of Scientific Research, Prince Sattam Bin abdul Aziz University (Grant No. Project 2017/01/7140).
About this article
Cite this article
Fahmy, O.M., Fahmy, G. & Fahmy, M.F. A new video magnification technique using complex wavelets with Radon transform application. SIViP 12, 1505–1512 (2018) doi:10.1007/s11760-018-1306-9
- Complex wavelets
- Phase video magnification
- Radon transform