Abstract
In this paper, we present a novel approach toward motion magnification using edge-aware filtering. Edge-aware filters have been used for applications such as image denoising, enhancement, and tone mapping. In this work, we have used fast local Laplacian filter followed by Eulerian motion magnification for enhancement of subtle changes in the video. The proposed method aims to reduce the noise and artifacts in the output video apart from motion magnification. Experiments are conducted on sample videos having minute changes which are imperceptible to see with the human eyes. A no-reference video quality assessment has been employed using a video quality score in order to quantify the motion magnification results.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Amir-Khalili, A., Peyrat, J.M., Abinahed, J., Al-Alao, O., Al-Ansari, A., Hamarneh, G., Abugharbieh, R.: Auto localization and segmentation of occluded vessels in robot-assisted partial nephrectomy. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. pp. 407–414. Springer (2014)
Aubry, M., Paris, S., Hasinoff, S.W., Kautz, J., Durand, F.: Fast local laplacian filters: Theory and applications. ACM Transactions on Graphics (TOG) 33(5), 167:1–167:14 (2014)
Aziz, N.A., Tannemaat, M.R.: A microscope for subtle movements in clinical neurology. Neurology 85(10), 920–920 (2015)
Balakrishnan, G., Durand, F., Guttag, J.: Detecting pulse from head motions in video. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 3430–3437 (2013)
Burt, P., Adelson, E.: The laplacian pyramid as a compact image code. IEEE Transactions on Communications 31(4), 532–540 (1983)
Elgharib, M., Hefeeda, M., Durand, F., Freeman, W.T.: Video magnification in presence of large motions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 4119–4127 (2015)
Fuchs, M., Chen, T., Wang, O., Raskar, R., Seidel, H.P., Lensch, H.P.: Real-time temporal shaping of high-speed video streams. Computers & Graphics 34(5), 575–584 (2010)
Kooij, J.F., van Gemert, J.C.: Depth-aware motion magnification. In: European Conference on Computer Vision. pp. 467–482. Springer (2016)
Liu, C., Torralba, A., Freeman, W.T., Durand, F., Adelson, E.H.: Motion magnification. ACM Transactions on Graphics 24(3), 519–526 (2005)
McLeod, A.J., Baxter, J.S., de Ribaupierre, S., Peters, T.M.: Motion magnification for endoscopic surgery. In: SPIE Medical Imaging. pp. 90360C–90360C. International Society for Optics and Photonics (2014)
Meyer, S., Sorkine-Hornung, A., Gross, M.: Phase-based modification transfer for video. In: European Conference on Computer Vision. pp. 633–648. Springer (2016)
Meyer, S., Wang, O., Zimmer, H., Grosse, M., Sorkine-Hornung, A.: Phase-based frame interpolation for video. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 1410–1418 (2015)
Paris, S., Hasinoff, S.W., Kautz, J.: Local laplacian filters: Edge-aware image processing with a laplacian pyramid. Communications of the ACM 58(3), 81–91 (2015)
Pintea, S., van Gemert, J.: Making a case for learning motion representations with phase. In: Computer Vision–ECCV Workshops. pp. 55–64. Springer (2016)
Revaud, J., Weinzaepfel, P., Harchaoui, Z., Schmid, C.: EpicFlow: Edge-Preserving Interpolation of Correspondences for Optical Flow. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 1164–1172 (2015)
Saad, M.A., Bovik, A.C., Charrier, C.: Blind prediction of natural video quality. IEEE Transactions on Image Processing 23(3), 1352–1365 (2014)
Wadhwa, N., Dekel, T., Wei, D., Durand, F., Freeman, W.T.: Deviation magnification: Revealing departure from ideal geometries. ACM Transactions on Graphics. (Proceedings SIGGRAPH Asia 2015) 34(6), 226:1–226:10, (2015)
Wadhwa, N., Rubinstein, M., Durand, F., Freeman, W.T.: Phase-based video motion processing. ACM Transactions on Graphics 32(4), 80:1–80:10 (2013)
Wadhwa, N., Rubinstein, M., Durand, F., Freeman, W.T.: Riesz pyramids for fast phase-based video magnification. In: Proceedings of IEEE International Conference on Computational Photography. pp. 1–10 (2014)
Wang, J., Drucker, S.M., Agrawala, M., Cohen, M.F.: The cartoon animation filter. ACM Transaction on Graphics 25(3), 1169–1173 (2006)
Wu, H.Y., Rubinstein, M., Shih, E., Guttag, J., Durand, F., Freeman, W.: Eulerian video magnification for revealing subtle changes in the world. ACM Transactions on Graphics (Proceeding SIGGRAPH 2012) 31(4), 1–8 (2012)
Acknowledgements
The authors would like to thank SERB-DST for support through Young Scientists Startup Research Grant.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Verma, M., Raman, S. (2018). Edge-Aware Spatial Filtering-Based Motion Magnification. In: Chaudhuri, B., Kankanhalli, M., Raman, B. (eds) Proceedings of 2nd International Conference on Computer Vision & Image Processing . Advances in Intelligent Systems and Computing, vol 704. Springer, Singapore. https://doi.org/10.1007/978-981-10-7898-9_10
Download citation
DOI: https://doi.org/10.1007/978-981-10-7898-9_10
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-7897-2
Online ISBN: 978-981-10-7898-9
eBook Packages: EngineeringEngineering (R0)