Abstract
This paper proposes a wallpaper replacement method in a free-hand movie. Our method superimposes computer graphics (CG) wallpaper onto a real wall region in the free-hand movie looking around a room. To extract wallpaper planes, ordinarily a special and expensive 3D survey instrument is required. However, there is usually no such instrument in homes or offices where many users want to experience wallpaper replacement simulation. To solve this problem, we extract the wallpaper region by an image segmentation technique with user interaction. By applying our method, wallpaper replacement can be easily achieved using only a handy camera and a PC.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ohta, Y., Tamura, H.: Mixed Reality-Merging Real and Virtual Worlds, Ohmsha (1999)
Kanbara, M., Okuma, T., Takemura, H., Yokoya, N.: Real-time Composition of Stereo Images for Video See-through Augmented Reality. In: Proceedings of IEEE International Conference on Multimedia Computing and Systems, vol. 1, pp. 213–219 (1999)
Newcombe, R.A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A.J., Kohli, P., Shotton, J., Hodges, S., Fitzgibbon, A.: Kinect-fusion: Real-time dense surface mapping and tracking. In: Proceedings of IEEE International Symposium on Mixed and Augmented Reality, pp. 99–107 (2011)
Snavely, N., Seitz, S.M., Szeliski, R.: Modeling the world from Internet photo collection. International Journal of Computer Vision 80(2), 189–210 (2007)
Mortensen, E., Barrett, W.: Intelligent scissors for image composition. In: Proceedings of SIGGRAPH, pp. 191–198 (1995)
Kass, M., Witkin, A., Terzopoulos, D.: Snakes: Active contour models. In: Proceeding of IEEE International Conference on Computer Vision, pp. 259–268 (1987)
Chuang, Y., Curless, B., Salesin, D.H., Szeliski, R.: A Bayesian Approach to Digital Matting. In: Proceedings of IEEE Computer Vision and Pattern Recognition, vol. 2, pp. 264–271 (2001)
Rother, C., Komogorov, V., Blake, A.: GrabCut: Interactive Foreground Extraction Using Iterated Graph Cuts. ACM Transactions on Graphics 23(3), 309–314 (2004)
Rav-Acha, A., Kohli, P., Rother, C., Fitzgibbon, A.: Unwarp Mosaics: A new representation for video editing. ACM Transactions on Graphics 27(3) (2008)
Bay, H., Tuytelaars, T., Van Gool, L.: SURF: Speed Up Robust Features. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006, Part I. LNCS, vol. 3951, pp. 404–417. Springer, Heidelberg (2006)
Fischler, M.A., Bolles, R.C.: Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography. Communications of the ACM 24(6), 381–395 (1981)
DiVerdi, S., Wither, J., Höllerer, T.: All around the map: Online spherical panorama construction. Computers and Graphics 33(1), 73–84 (2009)
Steedly, D., Pal, C., Szeliski, R.: Efficiently Registering Video into Panoramic Mosaics. In: Proceeding of IEEE International Conference on Computer Vision, pp. 1300–1307 (2005)
Brown, M., Lowe, D.: Automatic Panoramic Image Stitching using Invariant Features. International Journal of Computer Vision 74(1), 59–73 (2007)
Kwatra, V., Schodl, A., Essa, I., Turk, G., Bobick, A.: Graphcut Textures: Image and Video Synthesis Using Graph Cuts. Proceedings of ACM Transactions on Graphics 22(3), 277–286 (2003)
Perez, P., Gangnet, M., Blake, A.: Poisson Image Editing. ACM Transactions on Graphics 22(3), 313–318 (2003)
Boykov, Y., Jolly, M.-P.: Interactive Graph Cuts for Optimal Boundary & Region Segmentation of Objects in N-D Images. In: Proceedings of International Conference on Computer Vision, vol. 1, pp. 105–112 (2001)
Klein, G., Murray, D.: Parallel Tracking and Mapping for Small AR Workspaces. In: Proceedings of International Symposium on Mixed and Augmented Reality (ISMAR 2007), pp. 225–234 (2007)
Newcombe, R.A., Davison, A.D., Izadi, S., Kohli, P., Hilliges, O., Shotton, J., Molyneaux, D., Hodges, S., Kim, D., Fitzgibbon, A.: KinectFusion: Real-time dense surface mapping and tracking. In: Proceedings of International Symposium on Mixed and Augmented Reality (ISMAR 2011), pp. 127–136 (2011)
Jason, W., Tsai, Y., Azuma, R.: Indirect Augmented Reality. Computers & Graphics 35(4), 810–822 (2011)
Okura, F., Kanbara, M., Yokoya, N.: Interactive Exploration of Augmented Aerial Scenes with Free-Viewpoint Image Generation from Pre-Rendered Images. In: Proceedings of International Symposium on Mixed and Augmented Reality (ISMAR 2013), pp. 279–280 (2013)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Ueda, M., Kitahara, I., Ohta, Y. (2014). MR Simulation for Re-wallpapering a Room in a Free-Hand Movie. In: Gurrin, C., Hopfgartner, F., Hurst, W., Johansen, H., Lee, H., O’Connor, N. (eds) MultiMedia Modeling. MMM 2014. Lecture Notes in Computer Science, vol 8325. Springer, Cham. https://doi.org/10.1007/978-3-319-04114-8_37
Download citation
DOI: https://doi.org/10.1007/978-3-319-04114-8_37
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-04113-1
Online ISBN: 978-3-319-04114-8
eBook Packages: Computer ScienceComputer Science (R0)