Diminished Reality Based on 3D-Scanning

  • Erwin Andre
  • Helmut HlavacsEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11863)


In this paper a new method for diminished reality is explored, which uses a 3D model of a room to fill in missing regions when removing objects in real time on a video. The room is scanned before, so it is possible to recreate missing pieces in all their detail. The proposed method allows freedom in movement and rotation and is demonstrated with an application on a mobile device, detailed results are shown.


  1. 1.
    OpenCV library. Accessed 09 Jan 2019
  2. 2.
    Faubert, J., Dixon, P.E., Bennett, P.J.E.: Visual perception and aging. Can. J. Exp. Psychol./Rev. Can. Psychol. Exp. 56(3), 164–176 (2002)Google Scholar
  3. 3.
    Hackl, A., Hlavacs, H.: Diminishing reality. In: International Conference on Entertainment Computing (IFIP ICEC 2018) (2018)Google Scholar
  4. 4.
    Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2004)CrossRefGoogle Scholar
  5. 5.
    Herling, J., Broll, W.: Advanced self-contained object removal for realizing real-time diminished reality in unconstrained environments. In: 2010 IEEE International Symposium on Mixed and Augmented Reality, pp. 207–212, October 2010Google Scholar
  6. 6.
    Kalantari, M., Nechifor, M.: Accuracy and utility of the structure sensor for collecting 3D indoor information. Geo-Spat. Inform. Sci. 19(3), 202–209 (2016)CrossRefGoogle Scholar
  7. 7.
    Kawai, N., Sato, T., Yokoya, N.: Diminished reality based on image inpainting considering background geometry. IEEE Trans. Vis. Comput. Graph. 22(3), 1236–1247 (2016)CrossRefGoogle Scholar
  8. 8.
    Kawai, N., Sato, T., Yokoya, N.: From image inpainting to diminished reality. In: Shumaker, R., Lackey, S. (eds.) VAMR 2014. LNCS, vol. 8525, pp. 363–374. Springer, Cham (2014). Scholar
  9. 9.
    Kersten, T.P., Przybilla, H.-J., Lindstaedt, M., Tschirschwitz, F., Misgaiski-Hass, M.: Comparative geometrical investigations of hand-held scanning systems. Int. Arch. Photogr. 01, 507–514 (2016)Google Scholar
  10. 10.
    Mori, S., Ikeda, S., Saito, H.: A survey of diminished reality: techniques for visually concealing, eliminating, and seeing through real objects. IPSJ Trans. Comput. Vis. Appl. 9(1), 1–14 (2017)CrossRefGoogle Scholar
  11. 11.
    Queguiner, G., Fradet, M., Rouhani, M.: Towards mobile diminished reality. In: 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), pp. 226–231 (2018)Google Scholar
  12. 12.
    Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, p. I (2001)Google Scholar
  13. 13.
    Wikipedia. Camera resectioning - Wikipedia. Accessed 18 Jan 2019
  14. 14.
    Yagi, K., Hasegawa, K., Saito, H.: Diminished reality for privacy protection by hiding pedestrians in motion image sequences using structure from motion. In: 2017 IEEE International Symposium on Mixed and Augmented Reality, pp. 334–337, October 2017Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2019

Authors and Affiliations

  1. 1.Faculty of Computer Science, Entertainment Computing Research GroupUniversity of ViennaViennaAustria

Personalised recommendations