Repurpose 2D Character Animations for a VR Environment Using BDH Shape Interpolation

  • Simone BarbieriEmail author
  • Ben Cawthorne
  • Zhidong Xiao
  • Xiaosong Yang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10582)


Virtual Reality technology has spread rapidly in recent years. However, its growth risks ending soon due to the absence of quality content, except for few exceptions. We present an original framework that allows artists to use 2D characters and animations in a 3D Virtual Reality environment, in order to give an easier access to the production of content for the platform. In traditional platforms, 2D animation represents a more economic and immediate alternative to 3D. The challenge in adapting 2D characters to a 3D environment is to interpret the missing depth information. A 2D character is actually flat, so there is not any depth information, and every body part is at the same level of the others. We exploit mesh interpolation, billboarding and parallax scrolling to simulate the depth between each body segment of the character. We have developed a prototype of the system, and extensive tests with a 2D animation production show the effectiveness of our framework.


Virtual Reality Animation 2D characters in 3D environment Shape interpolation Billboarding Parallax scrolling 


  1. 1.
    Akenine-Moller, T., Haines, E.: Real-Time Rendering, 2nd edn. A.K. Peters Ltd. (2002)Google Scholar
  2. 2.
    Alexa, M.: Recent advances in mesh morphing. In: Computer Graphics Forum, vol. 21, pp. 173–198. Wiley Online Library (2002)Google Scholar
  3. 3.
    Alexa, M., Cohen-Or, D., Levin, D.: As-rigid-as-possible shape interpolation. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, pp. 157–164. ACM Press/Addison-Wesley Publishing Co. (2000)Google Scholar
  4. 4.
    Asbury, K., Cook, L., Howard, M., Katzenber, J., Soria, M.: Spirit: Stallion of the Cimarron. DreamWorks Pictures (2002)Google Scholar
  5. 5.
    Aubel, A., Boulic, R., Thalmann, D.: Real-time display of virtual humans: levels of details and impostors. IEEE Trans. Circuits Syst. Video Technol. 10(2), 207–217 (2000)CrossRefGoogle Scholar
  6. 6.
    Balkan, A., Dura, J., Eden, A., Monnone, B., Palmer, J.D., Tarbell, J., Yard, T.: Parallax scrolling. Flash 3D Cheats Most Wanted, pp. 121–164. Springer/Apress, Berkeley (2003). doi: 10.1007/978-1-4302-0814-3_5 CrossRefGoogle Scholar
  7. 7.
    Barbieri, S., Garau, N., Hu, W., Xiao, Z., Yang, X.: Enhancing character posing by a sketch-based interaction. In: ACM SIGGRAPH 2016 Posters, p. 56. ACM (2016)Google Scholar
  8. 8.
    Baxter, W., Barla, P., Anjyo, K.I.: Rigid shape interpolation using normal equations. In: Proceedings of the 6th International Symposium on Non-photorealistic Animation and Rendering, pp. 59–64. ACM (2008)Google Scholar
  9. 9.
    Bird, B., Abbate, A., McAnuff, D.: The iron giant. Warner Bros. Feature Animation (1999)Google Scholar
  10. 10.
    Blow, J.: Braid (2008).
  11. 11.
    Chen, R., Weber, O., Keren, D., Ben-Chen, M.: Planar shape interpolation with bounded distortion. ACM Trans. Graph. (TOG) 32(4), 108 (2013)zbMATHGoogle Scholar
  12. 12.
    Chien, E., Chen, R., Weber, O.: Bounded distortion harmonic shape interpolation. ACM Trans. Graph. (TOG) 35(4), 105 (2016)CrossRefGoogle Scholar
  13. 13.
    Choi, J., Szymczak, A.: On coherent rotation angles for as-rigid-as-possible shape interpolation. Technical report, Georgia Institute of Technology (2003)Google Scholar
  14. 14.
    Clements, R., Musker, J., Conli, R.: The treasure planet. Buena Vista Pictures (2002)Google Scholar
  15. 15.
    Cooper, D.: 2D/3D hybrid character animation on spirit. In: ACM SIGGRAPH 2002 Conference Abstracts and Applications, p. 133. ACM (2002)Google Scholar
  16. 16.
    Davis, J., Agrawala, M., Chuang, E., Popović, Z., Salesin, D.: A sketching interface for articulated figure animation. In: Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 320–328. Eurographics Association (2003)Google Scholar
  17. 17.
    Fox, T.: Undertale (2015).
  18. 18.
    Guay, M., Cani, M.P., Ronfard, R.: The line of action: an intuitive interface for expressive character posing. ACM Trans. Graph. (TOG) 32(6), 205 (2013)CrossRefGoogle Scholar
  19. 19.
    Hahn, F., Mutzel, F., Coros, S., Thomaszewski, B., Nitti, M., Gross, M., Sumner, R.W.: Sketch abstractions for character posing. In: Proceedings of the 14th ACM SIGGRAPH/Eurographics Symposium on Computer Animation,pp. 185–191. ACM (2015)Google Scholar
  20. 20.
    Jain, E., Sheikh, Y., Hodgins, J.: Leveraging the talent of hand animators to create three-dimensional animation. In: Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 93–102. ACM (2009)Google Scholar
  21. 21.
    Jain, E., Sheikh, Y., Mahler, M., Hodgins, J.: Augmenting hand animation with three-dimensional secondary motion. In: Proceedings of the 2010 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. pp. 93–102. Eurographics Association (2010)Google Scholar
  22. 22.
    Konno, H., Miyamoto, S.: Mario kart 64. Nintendo (1996)Google Scholar
  23. 23.
    Lipkin, N.: Examining indie’s independence: the meaning of “indie” games, the politics of production, and mainstream cooptation. Loading. 7(11) (2012)Google Scholar
  24. 24.
    Mao, C., Qin, S., Wright, D.: A sketch-based gesture interface for rough 3D stick figure animation. In: Eurographics (2005)Google Scholar
  25. 25.
    O’Hailey, T.: Hybrid Animation: Integrating 2D and 3D Assets. Taylor & Francis, Burlington (2010)Google Scholar
  26. 26.
    Poranne, R., Lipman, Y.: Provably good planar mappings. ACM Trans. Graph. (TOG) 33(4), 76 (2014)CrossRefGoogle Scholar
  27. 27.
    Schaufler, G.: Dynamically generated impostors. In: GI Workshop Modeling-Virtual Worlds-Distributed Graphics, pp. 129–136 (1995)Google Scholar
  28. 28.
    Scherba, T.: Virtual reality is about to go mainstream, but a lack of content threatens to hold it back (2016).
  29. 29.
    Sỳkora, D., Sedlacek, D., Jinchao, S., Dingliana, J., Collins, S.: Adding depth to cartoons using sparse depth (in) equalities. In: Computer Graphics Forum, vol. 29, pp. 615–623. Wiley Online Library (2010)Google Scholar
  30. 30.
    Tecchia, F., Chrysanthou, Y.: Real-time rendering of densely populated urban environments. In: Péroche, B., Rushmeier, H. (eds.) Rendering Techniques 2000, pp. 83–88. Springer, Vienna (2000)CrossRefGoogle Scholar
  31. 31.
    Weber, O., Ben-Chen, M., Gotsman, C.: Complex barycentric coordinates with applications to planar shape deformation. In: Computer Graphics Forum, vol. 28, pp. 587–597. Wiley Online Library (2009)Google Scholar
  32. 32.
    Weber, O., Gotsman, C.: Controllable conformal maps for shape deformation and interpolation. In: ACM Transactions on Graphics (TOG), vol. 29, p. 78. ACM (2010)Google Scholar
  33. 33.
    Xu, D., Zhang, H., Wang, Q., Bao, H.: Poisson shape interpolation. Graph. Models 68(3), 268–281 (2006)CrossRefzbMATHGoogle Scholar
  34. 34.
    Yang, Y., Wang, X., Chen, J.X.: Rendering avatars in virtual reality: integrating a 3D model with 2d images. Comput. Sci. Eng. 4(1), 86–91 (2002)CrossRefGoogle Scholar
  35. 35.
    Zemeckis, R., Marshall, F., Watts, R.: Who framed roger rabbit. Buena Vista Pictures (1988)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Simone Barbieri
    • 1
    • 2
    • 3
    Email author
  • Ben Cawthorne
    • 3
  • Zhidong Xiao
    • 2
  • Xiaosong Yang
    • 2
  1. 1.Centre for Digital EntertainmentBournemouth UniversityPooleUK
  2. 2.Bournemouth UniversityPooleUK
  3. 3.Thud MediaCardiffUK

Personalised recommendations