Integrating Motion-Capture Augmented Reality Technology as an Interactive Program for Children

  • Chien-Yu LinEmail author
  • Chien-Jung Chen
  • Yu-Hung Liu
  • Hua-Chen Chai
  • Cheng-Wei Lin
  • Yu-Mei Huang
  • Ching-Wen Chen
  • Chien-Chi Lin
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9177)


The purpose of this study is to investigate the effects of free interactive games invention program on jumping performance. This study design interactive games using motion capture technology that enable participant to interact using body motion in augmented environment. Scratch 2.0, using an augmented-reality function via webcam, creates real world and virtual reality merge at the same screen. Scratch-based motion capture system which uses physical activities as the input stimulate. This study uses a webcam integration that tracks movements and allows participants to interact physically with the project, to enhance the motivation of children in elementary. Participants are 7 children in elementary school; the independent variable was some interactive games arranged by the authors, the dependent variable was the immediate effect by the intervention program on jumping performance. The experimental location was in a classroom of elementary school. The results show the Scratch-base free support system could be allowed the participants some clues, so they could have the motivation to do physical activities by themselves. The participants have a significant achievement via free Scratch-base augmented reality instead of traditional activities.


Physical activity Scratch 2.0 Augmented-reality Webcam Motion capture 



This work was financially supported by the National Science Council, Taiwan, under the Grant No. 100-2410-H-024-028-MY2. Special thanks for Yu-Cheng Chen, who improve some of our programming skill.


  1. 1.
    Hwang, T.H.T.: Exploring real-time video interactivity with Scratch (Doctoral dissertation, Massachusetts Institute of Technology) (2012)Google Scholar
  2. 2.
    Kagohara, D.M., Sigafoos, J., Achmadi, D., O’Reilly, M., Lancioni, G.: Teaching children with autism spectrum disorders to check the spelling of words. Res. Autism Spectrum Disord. 6, 304–310 (2012)CrossRefGoogle Scholar
  3. 3.
    Olsson, T., Kärkkäinen, T., Lagerstam, E., Ventä-Olkkonen, L.: User evaluation of mobile augmented reality scenarios. J. Ambient Intell. Smart Environ. 4(1), 29–47 (2012)Google Scholar
  4. 4.
    Radu, I., MacIntyre, B.: Augmented-reality scratch: a children’s authoring environment for augmented-reality experiences. In: 8th International Conference on Interaction Design and Children, pp. 210–213. ACM Press, New York (2009)Google Scholar
  5. 5.
    Lin, C.Y., Chang, Y.M.: Increase in physical activities in kindergarten children with cerebral palsy by employing MaKey–MaKey-based task systems. Res. Dev. Disabil. 35(9), 1963–1969 (2014)CrossRefGoogle Scholar
  6. 6.
    Chang, Y.J., Kang, Y.S., Huang, P.C.: An augmented reality (AR)-based vocational task prompting system for people with cognitive impairments. Res. Dev. Disabil. 34(10), 3049–3056 (2013)CrossRefGoogle Scholar
  7. 7.
    Solari, F., Chessa, M., Garibotti, M., Sabatini, S.P.: Natural perception in dynamic stereoscopic augmented reality environments. Displays 34(2), 142–152 (2013)CrossRefGoogle Scholar
  8. 8.
    Wojciechowski, R., Cellary, W.: Evaluation of learners attitude toward learning in ARIES augmented reality environments. Comput. Educ. 68, 570–585 (2013)CrossRefGoogle Scholar
  9. 9.
    Harris, J.: Digital skin: how developments in digital imaging techniques and culture are informing the design of futuristic surface and fabrication concepts. Text. J. Cloth Cult. 11(3), 242–261 (2013)CrossRefGoogle Scholar
  10. 10.
    Volonté, F., Pugin, F., Bucher, P., Sugimoto, M., Ratib, O., Morel, P.: Augmented reality and image overlay navigation with OsiriX in laparoscopic and robotic surgery: not only a matter of fashion. J. Hepato-Biliary-Pancreat. Sci. 18(4), 506–509 (2011)CrossRefGoogle Scholar
  11. 11.
    Piekarski, W., Thomas, B.: ARQuake: the outdoor augmented reality gaming system. Commun. ACM 45(1), 36–38 (2002)CrossRefGoogle Scholar
  12. 12.
    Andujar, J.M., Mejías, A., Marquez, M.A.: Augmented reality for the improvement of remote laboratories: an augmented re-mote laboratory. IEEE Trans. Educ. 54(3), 492–500 (2011)CrossRefGoogle Scholar
  13. 13.
    Chang, Y.J., Kang, Y.S., Huang, P.C.: An augmented reality (AR)-based vocational task prompting system for people with cognitive impairments. Res. Dev. Disabil. 34(10), 3049–3056 (2013)CrossRefGoogle Scholar
  14. 14.
    Ding, Q., Stevenson, I.H., Wang, N., Li, W., Sun, Y., Wang, Q., Kording, K., Wei, K.: Motion games improve balance control in stroke survivors: a preliminary study based on the principle of constraint-induced movement therapy. Displays 34, 125–131 (2013)CrossRefGoogle Scholar
  15. 15.
    Resnick, M.: Mother’s Day, warrior cats, and digital fluency: stories from the scratch online community. In: Proceedings of the Constructionism 2012 Conference: Theory, Practice and Impact, pp. 52–58 (2012)Google Scholar
  16. 16.
    Resnick, M., Maloney, J., Monroy-Hernández, A., Rusk, N., Eastmond, E., Brennan, K., Kafai, Y.: Scratch: programming for all. Commun. ACM 52(11), 60–67 (2009)CrossRefGoogle Scholar
  17. 17.
    Resnick, M., Rosenbaum, E.: Designing for Tinkerability. In: Solari, F., Chessa, M., Garibotti, M., Sabatini, S.P.(eds.) Natural Perception in Dynamic Stereoscopic Augmented Reality Environments. (2012) Displays, 34(2), 142-152 (2013)Google Scholar
  18. 18.
    Brennan, K., Resnick, M.: Stories from the scratch community: connecting with ideas, interests, and people. In: 44th ACM Technical Symposium on Computer Science Education, pp. 463–464. ACM Press, New York (2013)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Chien-Yu Lin
    • 1
    Email author
  • Chien-Jung Chen
    • 2
  • Yu-Hung Liu
    • 2
  • Hua-Chen Chai
    • 3
  • Cheng-Wei Lin
    • 1
  • Yu-Mei Huang
    • 1
  • Ching-Wen Chen
    • 4
  • Chien-Chi Lin
    • 5
  1. 1.Department of Special EducationNational University of TainanTainanTaiwan
  2. 2.National Pei-Men Senior Agricultural and Industrial Vocational SchoolTainanTaiwan
  3. 3.Tainan City Da Chen ElementaryTainanTaiwan
  4. 4.Tainan Municipal Syuejia Junior High SchoolTainanTaiwan
  5. 5.Department of Leisure and Recreation ManagementDa-Yeh UniversityChanghuaTaiwan

Personalised recommendations