A Game-like Application for Dance Learning Using a Natural Human Computer Interface

  • Alexandros Kitsikidis
  • Kosmas DimitropoulosEmail author
  • Deniz Uğurca
  • Can Bayçay
  • Erdal Yilmaz
  • Filareti Tsalakanidou
  • Stella Douka
  • Nikos Grammalidis
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9177)


Game-based learning and gamification techniques are recently becoming a popular trend in the field of Technology Enhanced Learning. In this paper, we mainly focus on the use of game design elements for the transmission of Intangible Cultural Heritage (ICH) knowledge and, especially, for the learning of traditional dances. More specifically, we present a 3D game environment that employs an enjoyable natural human computer interface, which is based on the fusion of multiple depth sensors data in order to capture the body movements of the user/learner. In addition, the system automatically assesses the learner’s performance by utilizing a combination of Dynamic Time Warping (DTW) with Fuzzy Inference System (FIS) approach and provides feedback in a form of a score as well as instructions from a virtual tutor in order to promote self-learning. As a pilot use case, a Greek traditional dance, namely Tsamiko, has been selected. Preliminary small-scaled experiments with students of the Department of Physical Education and Sports Science at Aristotle University of Thessaloniki have shown the great potential of the proposed application.


Dance performance evaluation Natural human computer interface Traditional dances 



The research leading to these results has received funding from the European Community’s Seventh Framework Programme (FP7-ICT-2011-9) under grant agreement no FP7-ICT-600676 ‘‘i-Treasures: Intangible Treasures - Capturing the Intangible Cultural Heritage and Learning the Rare Know-How of Living Human Treasures’’.


  1. 1.
    De Gloria, A., Bellotti, F., Berta, R., Lavagnino, E.: Serious Games for education and training. Int. J. Serious Game 1(1), 1–14 (2014)Google Scholar
  2. 2.
    Watkins, R., Leigh, D., Foshay, R., Kaufman, R.: Kirkpatrick Plus: Evaluation and Continuous Improvement with a Community Focus. Educ. Technol. Res. Dev. 46(4), 90–96 (1998)CrossRefGoogle Scholar
  3. 3.
    Dimitropoulos, K., Manitsaris, S., Tsalakanidou, F., Nikolopoulos, S., Denby, B., Al Kork, S., Crevier-Buchman, L., Pillot-Loiseau, C., Dupont, S., Tilmanne, J., Ott, M., Alivizatou, M., Yilmaz, E., Hadjileontiadis, L., Charisis, V., Deroo, O., Manitsaris, A., Kompatsiaris, I., Grammalidis, N.: Capturing the intangible: an introduction to the i-treasures project. In: Proceedings of the 9th International Conference on Computer Vision Theory and Applications (VISAPP2014), Lisbon, 5–8 January 2014Google Scholar
  4. 4.
    Raptis, M., Kirovski, D., Hoppe, H.: Real-time classification of dance gestures from skeleton animation. In: Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, Vancouver, 05–07 August 2011Google Scholar
  5. 5.
  6. 6.
    Drobny, D., Weiss, M., Borchers, J.: Saltate! - a sensor-based system to support dance beginners. In: CHI 2009: Extended Abstracts on Human Factors in Computing Systems, pp. 3943–3948. ACM, New York (2009)Google Scholar
  7. 7.
    Aylward, R.: Sensemble: A Wireless Inertial Sensor System for InteractiveDance and Collective Motion Analysis, Masters of Science in Media Arts and Sciences, Massachusetts Institute of Technology (2006) Google Scholar
  8. 8.
  9. 9.
    Drobny D., Borchers, J.: Learning basic dance choreographies with different augmented feedback modalities. In: CHI 2010 Extended Abstracts on Human Factors in Computing Systems, ACM Press, New York Google Scholar
  10. 10.
  11. 11.
    Kinect for Windows | Voice, Movement & Gesture Recognition Technology. (2013)
  12. 12.
    Kitsikidis, A., Dimitropoulos, K., Douka, S., Grammalidis, N.: Dance Analysis using Multiple Kinect Sensors. In: VISAPP2014, Lisbon, 5–8 January 2014Google Scholar
  13. 13.
    Besl, P., McKay, N.: A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 239–256 (1992). (Los Alamitos, CA, USA: IEEE Computer Society)CrossRefGoogle Scholar
  14. 14.
    Rusu, B., Cousins, S.: 3D is here: point cloud library (PCL), In: IEEE International Conference on Robotics and Automation, 9–13 May 2011Google Scholar
  15. 15.
    Holt, G., Reinders, M., Hendriks, E.: Multi-dimensional dynamic time warping for gesture recognition. In: Thirteenth Annual Conference of the Advanced School for Computing and Imaging (2007)Google Scholar
  16. 16.
    Kitsikidis, A., Dimitropoulos, K., Yilmaz, E., Douka, S., Grammalidis, N.: Multi-sensor technology and fuzzy logic for dancer’s motion analysis and performance evaluation within a 3D virtual environment. In: HCI International (2014), Heraklion, 22–27 June 2014Google Scholar
  17. 17.
    Mamdani, E.H., Assilian, S.: An experiment in linguistic synthesis with a fuzzy logic controller. Int. J. Man Mach. Stud. 7(1), 1–13 (1975)zbMATHCrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Alexandros Kitsikidis
    • 1
  • Kosmas Dimitropoulos
    • 1
    Email author
  • Deniz Uğurca
    • 2
  • Can Bayçay
    • 2
  • Erdal Yilmaz
    • 2
  • Filareti Tsalakanidou
    • 1
  • Stella Douka
    • 3
  • Nikos Grammalidis
    • 1
  1. 1.Information Technologies InstituteITI-CERTHThessalonikiGreece
  2. 2.Argedor Information TechnologiesAnkaraTurkey
  3. 3.Department of Physical Education and Sport ScienceAristotle University of ThessalonikiThessalonikiGreece

Personalised recommendations