Gesture-Based Interaction for Seamless Coordination of Presentation Aides in Lecture Streaming

  • Andrew K. Lui
  • Vanessa S. C. Ng
  • Chun-Hong Chan
Part of the Communications in Computer and Information Science book series (CCIS, volume 407)


This paper describes a novel lecture streaming system that has integrated gesture based interaction with a flexible coordination of presentation tools. The system aims to facilitate instructors giving a seamless lecture delivery that can focus more on engaging students. With simple to learn gestures, the instructors can conveniently call upon presentation tools such as presentation slides, student response system, and electronic whiteboard. The system can be used in an office with minimum hardware and no technical staff support, allowing the arrangement of impromptu lectures at a distance to promptly share any inspiration thought about an emerging influential event. The paper also reports some positive evaluation results.


Lecture streaming natural interaction gesture kinect direct manipulation distance learning 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Andersen, J., Andersen, P., Jensen, A.: The measurement of nonverbal immediacy. Journal of Applied Communication Research 7, 153–180 (1979)CrossRefGoogle Scholar
  2. 2.
    Arnold, L.: Dialogic embodied action: Using gesture to organize sequence and participation in instructional interaction. Research on Language & Social Interaction 45(3), 269–296 (2012)CrossRefGoogle Scholar
  3. 3.
    Bosetti, M., Pilolli, P., Ruffoni, M., Ronchetti, M.: Interactive whiteboards based on the WiiMote: Validation on the field. In: Proceedings of 14th International Conference on Interactive Collaborative Learning (ICL), pp. 269–273. IEEE (2011)Google Scholar
  4. 4.
    Boster, F.J., Meyer, G.S., Roberto, A.J., Inge, C., Strom, R.E.: Some effects of video streaming on educational achievement. Communication Education 55, 46–62 (2006)CrossRefGoogle Scholar
  5. 5.
    Buhagiar, T., Potter, R.: To stream or not to stream in a quantitative business course. Journal of Instructional Pedagogies 3, 1–6 (2010)Google Scholar
  6. 6.
    Flower, E., Sawa, S.: Synchronous streaming video from the classroom to the remote student’s desktop: Report of a distributed education project. In: World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education, vol. 2005(1), pp. 654–665 (2005)Google Scholar
  7. 7.
    Ford, C.E.: Collaborative construction of task activity: Coordinating multiple resources in a high school physics lab. Research on Language and Social Interaction 32, 369–408 (1999)CrossRefGoogle Scholar
  8. 8.
    Lang, S., Block, M., Rojas, R.: Sign language recognition using kinect. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2012, Part I. LNCS, vol. 7267, pp. 394–402. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  9. 9.
    Lanir, J., Booth, K.S., Findlater, L.: Observing presenters’ use of visual aids to inform the design of classroom presentation software. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 695–704. ACM (2008)Google Scholar
  10. 10.
    Lui, A.K.F., Wong, K.F., Ng, S.C., Law, K.H.: Development of a mental stress relaxation tool based on guided imagery and Microsoft Kinect. In: Proceedings Sixth International Conference on Distributed Smart Cameras (ICDSC), pp. 1–6. IEEE (October 2012)Google Scholar
  11. 11.
    McKeachie, W.J.: McKeachie’s teaching tips: Strategies, research, and theory for college and university teachers, 11th edn. Houghton Mifflin, Boston (2002)Google Scholar
  12. 12.
    McNeill, D.: Hand and mind: What gestures reveal about thought. University of Chicago Press, Chicago (1992)Google Scholar
  13. 13.
    Pogrzeba, L., Wacker, M., Jung, B.: Potentials of a low-cost motion analysis system for exergames in rehabilitation and sports medicine. In: Göbel, S., Müller, W., Urban, B., Wiemeyer, J. (eds.) Edutainment 2012/GameDays 2012. LNCS, vol. 7516, pp. 125–133. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  14. 14.
    Prince, M.: Does active learning work? A review of the research. Journal of Engineering Education 93(3), 223–231 (2004)MathSciNetCrossRefGoogle Scholar
  15. 15.
    Ronchetti, M., Avancini, M.: Using Kinect to emulate an Interactive Whiteboard. MS Thesis in Computer Science, University of Trento (2011), (retrieved)
  16. 16.
    Roth, W.M.: Gestures: Their role in teaching and learning. Review of Educational Research 71(3), 365–392 (2001)CrossRefGoogle Scholar
  17. 17.
    Shephard, K.: Questioning, promoting and evaluating the use of streaming video to support student learning. British Journal of Educational Technology 34(3), 295–308 (2003)CrossRefGoogle Scholar
  18. 18.
    Smorkalov, A., Fominykh, M., Prasolova-Førland, E.: Virtualizing real-life lectures with vAcademia and Kinect. In: Presented at the 2nd Workshop on Off-The-Shelf Virtual Reality at the International Conference on Virtual Reality (VR), Orlando, FL, USA, March 16 (2013)Google Scholar
  19. 19.
    Wachs, J.P., Kölsch, M., Stern, H., Edan, Y.: Vision-based hand-gesture applications. Communications of the ACM 54(2), 60–71 (2011)CrossRefGoogle Scholar
  20. 20.
    Wang, F., Ngo, C.W., Pong, T.C.: Gesture tracking and recognition for lecture video editing. In: Proceedings of the 17th International Conference on Pattern Recognition, ICPR 2004, vol. 3, pp. 934–937. IEEE (2004)Google Scholar
  21. 21.
    Zarraonandia, T., Aedo, I., Díaz, P.: Envisioning the transformative role of IT in lectures. Interaction Design and Architecture(s) Journal - IxD&A (15), 7–17 (2012)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Andrew K. Lui
    • 1
  • Vanessa S. C. Ng
    • 1
  • Chun-Hong Chan
    • 1
  1. 1.School of Science and TechnologyThe Open University of Hong KongHong Kong SARChina

Personalised recommendations