Augmenting Non-verbal Communication Using a Tangible User Interface

  • Suraksha DeviEmail author
  • Suman Deb
Conference paper
Part of the Smart Innovation, Systems and Technologies book series (SIST, volume 77)


Since the dawn of the human civilization, non-verbal communication has been a pervasive phenomenon. With the advancement of technology, this natural interaction blended with computing facility turned into a scientific tangible interaction. Computer-aided non-verbal communication can be used as a vital interface between computers and specific areas of modern life like human psychology such as emotions, social attitudes, and even for educational games. Investigative, design-focused studies have shown that TUIs provide learning aids due to the added haptic dimension and the better approachability to the shared space that can be used in supportive circumstances. In this paper, a tangible user interface has been proposed comprising of several tablets/smartphones connected to a single server. This system would help out the teachers to attain feedback (whether the students are able to understand what the teacher is trying to convey. If yes up to what level) from the students in an elementary classroom. The experiments conducted with the prototype have shown significant interaction improvements among the children and the teachers in the classroom sessions. The experiments on modeling and improving the prototype are going on to improvise the interaction specially for mobile devices and tablets.


Non-verbal communication Tangible user interface Classroom teaching–learning 


  1. 1.
    Ullmer, B., Ishii, H.: Emerging frameworks for tangible user interfaces. IBM Syst. J. 39(3–4), 915–931 (2000)CrossRefGoogle Scholar
  2. 2.
    Ullmer, B., Ishii, H.: Emerging frameworks for tangible user interfaces. In: Carroll, J.M. (ed.) Human Computer Interaction in the New Millenium, pp. 579–601. Addison-Wesley, Boston (2001)Google Scholar
  3. 3.
    Hornecker, E., Buur, J.: Getting a grip on tangible interaction: a framework on physical space and social interaction. Proc. CHI 2006, 437–446 (2006)Google Scholar
  4. 4.
    Marshall, P., Rogers, Y., Hornecker, E.: Are tangible interfaces really any better than other kinds of interfaces? In: Workshop on Tangible User Interfaces in Context and Theory, ACM CHI (2007)Google Scholar
  5. 5.
    Carroll, J.M.: Becoming social: expanding scenario-based approaches in HCI. Behav. Inf. Technol. 15(4), 266–275 (1996)CrossRefGoogle Scholar
  6. 6.
    McCroskey, J.C., Richmond, V.P., McCroskey, L.L.: Nonverbal communication in instructional contexts. In: Manusov, V.L., Patterson, M.L. (eds.) The SAGE Handbook of Nonverbal Communication, pp. 421–436. Sage Publications, Thousand Oaks, CA (2006)CrossRefGoogle Scholar
  7. 7.
    Suinn, R.M.: Teaching culturally diverse students. In: McKeachie, W.J., Svinicki, M.D., Hofer, B.K. (eds.) McKeachie’s Teaching Tips: Strategies, Research, and Theory for College and University Teachers, 12th edn, p. xxii. Houghton Mifflin, Boston (2006). (407 p.)Google Scholar
  8. 8.
    Radford, K.W.: Observing the class. Educ. Canada 30, 36–39 (1990)Google Scholar
  9. 9.
    Miller, P.W.: Nonverbal Communication, 3rd edn. NEA Professional Library, West Haven (1988)Google Scholar
  10. 10.
    Angelo, T.A., Cross, K.P.: Classroom Assessment Techniques: A Handbook for College Teachers, 2nd edn. Jossey-Bass Publishers, San Francisco (1993)Google Scholar
  11. 11.
    Neill, S.R., Caswell, C.: Body Language for Competent Teachers. Routledge, London; New York (1993)CrossRefGoogle Scholar
  12. 12.
    Webb, J.M., Diana, E.M., Luft, P., Brooks, E.W., Brennan, E.L.: Influence of pedagogical expertise and feedback on assessing student comprehension from nonverbal behavior. J. Educ. Res. 91(2), 89–97 (1997)CrossRefGoogle Scholar
  13. 13.
    I/O Brush: Drawing with Everyday Objects as Ink Kimiko Ryokai, Stefan Marti and Hiroshi Ishii MIT Media Laboratory 20 Ames Street Cambridge, MA 02139 USAGoogle Scholar
  14. 14.
    Ronald Aylmer Fisher. The design of experiments (1935)Google Scholar
  15. 15.
    Kirk, R.E.: Experimental Design. Wiley Online Library, New York (1982)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  1. 1.Department of Computer Science and EngineeringNational Institute of Technology AgartalaAgartalaIndia

Personalised recommendations