The Effect of Voice Instruction on the Construction of Mental Model

  • Restyandito
  • Alan H. S. Chan
  • Umi Proboyekti
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8511)


The goal of this study is to observe the effect of instruction deliverance method in the construction of mental model. A good mental model can help the user’s learnability process. There were two methods tested in this study: a step-by-step instruction (SS) and a complete set of whole-steps instructions (WS) to finish a given task. The SS group performed better on the learning process, however they had the least score on both the information retention and transfer process. Their minds were not engaged in the process, as they seemed to simply follow the instructions without being critical. When error occurred, they tended to be less persistent in trying to finish the task. This might be caused by the incomplete mental model as a result of receiving the instruction step by step.


voice instruction mental model learnability 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Lin, D., Bigin, L., Bao-zong, Y.: Using chinese spoken-language access to the WWW. In: 5th International Conference on Signal Processing, Proceedings of the WCCC-ICSP 2000, vol. 2, pp. 1321–1324 (2000)Google Scholar
  2. 2.
    Hofmann, H., Ehrlich, U., Berton, A., Minker, W.: Speech interaction with the internet - A user study. In: Proc - Int. Conf. Intelligent Environ., pp. 323–326 (2012)Google Scholar
  3. 3.
    Sazbon, M., Haddad, Y.: Advanced vocal web browser. In: IEEE Conv. Electr. Electron Eng. Israel, pp. 732–735 (2010)Google Scholar
  4. 4.
    Werner, S., Wolff, M., Eichner, M., Hoffmann, R.: Integrating speech enabled services in a web-based e-learning environment. In: Internat. Conf. Inf. Tech. Coding Comput., pp. 303–307 (2004)Google Scholar
  5. 5.
    Neerincx, M.A., Cremers, A.H.M., Kessens, J.M., van Leeuwen, D.A., Truong, K.P.: Attuning speech-enabled interfaces to user and context for inclusive design: Technology, methodology and practice. Univers Access Inf. Soc. 8(2), 109–122 (2009)CrossRefGoogle Scholar
  6. 6.
    Knudsen, L.E., Holone, H.: A multimodal approach to accessible web content on smart-phones. In: Miesenberger, K., Karshmer, A., Penaz, P., Zagler, W. (eds.) ICCHP 2012, Part II. LNCS, vol. 7383, pp. 1–8. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  7. 7.
    Boufardea, E., Garofalakis, J., Plessas, A.: A dynamic voice portal for delivery of cultural content. In: Proc. - Int. Conf. Internet Web Appl. Serv., pp. 186–191 (2008)Google Scholar
  8. 8.
    Fein, R.M., Olson, G.M., Olson, J.S.: A mental model can help with learning to operate a complex device, pp. 157–158. ACM (1993)Google Scholar
  9. 9.
    Rouse, W.B., Morris, N.M.: On looking into the black box: Prospects and limits in the search for mental models. Psychol. Bull. 100(3), 349 (1986)CrossRefGoogle Scholar
  10. 10.
    Kieras, D.E., Bovair, S.: The role of a mental model in learning to operate a device. Cogn Sci. 8(3), 255–273 (1984)CrossRefGoogle Scholar
  11. 11.
    Phillips, R., Lockton, D., Baurley, S., Silve, S.: Making instructions for others: Exploring mental models through a simple exercise. Interactions 20(5), 74–79 (2013)CrossRefGoogle Scholar
  12. 12.
    Smith, R.: Game impact theory: The five forces that are driving the adoption of game technologies within multiple established industries. Games and Society Yearbook (2007)Google Scholar
  13. 13.
    Rigas, D.I., Alsuraihi, M.: A toolkit for multimodal interface design: An empirical investigation. In: Jacko, J.A. (ed.) HCI 2007. LNCS, vol. 4552, pp. 196–205. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  14. 14.
    Rigas, D., Yu, H., Klearhou, K., Mistry, S.: Designing information systems with audio-visual synergy: Empirical results of browsing E-mail data, pp. 960-7620 (2001)Google Scholar
  15. 15.
    Wersényi, G.: Auditory representations of a graphical user interface for a better human-computer interaction. In: Ystad, S., Aramaki, M., Kronland-Martinet, R., Jensen, K. (eds.) CMMR/ICAD 2009. LNCS, vol. 5954, pp. 80–102. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  16. 16.
    Sodnik, J., Dicke, C., Tomažic, S., Billinghurst, M.: A user study of auditory versus visual interfaces for use while driving. Int. J. Hum. Comput. Stud. 66(5), 318–332 (2008)CrossRefGoogle Scholar
  17. 17.
    Burke, J.L., Prewett, M.S., Gray, A.A., Yang, L., Stilson, F.R.B., Coovert, M.D., Elliot, L.R., Redden, E.: Comparing the effects of visual-auditory and visual-tactile feedback on user performance: A meta-analysis, pp. 108–117 (2008)Google Scholar
  18. 18.
    Baddeley, A.D.: Your memory: A user’s guide. Sidgwick & Jackson, London (1982)Google Scholar
  19. 19.
    Carpenter, S., Huffman, K.: Visualizing psychology. Wiley. com (2009)Google Scholar
  20. 20.
    Ujita, H., Yokota, T., Tanikawa, N., Mutoh, K.: Computer aided instruction systems for plant operators. Int. J. Hum. Comput. Stud. 45(4), 397–412 (1996)CrossRefGoogle Scholar
  21. 21.
    Schwamborn, A., Thillmann, H., Opfermann, M., Leutner, D.: Cognitive load and instructionally supported learning with provided and learner-generated visualizations. Comput. Hum. Behav. 27(1), 89–93 (2011)CrossRefGoogle Scholar
  22. 22.
    Ainsworth, S.: The functions of multiple representations. Comput. Educ. 33(2-3), 131–152 (1999)CrossRefGoogle Scholar
  23. 23.
    Leutner, D., Leopold, C., Sumfleth, E.: Cognitive load and science text comprehension: Effects of drawing and mentally imagining text content. Comput. Hum. Behav. 25(2), 284–289 (2009)CrossRefGoogle Scholar
  24. 24.
    Harvey, G.: Designing procedural instructions: 5 key components. Inf. Des. J. 16(1), 19–24 (2008)Google Scholar
  25. 25.
    Deo, S., Nichols, D.M., Cunningham, S.J., Witten, I.H., Trujillo, M.F.: Digital library access for illiterate users (2004)Google Scholar
  26. 26.
    Darabi, A.A., Sikorski, E.G., Nelson, D.W., Palanki, S.: Efficient, motivational, and effective strategies for complex learning: Computer-based simulation experiments in troubleshooting. Technology Instruction Cognition and Learning 3(3/4), 233 (2006)Google Scholar
  27. 27.
    Darabi, A.A., Nelson, D.W., Seel, N.M.: The role of supportive information in the development and progression of mental models. In: Learning and Instruction in the Digital Age, pp. 101–115. Springer (2010)Google Scholar
  28. 28.
    Marchionini, G.: Making the transition from print to electronic encyclopaedias: Adaptation of mental models. Int. J. Man Mach. Stud. 30(6), 591–618 (1989)CrossRefGoogle Scholar
  29. 29.
    Sherwani, J., Palijo, S., Mirza, S., Ahmed, T., Ali, N., Rosenfeld, R.: Speech vs. touch-tone: Telephony interfaces for information access by low literate users. In: Int. Conf. Inf. Commun. Technol. Development, pp. 447–457 (2009)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Restyandito
    • 1
  • Alan H. S. Chan
    • 1
  • Umi Proboyekti
    • 2
  1. 1.Dept. of Systems Eng. & Engineering Mgt.City University of Hong KongHong Kong SAR
  2. 2.Dept. of Information TechnologyDuta Wacana Christian Univ.YogyakartaIndonesia

Personalised recommendations