The Future of Learning Multisensory Experiences: Visual, Audio, Smell and Taste Senses

  • Aleksandra Klašnja-MilićevićEmail author
  • Zoran Marošan
  • Mirjana Ivanović
  • Ninoslava Savić
  • Boban Vesin
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 804)


This paper describes an investigative study about the sense of smell, taste, hearing and vision to assist process of learning. This will serve to start the design and construction of a multisensory human-computer interface for different educational applications. The most important part is understanding the ways in which learners’ senses process learning and memorize information and in which relation these activities are.

Though sensory systems and interfaces have developed significantly over the last few decades, there are still unfulfilled challenges in understanding multisensory experiences in Human Computer Interaction. The researchers generally rely on vision and listening, some of them focus on touch, but the taste and smell senses remain uninvestigated. Understanding the ways in which human’s senses influence the process, learning effects and memorizing information may be important to e-learning system and its higher functionalities. In order to analyze these questions, we carried out several usability studies with students to see if visual or audio experiences, different smells or tastes can assist and support memorizing information. Obtained results have shown improvement of learning abilities when using different smells, tastes and virtual reality facilities.


Learning Human-computer Interface Virtual reality Sense of smell Sense of taste 


  1. 1.
    Mansor, N., Jamaluddin, H., Shukor, Z.: Concept and application of virtual reality haptic technology: a review. J. Theor. Appl. Inf. Technol. 95(14), (2017)Google Scholar
  2. 2.
    Obrist, M., Velasco, C., Thanh, C., Cheok, D., Spence, C., Ponnampalam, G.: Sensing the future of HCI: touch, taste, and smell user interfaces. Interactions 23(5), 40–49 (2016)CrossRefGoogle Scholar
  3. 3.
    Gallace, A., Spence, C.: In Touch with the Future: The Sense of Touch from Cognitive Neuroscience to Virtual Reality. OUP Oxford, Oxford (2014)CrossRefGoogle Scholar
  4. 4.
    Thalmann, D.: Sensors and actuators for HCI and VR: a few case studies. In: Frontiers in Electronic Technologies, pp. 65–83. Springer (2017)Google Scholar
  5. 5.
    Shen, C.W., Ho, J.T., Kuo, T.C., Luong, T.H.: Behavioral intention of using virtual reality in learning. In: International Conference on World Wide Web Companion, pp. 129–137 (2017)Google Scholar
  6. 6.
    Zahira, M., Ernest, G., Cifuentes, L., Wendy, K., Trina, D.: Effectiveness of virtual reality-based instruction on students’ learning outcomes in K-12 and higher education: a meta-analysis. Comput. Educ. 70, 29–40 (2014)CrossRefGoogle Scholar
  7. 7.
    Martín-Gutiérrez, J., Fabiani, P., Benesova, W., Meneses, D., Mora, W.: Augmented reality to promote collaborative and autonomous learning in higher education. Comput. Hum. Behav. 51, 752–761 (2015)CrossRefGoogle Scholar
  8. 8.
    Mancini, E., Beglinger, C., Drewe, J., Borgwardt, S.: Green tea effects on cognition, mood and human brain function: a systematic review. Phytomedicine 34, 26–37 (2017)CrossRefGoogle Scholar
  9. 9.
    Garcia-Ruiz, M., El-Seoud, S.A., Edwards, A., Aquino-Santos, R.: Integrating the sense of smell in an educational human computer interface. In: Interactive Computer Aided Learning Conference (2008)Google Scholar
  10. 10.
    Kaye, N.: Olfactory Display. MSc thesis, Massachusetts Institute of Technology (2001) Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Aleksandra Klašnja-Milićević
    • 1
    Email author
  • Zoran Marošan
    • 2
  • Mirjana Ivanović
    • 1
  • Ninoslava Savić
    • 2
  • Boban Vesin
    • 3
  1. 1.University of Novi Sad, Faculty of Sciences, Department of Mathematics and InformaticsNovi SadSerbia
  2. 2.Department of Informatics, Novi Sad School of BusinessNovi SadSerbia
  3. 3.Department of Computer and Information ScienceTrondheimNorway

Personalised recommendations