Multisensory Learning System Applying Augmented Reality

  • Cesar GuevaraEmail author
  • Dennys Mauricio Vallejo Coronel
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 1211)


Mathematics is essential in our daily life. However, traditional teaching methods are mainly limited to the use of textbooks, generating demotivation and low interest in learning the subject. The present study proposes the development of an augmented reality system for the multi-sensory learning of students in the field of mathematics. For the creation of this proposal, we have used a human–computer interface tool called Makey Makey. Besides, the Singapore method, which has produced excellent results in the learning of mathematics, is applied. Scratch, a programming language that allows people to develop applications without having deep knowledge of the code, was used for the development of the application. Scratch allows us to combine Singapore, Makey Makey, and Augmented Reality optimally for learning.


Increased Reality Multisensory learning Singapore methodology Makey Makey 


  1. 1.
    Young, J.C., Kristanda, M.B., Hansun, S.: ARmatika: 3D game for arithmetic learning with augmented reality technology. In: 2016 International Conference on Informatics and Computing (ICIC), pp. 355–360 (2016)Google Scholar
  2. 2.
    Chao, W.H., Yang, C.Y., Chang, R.C.: A study of the interactive mathematics mobile application development. In: 1st IEEE International Conference on Knowledge Innovation and Invention, ICKII 2018, pp. 248–249 (2018)Google Scholar
  3. 3.
    Li, J., Van Der Spek, E., Hu, J., Feijs, L.: SEE ME ROAR: self-determination enhanced engagement for math education relying on augmented reality. In: CHI PLAY 2017 Extended Abstracts - Extended Abstracts Publication of the Annual Symposium on Computer-Human Interaction in Play, pp. 345–351 (2017)Google Scholar
  4. 4.
    Men, O.L., Ismail, Z., Abidin, M.: Using maths model method in solving pre-algebraic problems among year five students. In: 2018 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE), pp. 222–227 (2018)Google Scholar
  5. 5.
    Kaur, B.: The why, what and how of the ‘Model’ method: a tool for representing and visualising relationships when solving whole number arithmetic word problems. ZDM 51(1), 151–168 (2018)CrossRefGoogle Scholar
  6. 6.
    Price, S., Duffy, S., Gori, M.: Developing a pedagogical framework for designing a multisensory serious gaming environment. In: Proceedings of the 1st ACM SIGCHI International Workshop on Multimodal Interaction for Education - MIE 2017, pp. 1–9 (2017)Google Scholar
  7. 7.
    Chen, C.W.J., Lo, K.M.J.: From teacher-designer to student-researcher: a study of attitude change regarding creativity in STEAM education by using Makey Makey as a platform for human-centred design instrument. J. STEM Educ. Res. 2(1), 75–91 (2019)CrossRefGoogle Scholar
  8. 8.
    Fokides, E., Papoutsi, A.: Using Makey-Makey for teaching electricity to primary school students. A pilot study. Educ. Inf. Technol. 25(2), 1193–1215 (2019)CrossRefGoogle Scholar
  9. 9.
    Ziagkas, E., Zilidou, V.I., Loukovitis, A., Politopoulos, N., Douka, S., Tsiatsos, T.: The effects of 8-week plyometric training on tennis agility performance, improving evaluation throw the Makey Makey. In: Advances in Intelligent Systems and Computing, vol. 917, pp. 280–286 (2019)Google Scholar
  10. 10.
    Ito, K.: Mobile pictogramming. In: Advances in Intelligent Systems and Computing, vol. 935, pp. 547–553 (2019)Google Scholar
  11. 11.
    Erol, O., Kurt, A.A.: The effects of teaching programming with scratch on pre-service information technology teachers’ motivation and achievement. Comput. Hum. Behav. 77, 11–18 (2017)CrossRefGoogle Scholar
  12. 12.
    Ibáñez, M.B., Delgado-Kloos, C.: Augmented reality for STEM learning: a systematic review. Comput. Educ. 123, 109–123 (2018)CrossRefGoogle Scholar
  13. 13.
    Palmarini, R., Erkoyuncu, J.A., Roy, R., Torabmostaedi, H.: A systematic review of augmented reality applications in maintenance. Robot. Comput.-Integr. Manuf. 49, 215–228 (2018)CrossRefGoogle Scholar
  14. 14.
    Yeo, J.B.W., Choy, B.H., Lim, L.G.P., Wong, L.F.: Innovative pedagogical practices, pp. 165–193 (2019)Google Scholar
  15. 15.
    Closa, G., Masó, J., Proß, B., Pons, X.: W3C PROV to describe provenance at the dataset, feature and attribute levels in a distributed environment. Comput. Environ. Urban Syst. 64, 103–117 (2017)CrossRefGoogle Scholar
  16. 16.
    Kim, W.J., Kim, I.K., Kim, M.J., Lee, E.: Effect of UX design guideline on the information accessibility for the visually impaired in the mobile health apps. In: Proceedings - 2018 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2018, pp. 1103–1106 (2019)Google Scholar
  17. 17.
    Nengroo, A.S., Kuppusamy, K.S.: Accessible images (AIMS): a model to build self-describing images for assisting screen reader users. Univers. Access Inf. Soc. 17(3), 607–619 (2017)CrossRefGoogle Scholar
  18. 18.
    Bilal, M., Yu, Z., Song, S., Wang, C.: Evaluate accessibility and usability issues of particular China and Pakistan government websites. In: 2019 2nd International Conference on Artificial Intelligence and Big Data, ICAIBD 2019, pp. 316–322 (2019)Google Scholar
  19. 19.
    Jeba, M.T., Sadia, F., Rahman, T., Hossain, K.M.I., Bhuiyan, T.: Usability and accessibility testing: a study on public sector and government websites of Bangladesh. In: Lecture Notes in Electrical Engineering, vol. 605, pp. 666–674 (2020)Google Scholar

Copyright information

© The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Cesar Guevara
    • 1
    Email author
  • Dennys Mauricio Vallejo Coronel
    • 2
  1. 1.Research Center Mechatronics and Interactive Systems MISTUniversidad Tecnológica IndoaméricaQuitoEcuador
  2. 2.Centro de PosgradosUniversidad Tecnológica de MachalaMachalaEcuador

Personalised recommendations