A Tangible Constructivist AR Learning Method for Children with Mild to Moderate Intellectual Disability

  • Filip ČernýEmail author
  • Georgios Triantafyllidis
  • George Palamas
Conference paper
Part of the Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering book series (LNICST, volume 265)


This paper explores augmented tangible user interfaces (ATUIs) as a new educational paradigm for teaching special need children concepts from abstract domains. Case study being presented focuses on learning concepts of musical notation through constructivist multisensory AR experience utilizing TUI. The study was conducted in collaboration with Speciální Základní Škola Vysoké Mýto (Czech special needs school), where the experiment with such learning method using proposed ATUI called ARcomposer was held. In a user study with 22 participants, it was found that ATUIs are not only useful for children with intellectual disabilities, but that most of the children also yield great educational gains. The results of the study were concluded in a form of quantitative research in cooperation with pedagogues specialized in teaching students with intellectual disabilities.


Augmented reality Tangible user interface Constructivist learning Special education Music education Manipulative learning Multisensory 


  1. 1.
    Bakker, S., Antle, A.N., Van Den Hoven, E.: Embodied metaphors in tangible interaction design. Pers. Ubiquit. Comput. 16(4), 433–449 (2012)CrossRefGoogle Scholar
  2. 2.
    Bara, F., Gentaz, E., Colé, P.: Haptics in learning to read with children from low socio-economic status families. Br. J. Dev. Psychol. 25(4), 643–663 (2007). Scholar
  3. 3.
    Laine, T.H.: Mobile Educational Augmented Reality Games: A Systematic Literature Review and Two Case Studies (2018)CrossRefGoogle Scholar
  4. 4.
    Likert, R.: A technique for the measurement of attitudes. Arch. Psychol. (1932)Google Scholar
  5. 5.
    Marco, J., Cerezo, E., Baldassarri, S.: Bringing tabletop technology to all: evaluating a tangible farm game with kindergarten and special needs children. Pers. Ubiquit. Comput. 17(8), 1577–1591 (2013)CrossRefGoogle Scholar
  6. 6.
    McLinden, M., McCall, S.: Learning Through Touch: Supporting Children with Visual Impairments and Additional Difficulties. Routledge, Abingdon (2016)CrossRefGoogle Scholar
  7. 7.
    Schneider, B., Blikstein, P.: Flipping the flipped classroom: a study of the effectiveness of video lectures versus constructivist exploration using tangible user interfaces. IEEE Trans. Learn. Technol. 9(1), 5–17 (2016). Scholar
  8. 8.
    Simonetti Ibañez, A., Paredes Figueras, J.: Vuforia v1. 5 SDK: Analysis and evaluation of capabilities. Master’s thesis, Universitat Politècnica de Catalunya (2013)Google Scholar
  9. 9.
    Švancarová, I.: Mentální retardace. Praha: Portál, ISBN 80-7178-821-X (2003)Google Scholar
  10. 10.
    Ullmer, B., Ishii, H.: Emerging frameworks for tangible user interfaces. IBM Syst. J. 39(34), 915–931 (2000)CrossRefGoogle Scholar
  11. 11.
    Vermeeren, A.P.: DEVAN: a tool for detailed video analysis of user test data. Behav. Inf. Technol. 21(6), 403–423 (2002). Scholar
  12. 12.
    Zuckerman, O., Arida, S., Resnick, M.: Extending tangible interfaces for education: digital Montessori inspired manipulatives. In: Proceedings of CHI 2005, pp 859–868. ACM Press (2005)Google Scholar

Copyright information

© ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering 2019

Authors and Affiliations

  • Filip Černý
    • 1
    Email author
  • Georgios Triantafyllidis
    • 1
  • George Palamas
    • 1
  1. 1.Aalborg UniversityCopenhagenDenmark

Personalised recommendations