Abstract
Incorporation of the arts into the current model of science, technology, engineering, and mathematics (STEAM) may have a profound impact on the future of education. In light of this, we examined a novel technology at the intersection of these disciplines. Specifically, an experiment was conducted using augmented reality to learn a musical instrument, namely the guitar. The Fretlight® guitar system uses LED lights embedded in the fretboard to give direct information to the guitarist as to where to place their fingers. This was compared to a standard scale diagram. Results indicate that the Fretlight® system led to initial significant gains in performance over a control condition using diagrams, but these effects disappeared over the course of 30 trials. Potential benefits of the augmented reality technology are discussed, and future work is outlined to better understand how embodied cognition and augmented reality can increase learning outcomes for playing musical instruments.
Chapter PDF
Similar content being viewed by others
References
Pomeroy, S.R.: From STEM to STEAM: Science and Art Go Hand-in-hand. Scientific American (2012), blogs.scientificamerican.com/guest-blog/2012/08/22/from-stem-to-steam-science-and-the-arts-go-hand-in-hand (retrieved )
Asbury, C., Rich, B. (eds.): Learning, Arts and the Brain: The Dana Consortium Report on Arts and Cognition. Dana Press, New York (2008)
Hardiman, M., Magsamen, S., McKhann, G., Eilber, J.: Neuroeducation: Learning, Arts and the Brain: Findings and Challenges for Educators and Researchers from the 2009 Johns Hopkins University Summit. The Dana Foundation, New York (2009)
Wan, C.Y., Schlaug, G.: Music Making as a Tool for Promoting Brain Plasticity Across the Life Span. The Neuroscientist 16(5), 566–577 (2010)
Kraus, N., Chandrasekaran, B.: Music Training for the Development of Auditory Skills. Nature Reviews Neuroscience 11(8), 599–605 (2010)
Wilcox, C.: Even a Few Years of Music Training Benefits the Brain. Scientific American (2012), blogs.scientificamerican.com/science-sushi/2012/08/21/even-a-few-years-of-music-training-benefits-the-brain/ (retrieved)
Flor, N.V., Holder, B.: Hearing with the Eyes: A Distributed Cognition Perspective on Guitar Song Imitation. In: Proceedings of the 18th Annual Conference of the Cognitive Science Society. LEA, New Jersey (1996)
Liarokapis, F.: Augmented Reality Scenarios for Guitar Learning. In: Proceedings of Eurographics UK Theory and Practice of Computer Graphics, pp. 163–170 (2005)
Motokawa, Y., Saito, H.: Support System for Guitar Playing using Augmented Reality Display. In: Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR 2006), Santa Barbara, Calif, USA, pp. 243–244 (October 2006)
Birchfield, D., Thornburg, H., Megowan-Romanowicz, M.C., Hatton, S., Mechtley, B., Dolgov, I., Burleson, W.: Embodiment, Multimodality, and Composition: Convergent Themes across HCI and Education for Mixed-Reality Learning environments. Advances in Human Computer Interaction, pp. 1–20 (2008)
Crayton, J.E.: STEM Art Education Movement: A Creative Approach to Education in Innovation for the 21st century. University of New Mexico, Albuquerque,(2007), http://www.campusclubmilledgeville.org/images/stem_art_education_movement_crayton.pdf (retrieved)
Vaughn, K.: Music and Mathematics: Modest Support for the Oft-Claimed Relationship. Journal of Aesthetic Education 34(3/4), 149–166 (2000)
Moreno, S., Bialystok, E., Barac, R., Schellenberg, E.G., Cepeda, N.J., Chau, T.: Short-Term Music Training Enhances Verbal Intelligence and Executive Function. Psychological Science 22, 1425–1433 (2011)
Skoe, E., Kraus, N.: A Little Goes a Long Way: How the Adult Brain is Shaped by Musical Training in Childhood. The Journal of Neuroscience 32(34), 11507–11510 (2012)
Lim, S., Lippman, L.G.: Mental Practice and Memorization of Piano Music. The Journal of General Psychology 118(1), 21–30 (1991)
Sherman, W., Craig, A.: Understanding Virtual Reality: Interface Application and Design. Morgan Kaufmann (2003)
Klin, A., Jones, W., Schultz, R., Volkmar, F.: The Enactive Mind – From Actions to Cognition: Lessons from Autism. Philosophical Transactions of the Royal Society: Biological Sciences 358, 345–360 (2003)
Clark, A.: An Embodied Cognitive Science? Trends in Cognitive Science 3, 345–351 (1999)
Alerby, E., Ferm, C.: Learning music: Embodied Experience in the Life-World. Philosophy of Music Education Review 13(2), 177–186 (2005)
Krueger, J.W.: Enacting Musical Experience. Journal of Consciousness Studies 16, 2(2), 98–123 (2009)
Matyja, J.: Embodied Music Cognition. Philosophy. The University of Edinburgh (2010), http://hdl.handle.net/1842/5325 (retrieved)
Tang, A., Owen, C., Biocca, F., Mou, W.: Comparative Effectiveness of Augmented Reality in Object Assembly. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 73–80 (2003)
Raushcer, F.H., Shaw, G., Levine, L.J., Wright, E.L., Dennis, W.R., Newcomb, R.L.: Music Training Causes Long-Term Enhancement of Preschool Children’s Spatial-Temporal Reasoning. Neurological Research 19, 2–8 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Keebler, J.R., Wiltshire, T.J., Smith, D.C., Fiore, S.M. (2013). Picking Up STEAM: Educational Implications for Teaching with an Augmented Reality Guitar Learning System. In: Shumaker, R. (eds) Virtual, Augmented and Mixed Reality. Systems and Applications. VAMR 2013. Lecture Notes in Computer Science, vol 8022. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39420-1_19
Download citation
DOI: https://doi.org/10.1007/978-3-642-39420-1_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-39419-5
Online ISBN: 978-3-642-39420-1
eBook Packages: Computer ScienceComputer Science (R0)