Sensors for Seamless Learning
The chapter highlights the role of sensors for supporting seamless learning experiences. In the first part, the relation between sensor tracking of learning activities and research around real-time feedback in educational situations is introduced. The authors present an overview of the kinds of sensor data that have been used for educational purposes in the literature. Secondly, the authors introduce the link between sensor data and educational interventions, and especially the role of building expert models from real-world expert tracking. The third part of the paper illustrates how educational AR applications have used sensor data for different forms of learning support. The authors present 15 design patterns that have been implemented in different educational AR applications that build on our analysis of sensor tracking. For future AR applications, the authors propose that the use of sensors for building expert performance models is essential for a variety of educational interventions.
- Araki, A., Makiyama, K., Yamanaka, H., Ueno, D., Osaka, K., Nagasaka, M., … Yao, M. (2016). Comparison of the performance of experienced and novice surgeons: Measurement of gripping force during laparoscopic surgery performed on pigs using forceps with pressure sensors. Surgical Endoscopy, 31(4), 1999–2005. https://doi.org/10.1007/s00464-016-5153-x.CrossRefGoogle Scholar
- Benedetti, F., Volpi, N. C., Parisi, L., & Sartori, G. (2014). Attention training with an Easy–to–Use brain computer interface. In Virtual, augmented and mixed reality: Applications of virtual and augmented reality (Vol. 8526, pp. 236–247). https://doi.org/10.1007/978-3-319-07464-1_22.Google Scholar
- Chia, F.-Y., & Saakes, D. (2014). Interactive training chopsticks to improve fine motor skills. In ACE’14 Proceedings of the 11th Conference on Advances in Computer Entertainment Technology Article No. 57 (pp. 1–4). https://doi.org/10.1145/2663806.2663816.
- Collins, A., Brown, J. S., & Holum, A. (1991). Cognitive apprenticeship: Making thinking visible. American Educator, 15(3), 6–11. Retrieved from https://eric.ed.gov/?id=EJ440511.
- Daponte, P., De Vito, L., Riccio, M., & Sementa, C. (2014). Design and validation of a motion-tracking system for ROM measurements in home rehabilitation. Measurement: Journal of the International Measurement Confederation, 55, 82–96. https://doi.org/10.1016/j.measurement.2014.04.021.CrossRefGoogle Scholar
- Jang, S. A., Kim, H.-I., Woo, W., & Wakefield, G. (2014). AiRSculpt: A wearable augmented reality 3D sculpting system. In Distributed, Ambient, and Pervasive Interactions. DAPI 2014. Lecture Notes in Computer Science (Vol. 8530, pp. 130–141). https://doi.org/10.1007/978-3-319-07788-8_13.CrossRefGoogle Scholar
- Jarodzka, H., Van Gog, T., Dorr, M., Scheiter, K., & Gerjets, P. (2013). Learning to see: Guiding students’ attention via a Model’s eye movements fosters learning. Learning and Instruction, 25, 62–70. https://doi.org/10.1016/j.learninstruc.2012.11.004.CrossRefGoogle Scholar
- Kowalewski, K. F., Hendrie, J. D., Schmidt, M. W., Garrow, C. R., Bruckner, T., Proctor, T., … Nickel, F. (2016). Development and validation of a sensor- and expert model-based training system for laparoscopic surgery: The iSurgeon. Surgical Endoscopy, 31(5), 2155–2165. https://doi.org/10.1007/s00464-016-5213-2.CrossRefGoogle Scholar
- Limbu, B., Rasool, J., & Klemke, R. (2016). WEKIT D1.3 WEKIT framework & training methodology. Retrieved from http://wekit.eu/wp-content/uploads/2016/07/WEKIT_D1.3.pdf.
- Oppermann, R., & Specht, M. (2006). Situated learning in the process of work. In Engaged learning with emerging technologies. https://doi.org/10.1007/1-4020-3669-8_4.
- Schneider, J. (2017). Sensor-based learning support. Open Universiteit. Retrieved from http://dspace.ou.nl/handle/1820/8782.
- Schneider, J., Börner, D., van Rosmalen, P., & Specht, M. (2014). Presentation trainer: A study on immediate feedback for developing non-verbal public speaking skills. Bulletin of the Technical Committee on Learning Technology, 16(2–3), 6–9.Google Scholar
- Schneider, J., Börner, D., van Rosmalen, P., & Specht, M. (2015). Stand tall and raise your voice! A study on the presentation trainer. Lecture notes in computer science (including subseries Lecture notes in artificial intelligence and Lecture notes in bioinformatics) (Vol. 9307). https://doi.org/10.1007/978-3-319-24258-3_23.CrossRefGoogle Scholar
- Schneider, J., Börner, D., van Rosmalen, P., & Specht, M. (2015b). Presentation trainer, your public speaking multimodal coach. In ICMI 2015—Proceedings of the 2015 ACM International Conference on Multimodal Interaction. https://doi.org/10.1145/2818346.2830603.
- Specht, M. (2009). Learning in a technology enhanced world. Context in ubiquitous learning support. Heerlen: Open Universiteit Nederland. Retrieved from http://hdl.handle.net/1820/2034.
- Specht, M., Ternier, S., & Greller, W. (2011). Mobile augmented reality for learning: A case study. Journal of the Research Center for Educational Technology, 7(1), 117–127. Retrieved from http://rcetj.org/index.php/rcetj/article/view/151.
- Specht, M., Börner, D., & Tabuenca, B. (2012). RTST trend report: Lead theme contextualisation. Retrieved from http://dspace.ou.nl/handle/1820/4356.
- Wagner, R. K., & Sternberg, R. J. (1990). Street smarts. In K. E. Clark & M. B. Clark (Eds.), Measures of leadership (pp. 493–504). West Orange, NJ, USA: Leadership Library of America.Google Scholar
- Zimmermann, A., Lorenz, A., & Oppermann, R. (2007). An operational definition of context modeling and using context. In Proceedings of CONTEXT’07 (Vol. 4635, pp. 558–571). https://doi.org/10.1007/978-3-540-74255-5_42.