Learning Manual Skills with Smart Wearables
Intensive development of e-learning methods still struggles with domains where feedback on manual and physical skills is necessary, for example, crafts or physiotherapy movements. Most of such training is currently done exclusively through direct teacher-student interaction. The traditional approach minimizes the possibilities for remote learning, requires large time investments, and contributes to high costs of education. While human feedback remains very important, modern wearable sensors allow to transfer part of the workload to e-learning. In this chapter, we present an overview of available solutions with particular focus on wearable sensors. We argue that wearable devices have the ability to enable a new step in e-learning, not only allowing the acquisition of theoretical knowledge but also training of manual and physical skills.
The authors would like to express their gratitude to PD. Dr. Cord Spreckelsen for fruitful discussions on e-learning.
This work was partially funded by the German Federal Ministry of Education and Research and the European Social Fund as part of the digital media in vocational education (DIMEBB2) initiative (funding number 01P15013).
This work was partially supported by the Faculty of Applied Mathematics AGH UST statutory tasks within subsidy of the Polish Ministry of Science and Higher Education.
- Adidas miCoach Smart Soccer Ball – White | adidas US. (n.d.). Retrieved December 29, 2017 from https://www.adidas.com/us/micoach-smart-soccer-ball/G83963.html.
- Aminoff, M. J. (Ed.). (2012). Aminoff’s electrodiagnosis in clinical neurology (6th ed.). Philadelphia: Elsevier Saunders. (OCLC: 934736824).Google Scholar
- Anupindi, R., Deshmukh, S. D., Chopra, S., Mieghem, J. V., & Zemel, E. (1999). Managing business process flows (1st ed.). Upper Saddle River: Prentice-Hall, Inc.Google Scholar
- Attwell, G. (2006). Evaluating e-learning: A guide to the evaluation of e-learning (Evaluate Europe handbook series, Vol. 2, pp. 1610–0875). Bremen: ITB, Bremen.Google Scholar
- Australian Master OHS and Environment Guide. (2007). CCH Australia Limited. (Google-Books-ID: TtIBIuVhXoYC).Google Scholar
- Baraldi, L., Paci, F., Serra, G., Benini, L., & Cucchiara, R. (2015). Gesture recognition using wearable vision sensors to enhance visitors’ Museum experiences. IEEE Sensors Journal, 1–1. Retrieved February 08, 2018, from http://ieeexplore.ieee.org/document/7058423/, https://doi.org/10.1109/JSEN.2015.2411994.
- Biofeedback – About – Mayo Clinic. (n.d.). Retrieved February 12, 2018, from https://www.mayoclinic.org/tests-procedures/biofeedback/about/pac-20384664.
- Bishop, C. (2006). Pattern recognition and machine learning. New York: Springer. Retrieved February 06, 2018, from //www.springer.com/de/book/9780387310732.
- BlueTea. (n.d.). Retrieved January 15, 2018, from https://www.bluetea.nl/en/.
- Diamond Kinetics – Engineering Better Players. (n.d.). Retrieved December 29, 2017, from http://diamondkinetics.com/.
- Dimitrios Ververidis. (n.d.). Hand simulation in WebGL with Myo interface. Retrieved February 14, 2018, from https://www.youtube.com/watch?v=l4TJm5KGKdI.
- Ebner, M., & Spot, N. (2016). Game-based learning with the leap motion controller (pp. 555–565). https://doi.org/10.4018/978-1-4666-9629-7.ch026. Retrieved February 09, 2018, from https://www.igi-global.com/chapter/game-based-learning-with-the-leap-motion-controller/139824.
- Erasmus, V., Daha, T. J., Brug, H., Richardus, J. H., Behrendt, M. D., Vos, M. C., & Beeck, E. F. V. (2010). Systematic review of studies on compliance with hand hygiene guidelines in hospital care. Infection Control & Hospital Epidemiology, 31(3), 283–294. Retrieved February 06, 2018, from https://www.cambridge.org/core/journals/infection-control-and-hospital-epidemiology/article/systematic-review-of-studies-on-compliance-with-hand-hygiene-guidelines-in-hospital-care/36AD78694A4A2BA831A598E9C935C92E, https://doi.org/10.1086/65045.
- Frey, G., Lu, H., & Powers, J. (2005). Effect of mixing methods on mechanical properties of alginate impression materials. Journal of Prosthodontics, 14(4), 221–225. Retrieved January 29, 2018, from https://doi.org/10.1111/j.1532-849X.2005.00047.x/abstract.CrossRefGoogle Scholar
- Grandjean, E., & Kroemer, K. H. E. (1997). Fitting the task to the human, fifth edition: A textbook of occupational ergonomics (5th ed.). London/Bristol: CRC Press.Google Scholar
- Gurusamy, K., Aggarwal, R., Palanivelu, L., & Davidson, B. R. (2008). Systematic review of randomized controlled trials on the effectiveness of virtual reality training for laparoscopic surgery. British Journal of Surgery, 95(9), 1088–1097. Retrieved January 29, 2018, from https://doi.org/10.1002/bjs.6344/abstract.CrossRefGoogle Scholar
- Hannig, A., Kuth, N., Özman, M., Jonas, S., & Spreckelsen, C. (2012). eMedOffice: A web-based collaborative serious game for teaching optimal design of a medical practice. BMC Medical Education, 12(1), 104. Retrieved April 29, 2015, from http://www.biomedcentral.com/1472-6920/12/104/abstract, https://doi.org/10.1186/1472-6920-12-104.
- Higgins, A., & Hannan, M. M. (2013). Improved hand hygiene technique and compliance in healthcare workers using gaming technology. Journal of Hospital Infection, 84(1), 32–37. Retrieved January 15, 2018, from http://www.sciencedirect.com/science/article/pii/S0195670113000558, https://doi.org/10.1016/j.jhin.2013.02.004.
- Hindle, K. B., Whitcomb, T. J., Briggs, W. O., & Hong, J. (2012). Proprioceptive neuromuscular facilitation (PNF): Its mechanisms and effects on range of motion and muscular function. Journal of Human Kinetics, 31, 105–113. Retrieved January 23, 2018, from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3588663/, https://doi.org/10.2478/v10078-012-0011-y
- iMotions: Biometric research, simplified. (n.d.). Retrieved January 23, 2018, from https://imotions.com/.
- Kutafina, E., Laukamp, D., Bettermann, R., Schroeder, U., & Jonas, S. M. (2016). Wearable sensors for eLearning of manual tasks: Using forearm EMG in hand hygiene training. Sensors, 16(8), 1221. Retrieved December 29, 2017, from http://www.mdpi.com/1424-8220/16/8/1221, https://doi.org/10.3390/s16081221.
- Lopes, P., You, S., Cheng, L.-P., Marwecki, S., & Baudisch, P. (2017). Providing haptics to walls & heavy objects in virtual reality by means of electrical muscle stimulation (pp. 1471–1482). ACM Press. Retrieved January 24, 2018, from http://dl.acm.org/citation.cfm?doid=3025453.3025600, https://doi.org/10.1145/3025453.3025600.
- McDaniel, T. F., Kramer, R. T., Im, F., & Snow, D. (2013). Effects of mixing technique on bubble formation in alginate impression material. General Dentistry, 61(6), 35–39.Google Scholar
- McGorry, R., Young, S. L., Murphy, P., & Brogmus, G. (2000). Experimental appraisal of a manual task evaluator. International Journal of Industrial Ergonomics, 25(3), 265–274. Retrieved February 07, 2018, from http://www.sciencedirect.com/science/article/pii/S0169814199000177, https://doi.org/10.1016/S0169-8141(99)00017-7.
- Merchant, Z., Goetz, E. T., Cifuentes, L., Keeney-Kennicutt, W., & Davis, T. J. (2014). Effectiveness of virtual reality-based instruction on students’ learning outcomes in K-12 and higher education: A meta-analysis. Computers & Education, 70, 29–40. Retrieved January 29, 2018, from http://www.sciencedirect.com/science/article/pii/S0360131513002108, https://doi.org/10.1016/j.compedu.2013.07.033.
- Murphy, P., McGorry, R., Teare, P., & Brogmus, G. (2000). Design and performance of a manual task evaluator. International Journal of Industrial Ergonomics, 25(3), 257–264. Retrieved January 29, 2018, from http://www.sciencedirect.com/science/article/pii/S0169814199000165, https://doi.org/10.1016/S0169-8141(99)00016-5.
- Myo Gesture Control Armband. (n.d.). Retrieved December 29, 2017, from https://www.myo.com/.
- Nazir, S., Kluge, A., & Manca, D. (2014). Can immersive virtual environments make the difference in training industrial operators? In Proceedings of the Human Factors and Ergonomics Society Europe Chapter 2013 Annual Conference (pp. 251–265).Google Scholar
- Neto, L. B., Grijalva, F., Maike, V. R. M. L., Martini, L. C., Florencio, D., Baranauskas, M. C. C., …Goldenstein, S. (2017). A kinect-based wearable face recognition system to aid visually impaired users. IEEE Transactions on Human-Machine Systems, 47(1), 52–64. https://doi.org/10.1109/THMS.2016.2604367.
- NormaTec Recovery. (n.d.). Retrieved January 24, 2018, from https://www.normatecrecovery.com.
- Patel, S., Park, H., Bonato, P., Chan, L., & Rodgers, M. (2012). A review of wearable sensors and systems with application in rehabilitation. Journal of NeuroEngineering and Rehabilitation, 9, 21. Retrieved January 15, 2018, from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3354997/, https://doi.org/10.1186/1743-0003-9-21.
- Peters, J. R. (2007). Machine learning of motor skills for robotics. (Ph.D. Thesis), University of Southern California.Google Scholar
- Powerdot Smart Electric Muscle Stimulator. (n.d.). Retrieved February 06, 2018, from https://www.powerdot.com/.
- RAPAEL Smart Glove | NEOFECT. (n.d.). Retrieved February 12, 2018, from http://www.neofect.com/en/product/rapael/.
- Roussos, M. (1997). Issues in the design and evaluation of a virtual reality learning environment. Unpublished master’s thesis, University of Illinois at Chicago.Google Scholar
- Saha, S. (2013). Gesture recognition from dance video for e-learning application. Unpublished master’s thesis.Google Scholar
- Shin, J.-H., Kim, M.-Y., Lee, J.-Y., Jeon, Y.-J., Kim, S., Lee, S., …Choi, Y. (2016). Effects of virtual reality-based rehabilitation on distal upper extremity function and health-related quality of life: A single-blinded, randomized controlled trial. Journal of NeuroEngineering and Rehabilitation, 13, 17. Retrieved February 05, 2018, from https://doi.org/10.1186/s12984-016-0125-x.
- Valedo®Motion. (n.d.). Retrieved January 15, 2018, from https://www.hocoma.com/solutions/valedo-motion/.
- Ververidis, D., Karavarsamis, S., Nikolopoulos, S., & Kompatsiaris, I. (2016). Pottery gestures style comparison by exploiting Myo sensor and forearm anatomy. In Proceedings of the 3rd International Symposium on Movement and Computing (pp. 3:1–3:8). New York: ACM. Retrieved February 06, 2018, from https://doi.org/10.1145/2948910.2948924.
- Vignais, N., Miezal, M., Bleser, G., Mura, K., Gorecky, D., & Marin, F. (2013). Innovative system for real-time ergonomic feedback in industrial manufacturing. Applied Ergonomics, 44(4), 566–574. Retrieved December 27, 2017, from http://www.sciencedirect.com/science/article/pii/S0003687012001858, https://doi.org/10.1016/j.apergo.2012.11.008.
- Wearable Sensors 2018–2028: Technologies, Markets & Players. (2017). Retrieved December 27, 2017, from https://www.idtechex.com/research/reports/wearable-sensors-2018-2028-technologies-markets-and-players-000555.asp.
- WHO Guidelines on Hand Hygiene in Health Care: First Global Patient Safety Challenge Clean Care Is Safer Care. (2009). Geneva: World Health Organization. Retrieved February 06, 2018, from http://www.ncbi.nlm.nih.gov/books/NBK144013/.