Towards Efficient and Real-Time Human Activity Recognition Using Wearable Sensors: A Shapelet-Based Pattern Matching Approach

  • Delaram YazdansepasEmail author
  • Nitin Saroha
  • Lakshmish Ramaswamy
  • Khaled Rasheed
Conference paper
Part of the EAI/Springer Innovations in Communication and Computing book series (EAISICC)


With the advent and proliferation of wearable sensors, Human Activity Recognition (HAR) has received considerable research attention in recent years. Most existing HAR systems operate in a batch-processing (offline) mode, and they rely upon complex features from accelerometer readings for activity recognition. On the other hand, many applications such as continuous patient monitoring and elder fall detection demand real-time human activity recognition, and existing offline systems are inadequate for these applications. In this paper, we investigate challenges of real-time human activity recognition and present an effective framework based on a waveform pattern matching approach. We introduce the concept of A-Shapelets (activity shapelets), which is a representative pattern for each activity. Our framework incorporates several novel aspects; first, we present a scheme for computing the most distinctive A-Shapelet for each activity. Our scheme extracts repetitive patterns from wave forms. Second, our framework builds decision tree models using a personalized library of A-Shapelets. Third, we present a low-overhead matching algorithm for classifying incoming accelerometer data stream in real-time. This paper reports a series of experiments to evaluate the proposed framework. Our experiments demonstrate that the performance of our scheme is very good and the accuracy is comparable to offline HAR systems.


Activity recognition Time series Shapelet Pattern matching Wearable device Accelerometer 



The authors would like to thank Paula Capece, Grant Cooksey, Dr. Jennifer Gay, Dr. Fredrick Maier for their contributions and help in this project. Also we would like to thank Dr. Matthew Buman for providing us the dataset. This research has been partially funded by the National Science Foundation (NSF) under grant numbers CCF-1442672 and SES- 1637277. Any opinions, findings, conclusions, or recommendations expressed in this material are those of the authors, and do not necessarily reflect the views of the NSF.


  1. 1.
    Cassisi, C., Montalto, P., Aliotta, M., Cannata, A., Pulvirenti, A.: Similarity measures and dimensionality reduction techniques for time series data mining. In: Advances in data mining knowledge discovery and applications. InTech (2012)Google Scholar
  2. 2.
    Castillo, J.C., Carneiro, D., Serrano-Cuerda, J., Novais, P., Fernández-Caballero, A., Neves, J.: A multi-modal approach for activity classification and fall detection. Int. J. Syst. Sci. 45(4), 810–824 (2014)CrossRefGoogle Scholar
  3. 3.
    Das, B., Seelye, A.M., Thomas, B.L., Cook, D.J., Holder, L.B., Schmitter-Edgecombe, M.: Using smart phones for context-aware prompting in smart environments. In: Consumer Communications and Networking Conference (CCNC), pp. 399–403. IEEE, Piscataway (2012)Google Scholar
  4. 4.
    Ermes, M., Parkka, J., Mantyjarvi, J., Korhonen, I.: Detection of daily activities and sports with wearable sensors in controlled and uncontrolled conditions. IEEE Trans. Inf. Technol. Biomed. 12(1), 20–26 (2008)CrossRefGoogle Scholar
  5. 5.
    Feng, T., Timmermans, H.J.: Transportation mode recognition using {GPS} and accelerometer data. Transp. Res. C Emerg. Technol. 37, 118–130 (2013)CrossRefGoogle Scholar
  6. 6.
    Ignatov, A.D., Strijov, V.V.: Human activity recognition using quasiperiodic time series collected from a single tri-axial accelerometer. Multimed. Tools Appl. 75(12), 7257–7270 (2016). CrossRefGoogle Scholar
  7. 7.
    Negri, L.H.: Peakutils (2014). Google Scholar
  8. 8.
    Niazi, A.H., Yazdansepas, D., Gay, J.L., Maier, F.W., Ramaswamy, L., Rasheed, K., Buman, M.P.: A hierarchical meta-classifier for human activity recognition. In: 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA), pp. 81–86. IEEE, Piscataway (2016).
  9. 9.
    Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., Duchesnay, E.: Scikit-learn: machine learning in python. J. Mach. Learn. Res. 12, 2825–2830 (2011). MathSciNetzbMATHGoogle Scholar
  10. 10.
    Ratanamahatana, C.A., Keogh, E.: Making time-series classification more accurate using learned constraints. In: Proceedings of the 2004 SIAM International Conference on Data Mining. pp. 11–22. SIAM (2004)Google Scholar
  11. 11.
    Ratanamahatana, C.A., Keogh, E.: Three myths about dynamic time warping data mining. In: Proceedings of the 2005 SIAM International Conference on Data Mining, pp. 506–510. SIAM (2005)Google Scholar
  12. 12.
    Seto, S., Zhang, W., Zhou, Y.: Multivariate time series classification using dynamic time warping template selection for human activity recognition. In: 2015 IEEE Symposium Series on Computational Intelligence, pp. 1399–1406. IEEE, Piscataway (2015)Google Scholar
  13. 13.
    Shultz, S., Houglum, P., Perrin, D.: Examination of Musculoskeletal Injuries with Web Resource, 3rd edn. Human Kinetics Publishers, Champaign (2009)Google Scholar
  14. 14.
    Wu, W.H., Bui, A.A.T., Batalin, M.A., Au, L.K., Binney, J.D., Kaiser, W.J.: MEDIC: medical embedded device for individualized care. Artif. Intell. Med. 42(2), 137–152 (2008)CrossRefGoogle Scholar
  15. 15.
    Yazdansepas, D., Niazi, A.H., Gay, J.L., Maier, F.W., Ramaswamy, L., Rasheed, K., Buman, M.P.: A multi-featured approach for wearable sensor-based human activity recognition. In: 2016 IEEE International Conference on Healthcare Informatics, ICHI 2016, pp. 423–431. Chicago (2016).
  16. 16.
    Zaharia, M., Xin, R.S., Wendell, P., Das, T., Armbrust, M., Dave, A., Meng, X., Rosen, J., Venkataraman, S., Franklin, M.J., Ghodsi, A., Gonzalez, J., Shenker, S., Stoica, I.: Apache spark: a unified engine for big data processing. Commun. ACM 59(11), 56–65 (2016)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Delaram Yazdansepas
    • 1
    Email author
  • Nitin Saroha
    • 1
  • Lakshmish Ramaswamy
    • 1
  • Khaled Rasheed
    • 1
  1. 1.Department of Computer ScienceUniversity of GeorgiaAthensUSA

Personalised recommendations