Evaluation of Bag-of-Word Performance for Time Series Classification Using Discriminative SIFT-Based Mid-Level Representations

  • Raquel Almeida
  • Hugo Herlanin
  • Zenilton Kleber G. do PatrocinioJr.Email author
  • Simon Malinowski
  • Silvio Jamil Ferzoli Guimarães
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11401)


Time series classification has been widely explored over the last years. Amongst the best approaches for that task, many are based on the Bag-of-Words framework, in which time series are transformed into a histogram of word occurrences. These words represent quantized features that are extracted beforehand. In this paper, we aim to evaluate the use of accurate mid-level representations in order to enhance the Bag-of-Words representation. More precisely, this kind of representation enables to reduce the loss induced by feature quantization. Experiments show that these representations are likely to improve time series classification accuracy compared to Bag-of-Words and some of them are very competitive to the state-of-the-art.


Time series Mid-level representations SIFT-based descriptors 


  1. 1.
    Bagnall, A., Lines, J., Bostrom, A., Large, J., Keogh, E.: The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances. Data Min. Knowl. Discov. 31(3), 606–660 (2017)MathSciNetCrossRefGoogle Scholar
  2. 2.
    Bagnall, A., Lines, J., Hills, J., Bostrom, A.: Time-series classification with cote: the collective of transformation-based ensembles. IEEE Trans. Knowl. Data Eng. 27(9), 2522–2535 (2015)CrossRefGoogle Scholar
  3. 3.
    Bailly, A., Malinowski, S., Tavenard, R., Chapel, L., Guyet, T.: Dense bag-of-temporal-SIFT-words for time series classification. In: Douzal-Chouakria, A., Vilar, J.A., Marteau, P.-F. (eds.) AALTD 2015. LNCS (LNAI), vol. 9785, pp. 17–30. Springer, Cham (2016). Scholar
  4. 4.
    Baydogan, M.G., Runger, G., Tuv, E.: A bag-of-features framework to classify time series. IEEE PAMI 35(11), 2796–2802 (2013)CrossRefGoogle Scholar
  5. 5.
    Boureau, Y.L., Bach, F., LeCun, Y., Ponce, J.: Learning mid-level features for recognition. Proc. CVPR 2010, 2559–2566 (2010)Google Scholar
  6. 6.
    Hills, J., Lines, J., Baranauskas, E., Mapp, J., Bagnall, A.: Classification of time series by shapelet transformation. Data Min. Knowl. Discov. 28(4), 851–881 (2014)MathSciNetCrossRefGoogle Scholar
  7. 7.
    Jaakkola, T., Haussler, D.: Exploiting generative models in discriminative classifiers. In: Advances in Neural Information Processing Systems, pp. 487–493 (1999)Google Scholar
  8. 8.
    Jegou, H., Perronnin, F., Douze, M., Sánchez, J., Perez, P., Schmid, C.: Aggregating local image descriptors into compact codes. IEEE PAMI 34(9), 1704–1716 (2012)CrossRefGoogle Scholar
  9. 9.
    Lin, J., Khade, R., Li, Y.: Rotation-invariant similarity in time series using bag-of-patterns representation. J. Intell. Inf. Syst. 39(2), 287–315 (2012)CrossRefGoogle Scholar
  10. 10.
    Peng, X., Wang, L., Wang, X., Qiao, Y.: Bag of visual words and fusion methods for action recognition: comprehensive study and good practice. Comput. Vis. Image Underst. 150, 109–125 (2016)CrossRefGoogle Scholar
  11. 11.
    Perronnin, F., Sánchez, J., Mensink, T.: Improving the fisher kernel for large-scale image classification. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6314, pp. 143–156. Springer, Heidelberg (2010). Scholar
  12. 12.
    Schäfer, P.: The BOSS is concerned with time series classification in the presence of noise. Data Min. Knowl. Discov. 29(6), 1505–1530 (2014)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Sivic, J., Zisserman, A.: Video Google: a text retrieval approach to object matching in videos. In: Proceedings of the ICCV 2003, Nice, France, pp. 1470–1477 (2003)Google Scholar
  14. 14.
    Wang, J., Yang, J., Yu, K., Lv, F., Huang, T., Gong, Y.: Locality-constrained linear coding for image classification. Proc. CVPR 2010, 3360–3367 (2010)Google Scholar
  15. 15.
    Ye, L., Keogh, E.: Time series shapelets: a new primitive for data mining. In: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 947–956. ACM (2009)Google Scholar
  16. 16.
    Zhang, J., Marszalek, M., Lazebnik, S., Schmid, C.: Local features and kernels for classification of texture and object categories: a comprehensive study. In: Proceedings of the CVPR 2006, p. 13. IEEE (2006)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Raquel Almeida
    • 1
  • Hugo Herlanin
    • 1
  • Zenilton Kleber G. do PatrocinioJr.
    • 1
    Email author
  • Simon Malinowski
    • 2
  • Silvio Jamil Ferzoli Guimarães
    • 1
  1. 1.Computer Science DepartmentPontifical Catholic University of Minas GeraisBelo HorizonteBrazil
  2. 2.Université de Rennes 1, IRISARennesFrance

Personalised recommendations