Recognition of Texting-While-Walking by Joint Features Based on Arm and Head Poses

  • Fumito ShinmuraEmail author
  • Yasutomo Kawanishi
  • Daisuke Deguchi
  • Ichiro Ide
  • Hiroshi Murase
  • Hironobu Fujiyoshi
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10116)


Pedestrians “texting-while-walking” increase the risk of traffic accidents, since they are often not paying attention to their surrounding environments and fails to notice approaching vehicles. Thus, the recognition of texting-while-walking from an in-vehicle camera should be helpful for safety driving assistance. In this paper, we propose a method to recognize a pedestrian texting-while-walking from in-vehicle camera images. The proposed approach focuses on the characteristic relationship between the arm and the head poses observed during a texting-while-walking behavior. In this paper, Pose-Dependent Joint HOG feature is proposed as a novel feature, which uses parts locations as prior knowledge and describes the cooccurrence of the arm and the head poses. To show the effectiveness of the proposed method, we constructed a dataset and evaluated it.



This research is partially supported by the Center of Innovation Program (Nagoya-COI) from Japan Science and Technology Agency and Grant-in-Aid for Scientific Research from The Ministry of Education, Culture, Sports, Science and Technology.


  1. 1.
    Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proceedings of 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 886–893 (2005)Google Scholar
  2. 2.
    Dollar, P., Appel, R., Belongie, S., Perona, P.: Fast feature pyramids for object detection. IEEE Trans. Pattern Anal. Mach. Intell. 36, 1532–1545 (2014)CrossRefGoogle Scholar
  3. 3.
    Felzenszwalb, P., Girshick, R., McAllester, D., Ramanan, D.: Object detection with discriminatively trained part based models. IEEE Trans. Pattern Anal. Mach. Intell. 32, 1627–1645 (2010)CrossRefGoogle Scholar
  4. 4.
    Gandhi, T., Trivedi, M.: Image based estimation of pedestrian orientation for improving path prediction. In: Proceedings of 2008 IEEE Intelligent Vehicles Symposium, pp. 506–511 (2008)Google Scholar
  5. 5.
    Haga, S., Sano, A., Sekine, Y., Sato, H., Yamaguchi, S., Masuda, K.: Effects of using a smart phone on pedestrians’ attention and walking. Procedia Manufact. 3, 2574–2580 (2015)CrossRefGoogle Scholar
  6. 6.
    Krizhevsky, A., Sutskever, I., Hinton, G.: Imagenet classification with deep convolutional neural networks. In: Proceedings of 26th Annual Conference on Neural Information Processing Systems, pp. 1097–1105 (2012)Google Scholar
  7. 7.
    Mitsui, T., Fujiyoshi, H.: Object detection by joint features based on two-stage boosting. In: Proceedings of 12th IEEE International Conference on Computer Vision Workshops, pp. 1169–1176 (2009)Google Scholar
  8. 8.
    Shimizu, H., Poggio, T.: Direction estimation of pedestrian from multiple still images. In: Proceedings of 2004 IEEE Intelligent Vehicles Symposium, pp. 596–600 (2004)Google Scholar
  9. 9.
    Stavrinos, D., Byington, K., Schwebel, D.: Distracted walking: cell phones increase injury risk for college pedestrians. J. Saf. Res. 42, 101–107 (2011)CrossRefGoogle Scholar
  10. 10.
    Tao, J., Klette, R.: Part-based RDF for direction classification of pedestrians, and a benchmark. In: Workshop on Intelligent Vehicles with Vision Technology in the 12th Asian Conference on Computer Vision, w11-p2 (2014)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Fumito Shinmura
    • 1
    • 2
    Email author
  • Yasutomo Kawanishi
    • 3
  • Daisuke Deguchi
    • 4
  • Ichiro Ide
    • 3
  • Hiroshi Murase
    • 3
  • Hironobu Fujiyoshi
    • 5
  1. 1.Institute of Innovation for Future Society (MIRAI)Nagoya UniversityNagoyaJapan
  2. 2.JST/COINagoyaJapan
  3. 3.Graduate School of Information ScienceNagoya UniversityNagoyaJapan
  4. 4.Information Strategy OfficeNagoya UniversityNagoyaJapan
  5. 5.Department of Robotics Science and TechnologyChubu UniversityKasugaiJapan

Personalised recommendations