Person Authentication by Air-Writing Using 3D Sensor and Time Order Stroke Context

  • Lee-Wen Chiu
  • Jun-Wei HsiehEmail author
  • Chin-Rong Lai
  • Hui-Fen Chiang
  • Shyi-Chy Cheng
  • Kuo-Chin Fan
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11010)


This paper proposes touch-less system to use air-written signatures for person authentication. This smart system can verify a person’s ID without using any mouse, touch panels, or keyboards. It benefits from a 3D sensor to capture a user’s signature in air and then verifies his ID via a novel reverse time-ordered shape context. This backward representation can effectively filter out redundant lifting-up strokes and thus simplify the matching process as a path finding problem. As features to analyze a user’s signature more accurately, the rates of turning point and curvature are also embedded into this representation. Then, with a weighting scheme, the path finding problem can be solved in real time via a dynamic time warping technique. Another challenging problem is the multiplicity problem which means a signature is not always written the same due to users’ practices and moods. Thus, an agglomerative hierarchical clustering scheme is adopted to cluster users’ signatures into different subclasses. Each subclass represents different within-class variations. Another key issues is the criterion to determine the threshold for verifying and then passing a user’s signature. Experimental results proves the average within-class distance can gain the best accuracy. The proposed solution achieves quite satisfactory authentication accuracy (more than 93.5%) even though no starting gesture is required.


Air-writing ideographic signature Identity authentication Shape context Dynamic time warping 


  1. 1.
    Chen, M.Y., Alregib, G., Juang, B.-H.: Air-writing recognition—part I: modeling and recognition of characters, words, and connecting motions. IEEE Trans. Hum. Mach. Syst. 46(3), 403–413 (2016)CrossRefGoogle Scholar
  2. 2.
    Zhang, X., et al.: A new writing experience: finger writing in the air using a kinect sensor. IEEE Multimed. 20, 85–93 (2013)CrossRefGoogle Scholar
  3. 3.
    Tsuchida, K., Miyao, H., Maruyama, M.: Handwritten character recognition in the air by using leap motion controller. In: Stephanidis, C. (ed.) HCI 2015. CCIS, vol. 528, pp. 534–538. Springer, Cham (2015). Scholar
  4. 4.
    Chiang, C.-C., Wang, R.-H., Chen, B.-R.: Recognizing arbitrarily connected and superimposed handwritten numerals in intangible writing interfaces. Pattern Recognit. 61, 15–28 (2016)CrossRefGoogle Scholar
  5. 5.
    Qu, C.Z., Zhang, D.Y., Tian, J.: Online kinect handwritten digit recognition based on dynamic time warping and support vector machine. J. Inf. Comput. Sci. 12(1), 413–422 (2015)CrossRefGoogle Scholar
  6. 6.
    Su, C.-Y., et al.: Kinect-based midair handwritten number recognition system for dialing numbers and setting a timer. In: IEEE International Conference on Systems, Man and Cybernetics, pp. 2127–2130 (2014)Google Scholar
  7. 7.
    Be, S., Khan, M.F., Baig, F.: Text writing in Air. J. Inf. Disp. 14(4), 137–148 (2013)CrossRefGoogle Scholar
  8. 8.
    Aggarwa, R., et al.: Online handwriting recognition using depth sensors. In: IEEE International Conference on Document Analysis and Recognition (ICDAR) (2015)Google Scholar
  9. 9.
    Schick, A., Morlock, D., Amma, C.: Vision-based handwriting recognition for unrestricted text input in mid-air. In: Proceedings of the 14th ACM international conference on Multimodal Interaction, pp. 217–220 (2012)Google Scholar
  10. 10.
    Tian, J., Qu, C., Xu, W., Wang, S.: KinWrite: handwriting-based authentication using kinect. In: Proceedings of the 20th Annual Network and Distributed System Security Symposium (2013)Google Scholar
  11. 11.
    Ciao, G., Milanova, M., Xie, M.: Secure behavioral biometric authentication with leap motion. In 4th International Symposium on Digital Forensics and Security, pp. 25–27 (2016)Google Scholar
  12. 12.
    Belongie, S., Malik, J., Puzicha, J.: Shape context: a new descriptor for shape matching and object recognition. In: Advances in Neural Information Processing Systems, pp. 831–837 (2001)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Lee-Wen Chiu
    • 1
  • Jun-Wei Hsieh
    • 2
    Email author
  • Chin-Rong Lai
    • 1
  • Hui-Fen Chiang
    • 2
  • Shyi-Chy Cheng
    • 2
  • Kuo-Chin Fan
    • 1
  1. 1.National Central UniversityTaoyuan CityTaiwan
  2. 2.National Taiwan Ocean UniversityKeelung CityTaiwan

Personalised recommendations