Two-Stage Fully Convolutional Networks for Stroke Recovery of Handwritten Chinese Character

  • Yujung WangEmail author
  • Motoharu Sonogashira
  • Atsushi Hashimoto
  • Masaaki Iiyama
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 12047)


In this paper, we propose a method to recover strokes from offline handwritten Chinese characters. The proposed method employs a fully convolutional network (FCN) to estimate the writing order of connected components in offline Chinese character images and a multi-task FCN to estimate the writing order and directions of strokes in each connected component. Online dataset CASIA-OLHWDB1.0 from the CASIA database is hired as the training set. Because the network produces discontinuous strokes, we refine the estimated writing orders using a graph cut (GC), in which the estimated directions are used for calculation of smoothness term. Experimental results with test dataset of CASIA-OLHWDB1.0tst demonstrate the effectiveness of our method.


Handwriting trajectory recovery Semantic segmentation Fully convolutional networks Graphcut 



This work was supported by JSPS KAKENHI Grant Number 17H06288.


  1. 1.
    Liu, C., Dai, R., Xiao, B.: Chinese character recognition: history, status and prospects. Front. Comput. Sci. 1(2), 126–136 (2007)CrossRefGoogle Scholar
  2. 2.
    Liu, C.-L., Jaeger, S., Nakagawa, M.: Online recognition of Chinese characters: the state-of-the-art. IEEE Trans. Pattern Anal. Mach. Intell. 26(2), 198–213 (2004)CrossRefGoogle Scholar
  3. 3.
    Zhang, X.-Y., Bengio, Y., Liu, C.-L.: Online and offline handwritten Chinese character recognition: a comprehensive study and new benchmark. Pattern Recogn. 61, 348–360 (2017)CrossRefGoogle Scholar
  4. 4.
    Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, pp. 3431–3440 (2015)Google Scholar
  5. 5.
    Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. 23(1), 1222–1239 (2001)CrossRefGoogle Scholar
  6. 6.
    Doermann, D.S., Rosenfeld, A.: Recovery of temporal information from static images of handwriting. In: Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Champaign, IL, USA, pp. 162–168 (1992)Google Scholar
  7. 7.
    Lee, S., Pan, J.C.: Offline tracing and representation of signatures. IEEE Trans. Syst. Man Cybern. 22(4), 755–771 (1992)CrossRefGoogle Scholar
  8. 8.
    Boccignone, G., Chianese, A., Cordella, L.P., Marcelli, A.: Recovering dynamic information from static handwriting. Pattern Recogn. 26(3), 409–418 (1993)CrossRefGoogle Scholar
  9. 9.
    Abuhaiba, I.S.I., Holt, M.J.J., Datta, S.: Recognition of off-line cursive handwriting. Comput. Vis. Image Underst. 71(1), 19–38 (1998)CrossRefGoogle Scholar
  10. 10.
    Zhao, B., Yang, M., Tao, J.: Drawing order recovery for handwriting Chinese characters. In: ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brighton, United Kingdom, pp. 3227–3231 (2019)Google Scholar
  11. 11.
    Lallican, P.M., Viard-Gaudin, C.: A Kalman approach for stroke order recovering from off-line handwriting. In: Proceedings of the Fourth International Conference on Document Analysis and Recognition, Ulm, Germany, vol. 2, pp. 519–522 (1997)Google Scholar
  12. 12.
    Qiao, Y., Nishiara, M., Yasuhara, M.: A framework toward restoration of writing order from single-stroked handwriting image. IEEE Trans. Pattern Anal. Mach. Intell. 28(11), 1724–1737 (2000)CrossRefGoogle Scholar
  13. 13.
    Liu, C.-L., Kim, I.-J., Kim, J.H.: Model-based stroke extraction and matching for handwritten Chinese character recognition. Pattern Recogn. 34(12), 2339–2352 (2001)CrossRefGoogle Scholar
  14. 14.
    Kato, Y., Yasuhara, M.: Recovery of drawing order from scanned images of multi-stroke handwriting. In: Fifth International Conference on Document Analysis and Recognition, pp. 261–264 (1999)Google Scholar
  15. 15.
    Qiao, Y., Yasuhara, M.: Recover writing trajectory from multiple stroked image using bidirectional dynamic search. In: 18th International Conference on Pattern Recognition (ICPR 2006), Hong Kong, pp. 970–973 (2006)Google Scholar
  16. 16.
    Kim, B., Wang, O., Öztireli, A.C., Gross, M.: Semantic segmentation for line drawing vectorization using neural networks. Comput. Graphics Forum 37(2), 329–339 (2018)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Graduate School of InformaticsKyoto UniversityKyotoJapan
  2. 2.Academic Center for Computing and Media StudiesKyoto UniversityKyotoJapan
  3. 3.Graduate School of EducationKyoto UniversityKyotoJapan

Personalised recommendations