Skip to main content

Recent Results of Online Japanese Handwriting Recognition and Its Applications

  • Conference paper
Arabic and Chinese Handwriting Recognition (SACH 2006)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 4768))

Included in the following conference series:

Abstract

This paper discusses online handwriting recognition of Japanese characters, a mixture of ideographic characters (Kanji) of Chinese origin, and the phonetic characters made from them. Most Kanji character patterns are composed of multiple subpatterns, called radicals, which are shared among many (sometimes hundreds of) Kanji character patterns. This is common in Oriental languages of Chinese origin, i.e., Chinese, Korean and Japanese. It is also common that each language has thousands of characters. Given these characteristics, structured character pattern representation (SCPR) composed of subpatterns is effective in terms of the size reduction of a prototype dictionary (a set of prototype patterns) and the robustness to deformation of common subpatterns. In this paper, we show a prototype learning algorithm and HMM-based recognition for SCPR. Then, we combine the SCPR-based online recognizer with a compact offline recognizer employing quadratic discriminant functions. Moreover, we also discuss online handwritten Japanese text recognition and propose character orientation-free and line direction-free handwritten text recognition and segmentation. Finally, as applications of online handwritten Japanese text recognition, we show segmentation of mixed objects of text, formulas, tables and line-drawings, and handwritten text search.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. http://www.anoto.com

  2. http://www.e-pen.com

  3. Tappert, C.C., et al.: The State of the Art in On-Line Handwriting Recognition. IEEE, Trans. PAMI 12(8), 787–808 (1990)

    Google Scholar 

  4. Nakagawa, M.: Non-Keyboard Input of Japanese Text - On-line Recognition of Handwritten Characters as the Most Hopeful Approach. J. Information Processing 13(1), 15–34 (1990)

    Google Scholar 

  5. Plamondon, R., et al.: On-Line and Off-Line Handwriting Recognition: a Comprehensive Survey. IEEE Trans. PAMI 22(1), 63–82 (2000)

    Google Scholar 

  6. Jaeger, S., et al.: The State of the Art in Japanese On-line Handwriting Recognition Compared to Techniques in Western Handwriting Recognition. IJDAR 6(2), 75–88 (2003)

    Article  Google Scholar 

  7. Liu, C.L., et al.: On-Line Recognition of Chinese Characters: the State of the Art. IEEE Trans. PAMI 26(2), 198–213 (2004)

    Google Scholar 

  8. Nakagawa, M., et al.: On-line Handwritten Character Pattern Database Sampled in a Sequence of Sentences without any Writing Instructions. In: Proc. 4th ICDAR, pp. 376–381 (1997)

    Google Scholar 

  9. Nakagawa, M., et al.: Collection of On-line Handwritten Japanese Character Pattern Databases and Their Analysis. IJDAR 7(1), 69–81 (2004)

    Article  Google Scholar 

  10. Shin, J., et al.: Stroke Correspondence Search Method for Stroke-Order and Stroke-Number Free On-Line Character Recognition - Multilayer Cube Search (in Japanese). IEICE Trans J82-D-II(2), 230–239 (1999)

    Google Scholar 

  11. Kobayashi, M., et al.: RAV (Reparameterized Angular Variations) Algorithms for Online Handwriting Recognition. IJDAR 3(3), 181–191 (2001)

    Article  Google Scholar 

  12. Nakagawa, M., et al.: Robust and Highly Customizable Recognition of On-line Handwritten Japanese Characters. Proc. 13th ICPR 3, 269–273 (1996)

    Google Scholar 

  13. Nakagawa, M., et al.: A Linear-Time Elastic Matching for Stroke Number Free Recognition of On-Line Handwritten Characters. In: Proc. 4th IWFHR, pp. 48–56 (1994)

    Google Scholar 

  14. Yokota, T., et al.: An On-line Cuneiform Modeled Handwritten Japanese Character Recognition Method Free from Both the Number and Order of Character Strokes (in Japanese). Trans. IPSJ 44(3), 980–990 (2003)

    Google Scholar 

  15. Takahashi, K., et al.: A Fast HMM Algorithm for On-Line Handwritten Character Recognition. In: Proc.4th ICDAR, pp. 369–375 (1997)

    Google Scholar 

  16. Ishigaki, K., et al.: A Top-down On-line Handwritten Character Recognition Method via the Denotation of Variation. In: Proc. ICCPCOL, pp. 141–145 (1998)

    Google Scholar 

  17. Rammer, U., et al.: An Iterative Procedure for the Polygonal Approximation of Plane Closed Curves. CGIP 1, 244–256 (1972)

    Google Scholar 

  18. Kawamura, A., et al.: On-line Recognition of Freely Handwritten Japanese Characters Using Directional Feature Densities. Proc. 11th ICPR 2, 183–186 (1992)

    Google Scholar 

  19. Hamanaka, M., et al.: On-line Japanese Character Recognition Experiments by an Off-line Method. In: Proc. 2nd ICDAR, pp. 204–207 (1993)

    Google Scholar 

  20. Okamoto, M., et al.: On-line Handwritten Character Representation using Directional Features and Direction-Change Features (in Japanese). Journal of IEE Japan 119(3), 358–366 (1999)

    Google Scholar 

  21. Tokuno, J., et al.: Pen-Coordinate Information Modeling by SCPR-based HMM for On-line Japanese Handwriting Recognition. In: Proc. 18th ICPR. WED-P-II-1, vol. 3 (2006)

    Google Scholar 

  22. Kohonen, T., et al.: Improved Versions of Learning Vector Quantization. Proc. IJCNNI 1, 545–550 (1990)

    Google Scholar 

  23. Geva, S., et al.: Adaptive Nearest Neighbor Pattern Recognition. IEEE Trans. NN 2(2), 318–322 (1991)

    Google Scholar 

  24. Juang, B.-H., et al.: Discriminative Learning for Minimum Error Classification. IEEE Trans. SP 40(12), 3043–3054 (1992)

    Article  MATH  MathSciNet  Google Scholar 

  25. Sato, A., et al.: A Formulation of Learning Vector Quantization Using a New Misclassification Measure. In: Proc. 14th ICPR, pp. 322–325 (1998)

    Google Scholar 

  26. Liu, C.-L., et al.: Evaluation of Prototype Learning Algorithms for Nearest-neighbor Classifier in Application to Handwritten Character Recognition. Pattern Recognition 34, 601–615 (2001)

    Article  MATH  Google Scholar 

  27. Kitadai, A., et al.: Prototype Learning for Structured Pattern Representation Applied to On-line Recognition of Handwritten Japanese Characters (Published Online). IJDAR, 1433–2825 (2007)

    Google Scholar 

  28. Liu, C.-L., et al.: Preprocessing and Statistical /Structural Feature Extraction for Handwritten Numeral Recognition Process of Handwriting Recognition, pp. 161–168. World Scientific, Singapore (1997)

    Google Scholar 

  29. Hu, J., et al.: HMM based On-line Handwriting Recognition. IEEE Trans. PAMI 18(10), 1039–1045 (1996)

    Google Scholar 

  30. Starner, T., et al.: On-Line Cursive Handwriting Recognition Using Speech Recognition Methods. Proc. ICASSP 5, 125–128 (1994)

    Google Scholar 

  31. Kim, H.-J., et al.: On-line Recognition of Handwritten Chinese Characters based on Hidden Markov Models. Pattern Recognition 30(9), 1489–1499 (1997)

    Article  Google Scholar 

  32. Ito, H., et al.: An On-line Handwritten Character Recognition Method based on Hidden Markov Model (in Japanese). Technical Report of IEICE PRMU97-85, 95–100 (1997)

    Google Scholar 

  33. Okamoto, D., et al.: An HMM Implementation for On-line Handwriting Recognition Based on Pen-coordinate Feature and Pen-direction Feature. In: Proc. 8th ICDAR, pp. 26–30 (2005)

    Google Scholar 

  34. Nakai, M., et al.: Sub-stroke Approach to HMM-based On-line Kanji Handwriting Recognition. In: Proc. 6th ICDAR, pp. 491–495 (2001)

    Google Scholar 

  35. Cho, S.-J., et al.: Bayesian Network Modeling of Hangul Characters for On-line Handwriting Recognition. In: Proc. 7th ICDAR, pp. 207–211 (2003)

    Google Scholar 

  36. Manke, S., et al.: Combining Bitmaps with Dynamic Writing Information for On-line Handwriting Recognition. Proc. 13th ICPR, 596–598 (1994)

    Google Scholar 

  37. Vinciarelli, A., et al.: Combining Online and Offline Handwriting Recognition. In: Proc. 7th ICDAR, pp. 844–848 (2003)

    Google Scholar 

  38. Tanaka, H., et al.: Hybrid Pen-Input Character Recognition System Based on Integration of Online-Offline Recognition. In: Proc. 5th ICDAR, pp. 209–212 (1999)

    Google Scholar 

  39. Kimura, F., et al.: Modified Quadratic Discriminant Functions and the Application to Chinese Character Recognition. IEEE Trans. PAMI 9(1), 149–153 (1987)

    Google Scholar 

  40. Kittler, J., et al.: On Combining Classifiers. IEEE Trans. PAMI 20(3), 222–239 (1998)

    Google Scholar 

  41. Velek, O., et al.: A New Warping Technique for Normalizing Likelihood of Multiple Classifiers and its Effectiveness in Combined On-Line/Off-Line Japanese Character Recognition. In: Proc. 8th IWFHR, pp. 177–182 (2002)

    Google Scholar 

  42. Nakagawa, M., et al.: A Model of On-line Handwritten Japanese Text Recognition Free from Line Direction and Writing Format Constraints. IEICE Trans E88-D(8), 1815–182 (2005)

    Google Scholar 

  43. Saito, T., et al.: On the Data Base ETL9 of Handprinted Characters in JIS Chinese Characters and Its Analysis. Trans. IEICE J68-D(4), 757–764 (1985)

    Google Scholar 

  44. Kawatani, T., et al.: Handwritten Kanji Recognition with Determinant Normalized Quadratic Discriminant Function. Proc. 15th ICPR 2, 343–346 (2000)

    Google Scholar 

  45. http://www.ntt-at.com/products_e/jwords/

  46. Fukushima, T., et al.: On-line Writing-box-free Recognition of Handwritten Japanese Text Considering Character Size Variations. Proc. 15th ICPR 2, 359–363 (2000)

    MathSciNet  Google Scholar 

  47. Senda, S., et al.: A Maximum-Likelihood Approach to Segmentation-Based Recognition of Unconstrained Handwriting Text. In: Proc. of 6th ICDAR, pp. 184–188 (2001)

    Google Scholar 

  48. Inamura, Y., et al.: An On-line Writing-box-free and Writing-direction Free Recognition System for Handwritten Japanese Text (in Japanese). Technical Report of IEICE PRMU100-37, 17–24 (2000)

    Google Scholar 

  49. Nakagawa, M., et al.: On-line Handwritten Japanese Text Recognition Free from Constrains on Line Direction and Character Orientation. In: Proc. 7th ICDAR, pp. 519–523 (2003)

    Google Scholar 

  50. Senda, S., et al.: Box-free Online Character Recognition Integrating Confidence Values of Segmentation (in Japanese). Technical Report of IEICE PRMU98-138, 17–24 (1998)

    Google Scholar 

  51. Zhu, B., et al.: Segmentation of On-Line Handwritten Japanese Text Using SVM for Improving Text Recognition. In: Bunke, H., Spitz, A.L. (eds.) DAS 2006. LNCS, vol. 3872, pp. 208–219. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  52. Nakagawa, M., et al.: A Formalization of On-line Handwritten Japanese Text Recognition Free from Line Direction Constraint. Proc. 17th ICPR 2, 359–362 (2004)

    Google Scholar 

  53. Machii, K., et al.: On-line Text/Drawings Segmentation of Handwritten Patterns. In: Proc. 2nd ICDAR, pp. 710–713 (1993)

    Google Scholar 

  54. Mochida, K., et al.: Separating Figures, Mathematical Formulas and Japanese Text from Free Handwriting in Mixed On-Line Documents. IJPRAI 18(7), 1173–1187 (2004)

    Google Scholar 

  55. Senda, S., et al.: MemoPad: Software with Functions of Box-free Japanese Character Recognition and Handwritten Query Search (in Japanese). Technical Report of IEICE PRMU99-75, 85–90 (1999)

    Google Scholar 

  56. Lopresti, D., et al.: On the Searchability of Electronic Ink. Proc. of 4th IWFHR, 156–165 (1994)

    Google Scholar 

  57. Oda, H., et al.: A Search Method for On-line Handwritten Text Employing Writing-box-free Handwriting Recognition. In: Proc. 9th IWFHR, pp. 545–550 (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

David Doermann Stefan Jaeger

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Nakagawa, M., Tokuno, J., Zhu, B., Onuma, M., Oda, H., Kitadai, A. (2008). Recent Results of Online Japanese Handwriting Recognition and Its Applications. In: Doermann, D., Jaeger, S. (eds) Arabic and Chinese Handwriting Recognition. SACH 2006. Lecture Notes in Computer Science, vol 4768. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-78199-8_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-78199-8_11

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-78198-1

  • Online ISBN: 978-3-540-78199-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics