Abstract
Languages with comprehensive alphabets in written form, such as the ideographic system of Chinese adopted to Japanese, have specific combinatorial potential for text summarization and categorization. Modern Japanese text is composed of strings over the Roman alphabet, components of two phonetic systems, Japanese syllabaries hiragana and katakana, and Chinese characters. This richness of information expression facilitates, unlike from most other languages, creation of synonyms and paraphrases, which may but do not need to be context-wise substantiable, depending not only on circumstance but also on the user of the text. Therefore readability of Japanese text is largely individual; it depends on education and incorporates life-long experience. This work presents a quantitative study into common readability factors of Japanese text, for which thirteen text markers were developed. Our statistical analysis expressed as a numerical readability index is accompanied by categorization of text contents, which is visualized as a specific location on self-organizing map over a reference text corpus.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Hand, D.J., Mannila, H., Smyth, P.: Principles of Data Mining. MIT Press, Cambridge, MA (2001)
Feldman, R., Sanger, J.: The Text Mining Handbook. Cambridge University Press, Cambridge, UK (2006)
Smith, E.A., Kinkaid, P.: Derivation and Validation of the Automated Readability Index for Use with Technical Materials. Human Factors 12, 457–464 (1970)
Tateishi, Y., Ono, Y., Yamada, H.: A Computer Readability Formula of Japanese Texts for Machine Scoring. In: Proceedings of the 12th Conference on Computational Linguistics, vol. 2, pp. 649–654 (1988)
Hayashi, S.: Yomi no nouryoku to Yomiyasusa no youin to Yomareta kekka to. Mathematical Linguistics 11, 20–33 (1959)
Mc Laughlin, G.H.: SMOG grading: A new readability formula. Journal of Reading 12(8), 639–646 (1969)
Gunning, R.: The Technique of Clear Writing. McGraw-Hill, New York, NJ (1952)
Flesch, R.: A new readability yardstick. Journal of Applied Psychology 32, 221–233 (1948)
Coleman, M., Liau, T.L.: A computer readability formula designed for machine scoring. Journal of Applied Psychology 60, 283–284 (1975)
Kohonen, T.: Self-Organization and Associative Memory. Springer-Verlag, New York, NJ (1988)
Roussinov, D.G., Chen, H.: A Scalable Self-organizing Map Algorithm for Textual Classification. Artificial Intelligence Journal 15, 81–111 (1998)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Pichl, L., Narita, J. (2007). Readability Factors of Japanese Text Classification. In: Bhalla, S. (eds) Databases in Networked Information Systems. DNIS 2007. Lecture Notes in Computer Science, vol 4777. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75512-8_10
Download citation
DOI: https://doi.org/10.1007/978-3-540-75512-8_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-75511-1
Online ISBN: 978-3-540-75512-8
eBook Packages: Computer ScienceComputer Science (R0)