Abstract
Nowadays microblog has become a big source of information, and an important spreading channel as well. Owing to its unique characteristics, it is not effective to do valuable segmentation with exist-ing tools. By comparing the results of four mainstream segmentation tools on microblog corpus, this article analyzes that how segmentation tools with differ-ent characteristics influenced the seg-mentation results, and furthermore summed up the weakness of existing segmentation tools. Finally, the author proposed a “microword” centered seg-mentation method based on CRFs, which offers a new method of resolving segmentation problem in microblog.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Huang, C., Zhao, H.: Chinese Word Segmentation: A Decade Review. Journal of Chinese Information Processing 21(3), 8–20 (2007)
Xue, N.: Chinese Word Segmentation as Character Tagging. International Journal of Computational Linguistics and Chinese Language Processing 8(1), 29–48 (2003)
Che, W., Li, Z., Liu, T.: LTP: A Chinese Language Technology Platform. In: Proceedings of the COLING 2010, pp. 13–16 (2010)
Sun, W., Xu, J.: Enhancing Chinese word segmentation using unlabeled data. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing 2011, pp. 970–979 (2011)
Yuan, Z., Purver, M.: Predicting Emotion Labels for Chinese Microblog Texts. In: CEUR Workshop Proceedings, Vol. 917(4), pp. 40–47 (2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lou, H., Su, Q., Huang, J. (2013). Comparison and Optimization of Microblogging Segmentation Methods. In: Liu, P., Su, Q. (eds) Chinese Lexical Semantics. CLSW 2013. Lecture Notes in Computer Science(), vol 8229. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-45185-0_55
Download citation
DOI: https://doi.org/10.1007/978-3-642-45185-0_55
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-45184-3
Online ISBN: 978-3-642-45185-0
eBook Packages: Computer ScienceComputer Science (R0)