Abstract
In sentiment classification, traditional classification algorithms cannot perform well when the number of labeled data is limited. EM-based Naïve Bayes algorithm is often employed to argument the labeled data with the unlabeled ones. However, such an approach assumes the distributions of these two sets of data are identical, which may not hold in practice and often results in inferior performance.
We propose a semi-supervised algorithm, called Ratio-Adjusted EM-based Naïve Bayes (RAEMNB), for sentiment classification, which combines knowledge from a source domain and limited training instances from a target domain. In RAEMNB, the initial Bayes model is trained from labeled instances from both domains. During each EM iteration, we add an extra R-step to adjust the ratio of predicted positive instances to negative ones, which is approximated with labeled instances of target domain. Experimental results show that our RAEMNB approach outperforms the traditional supervised, semi-supervised classifiers.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aue, A., Gamon, M.: Customizing Sentiment Classifiers to New Domains: a Case Study. In: Proceedings of the International Conference on Recent Advances in Natural Language Processing, pp. 207–218 (2005)
Blitzer, J., Dredze, M., Pereira, F.: Biographies, Bollywood, Boomboxes and Blenders: Domain Adaptation for Sentiment Classification. In: ACL. pp. 187–205 (2007)
Chang, C.C., Lin, J.: LIBSVM: A Library for Support Vector Machines. Software (2001), http://www.csie.ntu.edu.tw/~cjlin/libsvm
Kennedy, A., Inkpen, D.: Sentiment Classification of Movie Reviews Using Contextual Valence Shifters. In: Computational Intelligence, vol. 22, pp. 110–125 (2006)
Kullback, S., Leibler, R.A.: On Information and Sufficiency. In: The Annals of Mathematical Statistics, vol. 22, pp. 79–86 (1951)
Nigam, K., Mccallum, A.K., Thrun, S., Mitchell, T.: Text Classification from Labeled and Unlabeled Documents Using EM. In: Machine Learning, vol. 39, pp. 103–134 (2000)
Pan, S.J., Ni, X., Sun, J.T., Yang, Q., Chen, Z.: Cross-domain Sentiment Classification via Spectral Feature Alignment. In: Proceedings of the 19th International Conference on World Wide Web, WWW 2010, pp. 751–760 (2010)
Pan, S.J., Yang, Q.: A Survey on Transfer Learning. Technical report. (2009), http://doi.ieeecomputersociety.org/10.1109/TKDE.2009.191 (in press,2009)
Pang, B., Lee, L.: Opinion Mining and Sentiment Analysis. In: Foundations and Trends in Information Retrieval, vol. 2, pp. 1–135 (2008)
Pang, B., Lee, L., Vaithyanathan, S.: Thumbs up?: Sentiment Classification Using Machine Learning Techniques. In: EMNLP 2002: Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing, pp. 79–86 (2002)
Porter, M.F.: An Algorithm for Suffix Stripping. In: Program, vol. 14, pp. 130–137 (1980)
Tan, S., Cheng, X.: Improving SCL Model for Sentiment-Transfer Learning. In: Proceedings of Annual Conference of the North American Chapter of the Association for Computational Linguistics, pp. 181–184 (2009)
Tan, S., Cheng, X., Wang, Y., Xu, H.: Adapting Naïve Bayes to Domain Adaptation for Sentiment Analysis. In: Boughanem, M., Berrut, C., Mothe, J., Soule-Dupuy, C. (eds.) ECIR 2009. LNCS, vol. 5478, pp. 337–349. Springer, Heidelberg (2009)
Thomas, M., Pang, B., Lee, L.: Get out the Vote: Determining Support or Opposition from Congressional Floor-debate Transcripts. In: EMNLP 2006: Proceedings of the ACL 2006 Conference on Empirical Methods in Natural Language Processing,Association for Computational Linguistics. pp. 327–335 (2006)
Tsuruoka, Y., Tsujii, J.: Training a Naïve Bayes Classifier via the EM Algorithm with a Class Distribution Constraint. In: Proceedings of the Seventh Conference on Natural language Learning at HLT-NAACL, pp. 127–134 Association for Computational Linguistics. Morristown (2003)
Turney, P.D.: Thumbs up or Thumbs down?: Semantic Orientation Applied to Unsupervised Classification of Reviews. In: ACL 2002: Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, Morristown, pp. 417–424 (2002)
Xue, G.R., Dai, W., Yang, Q., Yu, Y.: Topic-bridged PLSA for Cross-domain Text Classification. In: Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), pp. 627–634 (2008)
Yang, Y., Pedersen, J.O.: A Comparative Study on Feature Selection in Text Categorization. In: Proceedings of ICML 1997, 14th International Conference on Machine Learning, Nashville, US, pp. 412–420. Morgan Kaufmann Publishers, San Francisco (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chen, W., Zhou, J. (2010). A Text Classifier with Domain Adaptation for Sentiment Classification. In: Cheng, PJ., Kan, MY., Lam, W., Nakov, P. (eds) Information Retrieval Technology. AIRS 2010. Lecture Notes in Computer Science, vol 6458. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-17187-1_6
Download citation
DOI: https://doi.org/10.1007/978-3-642-17187-1_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-17186-4
Online ISBN: 978-3-642-17187-1
eBook Packages: Computer ScienceComputer Science (R0)