Data Quality Issues and Duel Purpose Lexicon Construction for Mining Emotions

  • Rajib Verma
Part of the Lecture Notes in Business Information Processing book series (LNBIP, volume 37)


Mining emotions over the Internet has seen limited use even though it has important research implications in fields such as applied econometrics, the interdisciplinary study of happiness and well-being, and for various applications in customer relationship management, finance, marketing, human resources, and managerial science.

A key ingredient to making progress in these areas is the development of an emotion specific lexicon, one that can capture intensity and select relevant sentiment laden texts from online sources. An approach to doing this is developed, issues relating to data quality are pointed out, and methods to overcome them are explained.

Justifications for constructing the lexicon are given using state of the art empirical results and research. Then a 10 step algorithm that populates a lexicon using a hybrid procedure (thesaurus-corpus based) is developed. It captures sentiment no matter how it is expressed, and balances issues of speed, cost, and data quality.


Word list domain dependent emotive intensive thesaurus corpus data quality 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Admati, A.R., Pfleiderer, P.: Broadcasting opinions in a noisy environment, WP1970R, Stanford University (2000)Google Scholar
  2. 2.
    Andreevskaia, A., Bergler, S.: Mining Wordnet for Fuzzy Sentiment: Sentiment Tag Extraction from WordNet Glosses. In: Proceedings of 5th International Conference on Language Resources and Evaluation (LREC) (2006)Google Scholar
  3. 3.
    Evert, S., Krenn, B.: Methods for the qualitative evaluation of lexical association measures. In: Proceedings of the 39th Annual Meeting of the Association for Computational Linguistics, Toulouse, France (2001)Google Scholar
  4. 4.
    Fano, R.: Transmission of Information: A Statistical Theory of Communications. American Journal of Physics 29(11) (1961)Google Scholar
  5. 5.
    Krenn, B.: Empirical Implications on Lexical Association Measures. In: Proceedings of The Ninth EURALEX International Congress, Stuttgart, Germany (2000)Google Scholar
  6. 6.
    Pazienza, M.T., Pennacchiotti, M., Zanzotto, F.M.: Terminology Extraction: An Analysis of Linguistic & Statistical Approaches. In: Knowledge Mining: Proceedings of the NEMIS 2004 Final Conference (2005)Google Scholar
  7. 7.
    Sharoff, S.: Creating general-purpose corpora using automated search engine queries. In: WaCky! Working papers on the Web as Corpus (2006)Google Scholar
  8. 8.
    Sista, S., Srinivasan, S.: Polarized Lexicon for Review Classification. In: Proceedings of the International Conference on Machine Learning, Models, Technologies & Applications (2004)Google Scholar
  9. 9.
    Sokolova, M., Szpakowicz, S., Nastase, V.: Automatically Building a Lexicon from Raw Noisy Data in a Closed Domain. INTERNEG working papers, INR 01/04 (2004)Google Scholar
  10. 10.
    Verma, R.: Extraction and Classification of Emotions for Business Research. In: Communications in Computer and Information Science (CCIS), vol. 31, pp. 46–53. Springer, Heidelberg (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Rajib Verma
    • 1
  1. 1.PSE—EHESS 

Personalised recommendations