Skip to main content

On the Quality of Annotations with Controlled Vocabularies

  • Conference paper
  • First Online:
Collective Online Platforms for Financial and Environmental Awareness (IFIN 2016, ISEM 2016)

Abstract

Corpus analysis and controlled vocabularies can benefit from each other in different ways. Usually, a controlled vocabulary is assumed to be in place and is used for improving the processing of a corpus. However, in practice the controlled vocabularies may be not available or domain experts may be not satisfied with their quality. In this work we investigate how one could measure how well a controlled vocabulary fits a corpus. For this purpose we find all the occurrences of the concepts from a controlled vocabulary (in form of a thesaurus) in each document of the corpus. After that we try to estimate the density of information in documents through the keywords and compare it with the number of concepts used for annotations. The introduced approach is tested with a financial thesaurus and corpora of financial news.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    projectprofit.eu.

  2. 2.

    http://zbw.eu/stw/.

  3. 3.

    http://www.investing.com/currencies/eur-usd-news.

  4. 4.

    http://www.investing.com/commodities/crude-oil-news.

  5. 5.

    http://www.investing.com/indices/eu-stoxx50-news.

  6. 6.

    https://www.poolparty.biz.

References

  1. Ahmad, K., Tariq, M., Vrusias, B., Handy, C.: Corpus-based thesaurus construction for image retrieval in specialist domains. In: Sebastiani, F. (ed.) ECIR 2003. LNCS, vol. 2633, pp. 502–510. Springer, Heidelberg (2003). doi:10.1007/3-540-36618-0_36

    Chapter  Google Scholar 

  2. Aussenac-Gilles, N., Biébow, B., Szulman, S.: Revisiting ontology design: a method based on corpus analysis. In: Dieng, R., Corby, O. (eds.) EKAW 2000. LNCS (LNAI), vol. 1937, pp. 172–188. Springer, Heidelberg (2000). doi:10.1007/3-540-39967-4_13

    Chapter  Google Scholar 

  3. Bechhofer, S., Miles, A.: Skos simple knowledge organization system reference. In: W3C recommendation, W3C (2009)

    Google Scholar 

  4. Birkhoff, G.: Lattice Theory, 3rd edn. Am. Math. Soc., Providence (1967)

    MATH  Google Scholar 

  5. Borst, T., Neubert, J.: Case study: publishing stw thesaurus for economics as linked open data. In: W3C Semantic Web Use Cases and Case Studies (2009)

    Google Scholar 

  6. Jimeno-Yepes, A.J., Aronson, A.R.: Knowledge-based biomedical word sense disambiguation: comparison of approaches. BMC Bioinform. 11(1), 1–12 (2010)

    Article  Google Scholar 

  7. Kacfah Emani, C.: Automatic detection and semantic formalisation of business rules. In: Presutti, V., d’Amato, C., Gandon, F., d’Aquin, M., Staab, S., Tordai, A. (eds.) ESWC 2014. LNCS, vol. 8465, pp. 834–844. Springer, Heidelberg (2014). doi:10.1007/978-3-319-07443-6_57

    Chapter  Google Scholar 

  8. Levy, F., Guisse, A., Nazarenko, A., Omrane, N., Szulman, S.: An environment for the joint management of written policies and business rules. In: 2010 22nd IEEE International Conference on Tools with Artificial Intelligence, vol. 2, pp. 142–149, October 2010

    Google Scholar 

  9. Magerman, D.M., Marcus, M.P.: Parsing a natural language using mutual information statistics. In: AAAI, vol. 90, pp. 984–989 (1990)

    Google Scholar 

  10. Mandala, R., Tokunaga, T., Tanaka, H.: Combining multiple evidence from different types of thesaurus for query expansion. In: Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 191–197. ACM (1999)

    Google Scholar 

  11. Mani, I., Maybury, M.T.: Advances in Automatic Text Summarization, vol. 293. MIT Press, Cambridge (1999)

    Google Scholar 

  12. Neubert, J.: Bringing the “thesaurus for economics” on to the web of linked data. In: LDOW, 25964 (2009)

    Google Scholar 

  13. Rose, S., Engel, D., Cramer, N., Cowley, W.: Automatic keyword extraction from individual documents. In: Berry, M.W., Kogan, J. (eds.) Text Mining, pp. 1–20. Wiley, New York (2010)

    Chapter  Google Scholar 

  14. Shah, P.K., Perez-Iratxeta, C., Bork, P., Andrade, M.A.: Information extraction from full text scientific articles: where are the keywords? BMC Bioinform. 4(1), 1 (2003)

    Article  Google Scholar 

  15. Tan, A.-H., et al.: Text mining: the state of the art and the challenges. In: Proceedings of the PAKDD 1999 Workshop on Knowledge Discovery from Advanced Databases, vol. 8, pp. 65–70 (1999)

    Google Scholar 

Download references

Acknowledgements

We would like to thank Ioannis Pragidis for his work on improving the thesaurus, pointing us to the relevant data, and sharing his deep expertize in the subject domain.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Artem Revenko .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Hobel, H., Revenko, A. (2016). On the Quality of Annotations with Controlled Vocabularies. In: Satsiou, A., et al. Collective Online Platforms for Financial and Environmental Awareness. IFIN ISEM 2016 2016. Lecture Notes in Computer Science(), vol 10078. Springer, Cham. https://doi.org/10.1007/978-3-319-50237-3_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-50237-3_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-50236-6

  • Online ISBN: 978-3-319-50237-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics