In the context of monolingual and bilingual retrieval, Simple Knowledge Organisation System (SKOS) datasets can play a dual role as knowledge bases for semantic annotations and as language-independent resources for translation. With no existing track of formal evaluations of these aspects for datasets in SKOS format, we describe a case study on the usage of the Thesaurus for the Social Sciences in SKOS format for a retrieval setup based on the CLEF 2004-2006 Domain-Specific Track topics, documents and relevance assessments. Results showed a mixed picture with significant system-level improvements in terms of mean average precision in the bilingual runs. Our experiments set a new and improved baseline for using SKOS-based datasets with the GIRT collection and are an example of component-based evaluation.


Concept Scheme Query Expansion Mean Average Precision Semantic Annotation Link Open Data 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    SKOS Simple Knowledge Organization System Primer (February 2009),
  2. 2.
    Baeza-Yates, R.A., Ribeiro-Neto, B.: Modern Information Retrieval the concepts and technology behind search, 2nd edn. Addison-Wesley (2011)Google Scholar
  3. 3.
    Kamps, J., Karlgren, J., Mika, P., Murdock, V.: Fifth workshop on exploiting semantic annotations in information retrieval: ESAIR 2012. In: Proceedings of the 21st ACM International Conference on Information and Knowledge Management, CIKM 2012, pp. 2772–2773. ACM, New York (2012)Google Scholar
  4. 4.
    Petras, V.: How one word can make all the difference - using subject metadata for automatic query expansion and reformulation. In: Working Notes for the CLEF 2005 Workshop, Vienna, Austria, September 21-23 (2005)Google Scholar
  5. 5.
    Volk, M., Ripplinger, B., Vintar, S., Buitelaar, P., Raileanu, D., Sacaleanu, B.: Semantic annotation for concept-based cross-language medical information retrieval. International Journal of Medical Informatics 67(13), 97–112 (2002)CrossRefGoogle Scholar
  6. 6.
    Wartena, C., Brussee, R., Gazendam, L., Huijsen, W.-O.: Apolda: A practical tool for semantic annotation. In: Proceedings of the 18th International Conference on Database and Expert Systems Applications, DEXA 2007, pp. 288–292. IEEE Computer Society, Washington, DC (2007)Google Scholar
  7. 7.
    Zapilko, B., Sure, Y.: Converting TheSoz to SKOS. Technical report, GESIS – Leibniz-Institut für Sozialwissenschaften, Bonn. GESIS-Technical Reports 2009|07 (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Diana Tanase
    • 1
  • Epaminondas Kapetanios
    • 1
  1. 1.University of WestminsterLondonUK

Personalised recommendations