Skip to main content
SpringerLink
Log in

Morphological Annotation of a Corpus with a Collaborative Multiplayer Game

  • Conference paper
Computational Linguistics and Intelligent Text Processing (CICLing 2010)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 6008))

Abstract

In most of the natural language processing tasks, state-of-the-art systems usually rely on machine learning methods for building their mathematical models. Given that the majority of these systems employ supervised learning strategies, a corpus that is annotated for the problem area is essential. The current method for annotating a corpus is to hire several experts and make them annotate the corpus manually or by using a helper software. However, this method is costly and time-consuming. In this paper, we propose a novel method that aims to solve these problems. By employing a multiplayer collaborative game that is playable by ordinary people on the Internet, it seems possible to direct the covert labour force so that people can contribute by just playing a fun game. Through a game site which incorporates some functionality inherited from social networking sites, people are motivated to contribute to the annotation process by answering questions about the underlying morphological features of a target word. The experiments show that the 63.5% of the actual question types are successful based on a two-phase evaluation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Marquez, L., Salgado, J.G.: Machine learning and natural language processing (2000)

    Google Scholar 

  2. Marcus, M.P., Santorini, B., Marcinkiewicz, M.A.: Building a large annotated corpus of english: The penn treebank. Computational Linguistics 19(2), 313–330 (1994)

    Google Scholar 

  3. Yüret, D.: Morphologically tagged corpus (2009)

    Google Scholar 

  4. von Ahn, L., Dabbish, L.: Labeling images with a computer game. In: CHI 2004: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 319–326. ACM, New York (2004)

    Google Scholar 

  5. von Ahn, L., Liu, R., Blum, M.: Peekaboom: a game for locating objects in images. In: CHI 2006: Proceedings of the SIGCHI conference on Human Factors in computing systems, pp. 55–64. ACM, New York (2006)

    Chapter  Google Scholar 

  6. von Ahn, L., Ginosar, S., Kedia, M., Liu, R., Blum, M.: Improving accessibility of the web with a computer game. In: CHI 2006: Proceedings of the SIGCHI conference on Human Factors in computing systems, pp. 79–82. ACM, New York (2006)

    Chapter  Google Scholar 

  7. von Ahn, L., Kedia, M., Blum, M.: Verbosity: a game for collecting common-sense facts. In: CHI 2006: Proceedings of the SIGCHI conference on Human Factors in computing systems, pp. 75–78. ACM, New York (2006)

    Chapter  Google Scholar 

  8. Law, E.L.M., von Ahn, L., Dannenberg, R.B., Crawford, M.: Tagatune: A game for music and sound annotation. In: ISMIR 2007: 8th International Conference on Music Information Retrieval (2007)

    Google Scholar 

  9. Chklovski, T.: Collecting paraphrase corpora from volunteer contributors. In: K-CAP 2005: Proceedings of the 3rd international conference on Knowledge capture, pp. 115–120. ACM, New York (2005)

    Chapter  Google Scholar 

  10. Chklovski, T., Gil, Y.: Improving the design of intelligent acquisition interfaces for collecting world knowledge from web contributors. In: K-CAP 2005: Proceedings of the 3rd international conference on Knowledge capture, pp. 35–42. ACM, New York (2005)

    Chapter  Google Scholar 

  11. Richardson, M., Domingos, P.: Building large knowledge bases by mass collaboration. In: K-CAP 2003: Proceedings of the 2nd international conference on Knowledge capture, pp. 129–137. ACM, New York (2003)

    Chapter  Google Scholar 

  12. Bontcheva, C.T., Cunningham, H., Tablan, V., Bontcheva, K., Dimitrov, M., Lab, O.: Language engineering tools for collaborative corpus annotation. In: Proceedings of Corpus Linguistics 2003, pp. 80–87. Wiley, Chichester (2003)

    Google Scholar 

  13. Ma, X., Lee, H., Bird, S., Maeda, K.: Models and tools for collaborative annotation. In: Proceedings of the Third International Conference on Language Resources and Evaluation. European Language Resources Association, Paris (2002)

    Google Scholar 

  14. Eryiǧit, G.: ITU treebank annotation tool. In: Proceedings of the Linguistic Annotation Workshop, Prague, Czech Republic, June 2007, pp. 117–120. Association for Computational Linguistics (2007)

    Google Scholar 

  15. Stührenberg, M., Goecke, D., Diewald, N., Mehler, A., Cramer, I.: Web-based annotation of anaphoric relations and lexical chains. In: Proceedings of the Linguistic Annotation Workshop, Prague, Czech Republic, June 2007, pp. 140–147. Association for Computational Linguistics (2007)

    Google Scholar 

  16. Hakkani-Tür, D.Z., Oflazer, K., Tür, G.: Statistical morphological disambiguation for agglutinative languages. In: Proceedings of the 18th conference on Computational linguistics, Morristown, NJ, USA, pp. 285–291. Association for Computational Linguistics (2000)

    Google Scholar 

  17. Yuret, D., Türe, F.: Learning morphological disambiguation rules for turkish. In: HLT-NAACL 2006 (June 2006)

    Google Scholar 

  18. Oflazer, K., Tur, G.: Combining hand-crafted rules and unsupervised learning in constraint-based morphological disambiguation. In: Brill, E., Church, K. (eds.) Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp. 69–81. Association for Computational Linguistics, Somerset (1996)

    Google Scholar 

  19. Oflazer, K., Tür, G., Tfir, G.: Morphological disambiguation by voting constraints. In: Proceedings of the Thirty-Fifth Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics, pp. 222–229 (1997)

    Google Scholar 

  20. Sak, H., Güngör, T., Saraçlar, M.: Morphological disambiguation of Turkish text with perceptron algorithm. In: Gelbukh, A. (ed.) CICLing 2007. LNCS, vol. 4394, pp. 107–118. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Boĝaziçi University, Bebek, 34342, Istanbul, Turkey

    Onur Güngör & Tunga Güngör

Authors
  1. Onur Güngör
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tunga Güngör
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Center for Computing Research, National Polytechnic Institute, 07738, Mexico City, Mexico

    Alexander Gelbukh

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Güngör, O., Güngör, T. (2010). Morphological Annotation of a Corpus with a Collaborative Multiplayer Game. In: Gelbukh, A. (eds) Computational Linguistics and Intelligent Text Processing. CICLing 2010. Lecture Notes in Computer Science, vol 6008. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12116-6_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-12116-6_7

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-12115-9

  • Online ISBN: 978-3-642-12116-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation