Skip to main content

Crowdsourced Knowledge: Peril and Promise for Conceptual Structures Research

  • Conference paper
Conceptual Structures for Discovering Knowledge (ICCS 2011)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 6828))

Included in the following conference series:

Abstract

Recent efforts to create natural-language, question-answering systems for the World Wide Web exploit the vast availability of information in Web resources as a knowledge base. Researchers who develop these systems explicitly assume that what is most often repeated in that knowledge base is the truth. Their assumption implicitly relies on a fallacy in classical logic: “proof by assertion” (or proof by repeated assertion). This paper considers the implications—both hazardous and hopeful—of the Most Often Repeated (MOR) assumption, and suggests Peirce’s “economy of research” (EOR), in his evolutionary view of logic, as a promising alternative to MOR for truth-finding in the increasing complexity of crowdsourced knowledge.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. GalaxyZoo, http://www.galaxyzoo.org/

  2. WordPress. Crowdsourcing Revolution in Egypt, http://siliconcowboy.wordpress.com/2011/02/02/crowdsourcing-revolution-in-egypt/

  3. Mechanical Turk, https://www.mturk.com/mturk/welcome

  4. Ojala, M.: Data Conservation Lab News (2009), http://www.dclab.com/crowdsourcinghistory.asp

  5. Flickr Commons, http://www.flickr.com/commons

  6. Voorhees, E.: Overview of the TREC 2001 Question Answering Track. National Institute of Standards and Technology (2001), http://www.ai.mit.edu/people/jimmylin/papers/Voorhees01.pdf

  7. Androutsopoulos, I., Ritchie, G., Thanisch, P.: Natural language interfaces to databases—an introduction. Natural Language Engineering 1(1), 29–81 (1995)

    Article  Google Scholar 

  8. Schank, R., Colby, K. (eds.): Computer Models of Thought and Language. W.H. Freeman, San Francisco (1973)

    MATH  Google Scholar 

  9. TrueKnowledge. The Internet Answer Engine, http://www.trueknowledge.com

  10. Tunstall-Pedoe, W.: Knowledge: Open-Domain Question Answering Using Structured Knowledge and Inference, AI Magazine, Fall (2010), http://findarticles.com/p/articles/mi_7446/is_201010/ai_n56441011/

  11. Kwok, C., Etzioni, O., Weld, D.: Scaling question answering to the Web. In: Proceedings of the Tenth International World Wide Web Conference (WWW 2010) (2001), http://www.cs.washington.edu/homes/weld/papers/mulder-www10.pdf

  12. Clark, P., Harrison, P.: Large-Scale Extraction and Use of Knowledge from Text. In: Proceedings of the Fifth International Conference on Knowledge Capture, pp. 153–160. ACM, New York (September 2009)

    Chapter  Google Scholar 

  13. Ferrucci, D.: Lecture in Yorktown (recording), http://www-943.ibm.com/innovation/us/watson/watson-for-a-smarter-planet/building-a-jeopardy-champion/how-watson-works.html

  14. Common Component Metadata Analysis Engine, http://uima.lti.cs.cmu.edu/index.html

  15. Answers.com, http://www.answers.com/

  16. IWise. Wisdom on Demand, http://www.iwise.com/9lfZT

  17. Thinkexist.com. “Finding Quotations was never this Easy!”, http://www.quotationspage.com/ , http://www.quotationspage.com/

  18. Framework Institute, http://www.frameworksinstitute.org/mission.html

  19. BBC World News; and see The PIPA Knowledge Networks Poll BBC World News. Iraqi defector ’Curveball’ Janabi denies WMD claims, (February 16, 2011), http://personaldemocracy.com/pdfleaks

  20. Fox News Survey, http://www.foxnews.com/politics/2010/08/19/nearly-americans-thinks-obama-muslim-survey-shows/

  21. PolitiFact, http://politifact.com/truth-o-meter/article/2010/dec/16/lie-year-government-takeover-health-care/

  22. Tomasky, M.: Guardian, http://www.guardian.co.uk/commentisfree/michaeltomasky/2011/feb/01/healthcare-vinson-decision

  23. Huffington, A.: Report on “A Symposium on WikiLeaks and Internet Freedom”. Personal Democracy Forum (12/11/10), http://www.huffingtonpost.com/2010/12/03/wikileaks-online-presence_n_791699.html

  24. UTVNews, http://www.u.tv/News/

  25. Lippmann, W.: Goodquotes.com, http://www.goodquotes.com/quote/walter-lippmann/when-distant-and-unfamiliar-and-comple

  26. Sagan, C.: http://www.positiveatheism.org/writ/saganbd.htm#BALONEY , http://www.positiveatheism.org/writ/saganbd.htm#BALONEY

  27. Quora, http://www.quora.com

  28. TruthorFiction, http://www.truthorfiction.com , http://www.truthorfiction.com/rumors/o/obama-lies.htm

  29. Burch, R.: In: Zalta, E. (eds.): Stanford Encyclopedia of Philosophy, http://plato.stanford.edu/

  30. Wible, J.: Science Bought and Sold: Essays in the Economics of Science. University of Chicago Press, Chicago (2002)

    Google Scholar 

  31. Peirce. C. Studies in Logic. In: Eschbach, A. (ed.) Foundations of Semiotics Series, John Benjamins B.V (1983), pp. 126-181. Originally published as A Theory of Probable Inference, In: The Johns Hopkins Studies in Logic (ed.) Peirce, C. Little Brown and Co (1883); intended as Essay XIV of the Search for a Method (1893)

    Google Scholar 

  32. Keeler, M., Pfeiffer, H.: Building a Pragmatic Methodology for KR Tool Research and Development. In: Schärfe, H., Hitzler, P., Øhrstrøm, P. (eds.) ICCS 2006. LNCS (LNAI), vol. 4068, pp. 314–330. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  33. Keeler, M.: Revelator Game of Inquiry: A Peircean Challenge for Conceptual Structures in Application and Evolution. In: Priss, U., Polovina, S., Hill, R. (eds.) ICCS 2007. LNCS (LNAI), vol. 4604, pp. 443–459. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  34. Keeler, M., Majumdar, A.: Revelator’s Complex Adaptive Reasoning Methodology for Resource Infrastructure Evolution. In: Eklund, P., Haemmerlé, O. (eds.) ICCS 2008. LNCS (LNAI), vol. 5113, pp. 88–103. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  35. Skagestad, P.: The Road of Inquiry. Columbia University Press (1981)

    Google Scholar 

  36. Hilpinen, R.: On C.S. Peirce’s Theory of the Proposition: Peirce as a Precursor of Game Theoretîcal Semantics. In: Freeman, E. (ed.) The Relevance of Peirce, pp. 264–270 (1983a)

    Google Scholar 

  37. McGonicgal, J.: Reality is Broken: Why Games Make us Better and How They Can Change the World. Penguin Press (2011)

    Google Scholar 

  38. Bailey, K.: Microsoft, Government Working Together on Deficit Reduction Game, http://www.escapistmagazine.com/forums/read/7.188356-Microsoft-to-Make-Budget-Balancing-Game

  39. Taleb, N.: The Black Swan: the Impact of the Highly Improbable. Random House (2010)

    Google Scholar 

  40. Serious Games Initiative, http://www.seriousgames.org/

  41. Keeler, M.: Learning to Map the Virtual Evolution of Knowledge. In: Croitoru, M., Ferre, S., Lukose, D. (eds.) Proceedings of the 18th International Conference on Conceptual Structures (2010)

    Google Scholar 

  42. Waters, R.: Information Technology: Mind Games. Financial Times (February 16, 2011)

    Google Scholar 

  43. Bakalis, A.: AOL, Patch’s Parent Company, Buys Huffington Post, http://hollywood.patch.com/articles/aol-patchs-parent-company-buys-huffington-post

  44. Anderson, C.: How web video powers global innovation, http://www.ted.com/talks/chris_anderson_how_web_video_powers_global_innovation.html

  45. JoVE. Journal of Visualized Experiments, http://www.jove.com/

  46. Woods, J., Walton, D.: Argument: The Logic of Fallacies. McGraw-Hill, New York (1982)

    Google Scholar 

  47. Burks, A.: Logic, Learning, and Creativity in Evolution. In: Houser, N., Roberts, D., Van Evra, J. (eds.) Studies in the Logic of Charles Sanders Peirce, pp. 497–534. Indiana U. Press (1997)

    Google Scholar 

  48. Sowa, J.: Matching Logic Structure to Linguistic Structure. In: Houser, N., Roberts, D., Van Evra, J. (eds.) Studies in the Logic of Charles Sanders Peirce, pp. 418–444. Indiana U. Press (1997)

    Google Scholar 

Download references

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Keeler, M. (2011). Crowdsourced Knowledge: Peril and Promise for Conceptual Structures Research. In: Andrews, S., Polovina, S., Hill, R., Akhgar, B. (eds) Conceptual Structures for Discovering Knowledge. ICCS 2011. Lecture Notes in Computer Science(), vol 6828. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-22688-5_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-22688-5_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-22687-8

  • Online ISBN: 978-3-642-22688-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics