Skip to main content

Search and Discovery Through Human Computation

  • Chapter
  • First Online:
Handbook of Human Computation

Abstract

In the latest evolution of the Internet, human networks are becoming functionalized through collective collaboration frameworks. Questions are now being addressed as never before, by leveraging the easy digital accessibility of crowds to supplement the limitations of machine computation. This is especially relevant in the case of visual analytics where human intuition remains beyond the scope of existing computer object recognition algorithms. Distributing the effort over a massive network of humans not only succeeds in expanding the capacity of human based analytical power, but if set up appropriately, can also provide a statistical basis to pool human perceptive knowledge when identifying the unknown. Here we describe the impacts of this capacity in efforts of search and discovery, where massively parallel human computation can be used to identify anomalies of loosely defined characteristics within large volumes of ultra-high resolution multi-spectral satellite imagery. As human generated data is inherently noisy and subjective in nature, a statistical approach is taken towards consensus based data validation. We show that a spatial landscape can serve as the framework for collaborative computation through an overview of our initial efforts in archaeology, and the subsequent applications in disaster assessment, and search and rescue.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://exploration.nationalgeographic.com/mongolia

References

  • Allard F, Erdenebaatar D (2005) Khirigsuurs, ritual and mobility in the bronze age of mongolia. Antiquity 79:547–563

    Google Scholar 

  • Babenko B, Dollár P, Belongie S (2006) Multiple instance learning with query bags, pp 1–9. vision.ucsd.edu

  • Barrington L, Ghosh S, Greene M, Har-Noy S, Berger J, Gill S, Lin AYM, Huyck C (2012) Crowdsourcing earthquake damage assessment using remote sensing imagery. Ann Geophys 54(6):680–687

    Google Scholar 

  • Barrington L, Turnbull D, Lanckriet G (2012) Game-powered machine learning. Proc Natl Acad Sci 109(17):6411–6416

    Article  Google Scholar 

  • Bewley RH Aerial survey for archaeology. Photogramm Rec 18:273–292 (2003)

    Article  Google Scholar 

  • Blom RG, Chapman B, Podest E, Murowchick R (2000) Applications of remote sensing to archaeological studies of early Shang civilization in northern China. In: Proceedings IEEE 2000 international geoscience and remote sensing symposium, IGARSS 2000, vol 6, pp 2483–2485 Honolulu, Hawaii

    Google Scholar 

  • comScore. http://www.comscore.com/Press_Events/Press_Releases/2009/3/YouTube_Surpasses_100_Million_US_Viewers, Mar 2009

  • Cooper S, Khatib F, Treuille A, Barbero J, Lee J, Beenen M, Leaver-Fay A, Baker D, Popović Z, Players F (2010) Predicting protein structures with a multiplayer online game. Nature 466(7307):756–760

    Article  Google Scholar 

  • Deuel L (1969) Flights into yesterday: the story of aerial archaeology. St. Martin’s Press, New York

    Google Scholar 

  • Foulser-Piggott R, Spence R, Brown D (2012). 15th World Conference on Earthquake Engineering (Lisbon) following February 2012 The use of remote sensing for building damage assessment following 22 nd February 2011 Christchurch earthquake: the GEOCAN study and its validation

    Google Scholar 

  • Fowler MJF (1996) High-resolution satellite imagery in archaeological application: a Russian satellite photograph of Stonehenge region. Archaeological Prospection, 70; pp 667–671 Antiquity Portland Press

    Google Scholar 

  • Google Blog. http://googleblog.blogspot.com/2008/07/we-knew-web-was-big.html, July 2008

  • Huynh A, Lin AYM (2012) Connecting the dots: triadic clustering of crowdsourced data to map dirt roads. In: Proceedings of 21st international conference on pattern recognition, Tsukuba

    Google Scholar 

  • Huynh A, Ponto K, Lin A Yu-Min, Kuester F (2013) Visual analytics of inherently noisy crowdsourced data on ultra high resolution displays. Aerospace conference proceedings IEEE. 1--8

    Google Scholar 

  • International game developers association (2006) Casual games white paper

    Google Scholar 

  • Internet world stats. http://www.internetworldstats.com/stats.htm, Aug 2009

  • Jacobson-Tepfer E, Meacham JE, Tepfer G (2010) Archaeology and landscape in the Mongolian Altai: an Atlas. ESRI, Redlands

    Google Scholar 

  • Lasaponara R, Masini N (2006) Identification of archaeological buried remains based on the normalized difference vegetation index (NDVI) from Quickbird satellite data. Geosci Remote Sens Lett IEEE 3:325–328

    Article  Google Scholar 

  • Law E, vonAhn L (2009) Input-agreement: a new mechanism for collecting data using human computation games. In: ACM CHI, Boston

    Google Scholar 

  • Lin AY, Novo A, Har-Noy S, Ricklin ND, Stamatiou K (2011) Combining geoeye-1 satellite remote sensing, uav aerial imaging, and geophysical surveys in anomaly detection applied to archaeology. IEEE J Sel Top Appl Earth Obs Remote Sens 4(4):870–876

    Article  Google Scholar 

  • Lin AYM, Huynh A, Lanckriet G, Barrington L (2013) Crowdsourcing the Unknown: The Search for Genghis Khan (in preparation)

    Google Scholar 

  • Lyons TR (1977) Remote sensing: a handbook for archeologists and cultural resource managers. Cultural Resources Management Division, National Park Service, US. Department of the Interior: For sale by the Supt. of Docs., U.S. Govt. Print. Off.

    Google Scholar 

  • Madden M (2009) Geoeye-1, the world’s highest resolution commercial satellite. In: Conference on lasers and electro-optics/international quantum electronics conference, OSA technical digest (CD). San Jose, CA, USA

    Google Scholar 

  • Mandel M, Ellis D (2007) A web-based game for collecting music metadata. In: ISMIR, Vienna

    Google Scholar 

  • Maron O, Lozano-Pérez T (1998) A framework for multiple-instance learning. In: Advances in neural information processing systems. Madison, Wisconsin, USA, pp 579–576 (Citeseer)

    Google Scholar 

  • Maron O, Ratan AL (1998) Multiple-instance learning for natural scene classification. The fifteenth international conference on machine learning, San Francisco, pp 341–349, April 1998

    Google Scholar 

  • Novotney S, Callison-Burch C (2010) Cheap, fast and good enough: automatic speech recognition with non-expert transcription. In: Human language technologies: 11th conference of the North American chapter of the association for computational linguistics (NAACL HLT), Los Angeles

    Google Scholar 

  • Parcak SH (2009) Satellite remote sensing for archaeology. Routledge, London/New York

    Google Scholar 

  • Riley DN (1987) Aerial photography in archaeology. University of Pennsylvania Press, Philadelphia, PA

    Google Scholar 

  • Snow R, O’Connor B, Jurafsky D, Ng AY (2008) Cheap and fast—but is it good? Evaluating non-expert annotations for natural language tasks. In: 13th conference on empirical methods in natural language processing (EMNLP), Waikiki

    Google Scholar 

  • von Ahn L (2006) Games with a purpose. IEEE Comput Mag 39(6):92–94

    Article  Google Scholar 

  • von Ahn L, Dabbish L (2004) Labeling images with a computer game. In: ACM CHI, Vienna

    Google Scholar 

  • von Ahn L, Kedia M, Blum M (2006) Verbosity: a game for collecting common-sense facts. In: ACM CHI, Montral, Montréal, Canada

    Google Scholar 

  • von Ahn L, Maurer B, McMillen C, Abraham D, Blum M (2008) reCAPTCHA: human-based character recognition via web security measures. Science 321(5895):1465–1468

    Article  MathSciNet  MATH  Google Scholar 

  • Wilkinson KN, Beck AR, Philip G (2006) Satellite imagery as a resource in the prospection for archaeological sites in central Syria. Geoarchaeology 21:735–750

    Article  Google Scholar 

  • Zhang Q, Goldman SA, Yu W, Fritts JE (2002) Content-based image retrieval using multiple-instance learning. In: Machine learning-international workshop then conference- number 2, pp 682–689 (Citeseer). San Jose, CA, USA

    Google Scholar 

Download references

Acknowledgements

We thank N. Ricklin, S. Har-Noy of Tomnod Inc. as well as the entire Valley of the Khans (VOTK) project team; S. Bira, and T. Ishdorj of the International Association for Mongol Studies and F. Hiebert of the National Geographic Society for co-leadership in field expeditions; D. Vanoni, K. Ponto, D. Lomas, J. Lewis, V. deSa, F. Kuester, and S. Belongie for critical discussions and contributions; S. Poulton and A. Bucci of National Geographic Digital Media; the Digitaria team; Ron Eguchi and ImageCat Inc.; Digital Globe. This effort was made possible by the support of the National Geographic Society, the Waitt Institute for Discovery, the GeoEye Foundation, and the National Science Foundation EAGER ISS-1145291 and HCC IIS-1219138.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Albert Yu-Min Lin .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media New York

About this chapter

Cite this chapter

Lin, A.YM., Huynh, A., Barrington, L., Lanckriet, G. (2013). Search and Discovery Through Human Computation. In: Michelucci, P. (eds) Handbook of Human Computation. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-8806-4_16

Download citation

  • DOI: https://doi.org/10.1007/978-1-4614-8806-4_16

  • Published:

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4614-8805-7

  • Online ISBN: 978-1-4614-8806-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics