Skip to main content

Wayfinder: Navigating and Sharing Information in a Decentralized World

  • Conference paper
Book cover Databases, Information Systems, and Peer-to-Peer Computing (DBISP2P 2004)

Abstract

Social networks offering unprecedented content sharing are rapidly developing over the Internet. Unfortunately, it is often difficult to both locate and manage content in these networks, particularly when they are implemented on current peer-to-peer technologies. In this paper, we describe Wayfinder, a peer-to-peer file system that targets the needs of medium-sized content sharing communities. Wayfinder seeks to advance the state-of-the-art by providing three synergistic abstractions: a global namespace that is uniformly accessible across connected and disconnected operation, content-based queries that can be persistently embedded into the global namespace, and automatic availability management. Interestingly, Wayfinder achieves much of its functionality through the use of a peer-to-peer indexed data storage system called PlanetP: essentially, Wayfinder constructs the global namespace, locates specific files, and performs content searches by posing appropriate queries to PlanetP. We describe this query-based design and present preliminary performance measurements of a prototype implementation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Adya, A., Bolosky, W.J., Castro, M., Cermak, G., Chaiken, R., Douceur, J.R., Howell, J., Lorch, J.R., Theimer, M., Wattenhofer, R.P.: FARSITE: Federated, Available, and Reliable Storage for an Incompletely Trusted Environment. In: Proceedings of the Symposium on Operating Systems Design and Implementation (OSDI) (December 2002)

    Google Scholar 

  2. Bhagwan, R., Savage, S., Voelker, G.: Understanding Availability. In: Proceedings of the International Workshop on Peer-to-Peer Systems (IPTPS) (February 2003)

    Google Scholar 

  3. Bhagwan, R., Tati, K., Cheng, Y., Savage, S., Voelker, G.M.: Total Recall: System Support for Automated Availability Management. In: Proceedings of the Symposium on Networked Systems Design and Implementation (NSDI) (June 2004)

    Google Scholar 

  4. Bloom, B.H.: Space/Time Trade-offs in Hash Coding with Allowable Errors. Communications of the ACM (July 1970)

    Google Scholar 

  5. Cuenca-Acuna, F.M., Martin, R.P., Nguyen, T.D.: Autonomous Replication for High Availability in Unstructured P2P Systems. In: Proceedings of the Symposium on Reliable Distributed Systems (SRDS) (October 2003)

    Google Scholar 

  6. Cuenca-Acuna, F.M., Nguyen, T.D.: Text-Based Content Search and Retrieval in ad hoc P2P Communities. In: Proceedings of the International Workshop on Peer-to-Peer Computing (May 2002)

    Google Scholar 

  7. Cuenca-Acuna, F.M., Peery, C., Martin, R.P., Nguyen, T.D.: PlanetP: Using Gossiping to Build Content Addressable Peer-to-Peer Information Sharing Communities. In: Proceedings of the International Symposium on High Performance Distributed Computing (HPDC) (June 2003)

    Google Scholar 

  8. Dabek, F., Kaashoek, M.F., Karger, D., Morris, R., Stoica, I.: Wide-area cooperative storage with CFS. In: Proceedings of the Symposium on Operating Systems Principles (SOSP) (October 2001)

    Google Scholar 

  9. Demers, A., Greene, D., Hauser, C., Irish, W., Larson, J., Shenker, S., Sturgis, H., Swinehart, D., Terry, D.: Epidemic Algorithms for Replicated Database Maintenance. In: Proceedings of the Sixth Annual ACM Symposium on Principles of Distributed Computing (1987)

    Google Scholar 

  10. Fu, K., Kaashoek, M.F., MaziÃr̈es, D.: Fast and secure distributed read-only file system. In: Proceedings of the Symposium on Operating Systems Design and Implementation (OSDI) (October 2000)

    Google Scholar 

  11. Gifford, D.K., Jouvelot, P., Sheldon, M.A., O’Toole Jr., J.: Semantic File Systems. In: Proceedings of the Symposium on Operating Systems Principles (SOSP) (October 1991)

    Google Scholar 

  12. Gopal, B., Manber, U.: Integrating Content-Based Access Mechanisms with Hierarchical File System. In: Proceedings of the Symposium on Operating Systems Design and Implementation (OSDI) (February 1999)

    Google Scholar 

  13. Guy, R.G., Heidemann, J.S., Mak, W., Page Jr., T.W., Popek, G.J., Rothmeir, D.: Implementation of the Ficus Replicated File System. In: Proceedings of the Summer USENIX Conference (June 1990)

    Google Scholar 

  14. Harren, M., Hellerstein, J.M., Huebsch, R., Loo, B.T., Shenker, S., Stoica, I.: Complex Queries in DHT-based Peer-to-Peer Networks. In: Proceedings of the International Workshop on Peer-to-Peer Systems (IPTPS) (April 2002)

    Google Scholar 

  15. Howard, J.H., Kazar, M.L., Menees, S.G., Nichols, D.A., Satyanarayanan, M., Sidebotham, R.N., West, M.J.: Scale and Performance in a Distributed File System. ACM Transactions on Computer Systems (TOC) 6(1) (February 1988)

    Google Scholar 

  16. Java nfs server (October 2002), http://members.aol.com/_ht_a/markmitche11/jnfsd.htm

  17. Muthitacharoen, A., Morris, R., Gil, T., Chen, I.B.: Ivy: A Read/Write Peer-to-Peer File System. In: Proceedings of the Symposium on Operating Systems Design and Implementation (OSDI) (December 2002)

    Google Scholar 

  18. Neuman, B.C.: The Prospero File System: A Global File System Based on the Virtual System Model. In: Proceedings of the Workshop on File Systems (May 1992)

    Google Scholar 

  19. Peery, C., Cuenca-Acuna, F.M., Martin, R.P., Nguyen, T.D.: Wayfinder: Navigating and sharing information in a decentralized world. Technical Report DCS-TR-534, Department of Computer Science, Rutgers University (October 2003)

    Google Scholar 

  20. Petersen, K., Spreitzer, M., Terry, D., Theimer, M.: Bayou: Replicated Database Services for World-Wide Applications. In: Proceedings of the Conference on Operating Systems (SIGOPS) (September 1996)

    Google Scholar 

  21. Rao, H.C., Peterson, L.L.: Accessing Files in an Internet: The Jade File System. Software Engineering 19(6) (June 1993)

    Google Scholar 

  22. Rhea, S., Eaton, P., Geels, D., Weatherspoon, H., Zhao, B., Kubiatowicz, J.: Pond: The oceanstore prototype. In: Proceedings of the Conference on File and Storage Technologies, FAST (2003)

    Google Scholar 

  23. Saito, Y., Karamanolis, C.: Pangaea: a symbiotic wide-area file system. In: Proceedings of the Conference on Operating Systems (SIGOPS) (September 2002)

    Google Scholar 

  24. Saroiu, S., Gummadi, P.K., Gribble, S.D.: A Measurement Study of Peer-to-Peer File Sharing Systems. In: Proceedings of Multimedia Computing and Networking (MMCN) (January 2002)

    Google Scholar 

  25. Software, S.: Berkeley DB, http://www.sleepycat.com/

  26. Stoica, I., Morris, R., Karger, D., Kaashoek, M.F., Balakrishnan, H.: Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications. In: Proceedings of the Conference on Data Communications (SIGCOMM) (August 2001)

    Google Scholar 

  27. Suresh Gopalakrishnan, L.I., Arumugam, A.: Federated File Systems for Clusters with Remote Memory Communication. Technical Report DCS-TR-472, Department of Computer Science, Rutgers University (December 2001)

    Google Scholar 

  28. Tang, C., Dwarkadas, S.: Hybrid Global-Local Indexing for Efficient Peer-to-Peer Information Retrieval. In: Proceedings of the Symposium on Networked Systems Design and Implementation (NSDI) (June 2004)

    Google Scholar 

  29. Tatarinov, I., Ives, Z., Madhavan, J., Halevy, A., Suciu, D., Dalvi, N., Dong, X., Kadiyska, Y., Miklau, G., Mork, P.: The Piazza Peer Data Management Project. In: Proceedings of the Conference on Management of Data (SIGMOD) (June 2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Peery, C., Cuenca-Acuna, F.M., Martin, R.P., Nguyen, T.D. (2005). Wayfinder: Navigating and Sharing Information in a Decentralized World. In: Ng, W.S., Ooi, BC., Ouksel, A.M., Sartori, C. (eds) Databases, Information Systems, and Peer-to-Peer Computing. DBISP2P 2004. Lecture Notes in Computer Science, vol 3367. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-31838-5_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-31838-5_14

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-25233-7

  • Online ISBN: 978-3-540-31838-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics