Performing Efficient Keyword Search by Keyword Grouping in DHT Peer-to-Peer Network

  • Yin Li
  • Fanyuan Ma
  • Liang Zhang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3759)


The primary challenge in developing a peer-to-peer file sharing system is implementing an efficient keyword search mechanism. Current keyword search system for structured P2P systems relies on the intersection of distributed inverted index. However, when executing multiple-attribute queries, the bandwidth overhead is unacceptable. In order to reduce query overhead, indexing can be done by a set of keywords which is adopted in KSS system. However, KSS index is considerably larger than standard inverted index and the insert and storage overhead are dramatically increased. In this paper, by adopting term ranking approach such as TFIDF and exploiting the relationship information between query keywords, the indexing is done by individual keyword while search can be done in a set of related keywords like KSS. Experiments results clearly demonstrated that the improved keyword search system can match standard inverted index in insert overhead and storage overhead, while can compete with KSS index in query overhead.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
  2. 2.
  3. 3.
    Lv, Q., Cao, P., Cohen, E., Li, K., Shenker, S.: Search and Replication in Unstructured Peer-to-Peer Networks. In: Proc. ACM ICS 2002 (June 2002)Google Scholar
  4. 4.
    Cohen, E., Fiat, A., Kaplan, H.: A Case for Associative Peer to Peer Overlays. In: Proc. HotNets-I (October 2002)Google Scholar
  5. 5.
    Zhao, B., Huang, L., Jeremy, S., et al.: Tapestry: a resilient global scale overlay for service deployment. IEEE Journal on Selected Areas in Communications 22(1), 41–53 (2004)CrossRefGoogle Scholar
  6. 6.
    Stoica, I., Morris, R., Karger, D., Kaashoek, M., Balakrishnan, H.: Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications. In: Proc. ACM SIGCOMM 2001 (Augest 2001)Google Scholar
  7. 7.
    Ratnasamy, S., Francis, P., Handley, M., Karp, R., Shenker, S.: A Scalable Content-Addressable Network. In: Proc. ACM SIGCOMM 2001 (Augest 2001)Google Scholar
  8. 8.
    Rowston, A., Druschel, P.: Pastry: Scalable, distributed object location and routing for large-scale peer-to-peer systems. In: Proc. Middleware 2001 (November 2001)Google Scholar
  9. 9.
    Yang, B., Garcia-Molina, H.: Improving Search in Peer-to-Peer Networks. In: Proceedings of the 22nd International Conference on Distributed Computing Systems, ICDCS 2002 (2002)Google Scholar
  10. 10.
    Omprakash, D.G.: A Keyword-set Search System for Peer-to-Peer Networks. MIT’s thesis Lib. (2002)Google Scholar
  11. 11.
  12. 12.
  13. 13.
    Clarke, I., Sandberg, O., Wiley, B., Hong, T.: Freenet: A distributed anonymous information storage and retrieval system. In: Proc. of the ICSI Workshop on Design Issues in Anonymity and Unobservability, Berkeley, CA (June 2000)Google Scholar
  14. 14.
    Reynolds, P., Vahdat, A.: Efficient peer-to-peer keyword searching. Technical Report 2002, Duke University, CS Department, Febraury (2002)Google Scholar
  15. 15.
    Salton, G., Wang, A., Yang, C.: A vector space model for information retrieval. Journal of the American Society for Information Science 18, C613–C620 (1975)Google Scholar
  16. 16.
    Witten, I., Moffat, A., Bell, T.: Managing Gigabytes: Compressing and Indexing Documents and Images, 2nd edn. Morgan Kaufmann, San Francisco (1999)Google Scholar
  17. 17.
    Li, J., Loo, B.T., et al.: On the Feasibility of Peer-to-Peer Web Indexing and Search. In: Kaashoek, M.F., Stoica, I. (eds.) IPTPS 2003. LNCS, vol. 2735, pp. 207–215. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  18. 18.
    Harvey, N.J.A., Jones, M.B., Saroiu, S., Theimer, M., Wolman, A.: SkipNet: A Scalable Overlay Network with Practical Locality Properties. In: USITS 2003 (2003)Google Scholar
  19. 19.
    Bhattacharjee, B., Chawathe, S., Gopalakrishnan, V., Keleher, P., Silaghi, B.: Efficient Peer-To-Peer Searches Using Result-Caching. In: IPTPS 2003 (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Yin Li
    • 1
  • Fanyuan Ma
    • 1
  • Liang Zhang
    • 1
  1. 1.The Department of Computer Science and EngineeringShanghai Jiaotong UniversityShanghaiChina

Personalised recommendations