Advertisement

Web Recency Maintenance Protocol

  • K. Satya Sai Prakash
  • S. V. Raghavan
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2571)

Abstract

In this paper, we propose a new protocol namely Web Recency Maintenance Protocol (WRMP) that employs “push” mechanism to maintain the currency of the World Wide Web (WWW) at Search Engine (SE) site. As of this writing SEs are adopting “pull” technology, by employing search bots to collect the data from WWW. Pull technology can no longer cater to the growing user base and the information explosion on the web. In view of the gigantic structure and dynamic nature of the WWW, it is impractical to maintain the currency using this technology. This practical limitation makes SEs yield stale results. WRMP ensures the real time update by initiating an update agent as and when the server is modified or updated. The availability of high processing speed enables the SE to maintain the currency of the whole WWW in real time. This protocol cuts down the unwarranted roaming of the search bots and takes the real purpose of the web server establishment i.e. reach the public over Internet as the motivating factor. This protocol gives an additional advantage to the SE by enabling it to prioritize the Web sites based on the change frequency. We have given a formal specification for the protocol and an M/M/1 model based analysis.

Keywords

Search Engine Finite State Machine Bandwidth Requirement Processor Speed Information Agent 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    Andrie Broder et.al, “Graph Structure in the Web”, URL:http://www9.org/w9cdrom/160/160.html
  2. [2]
    Aravind Arasu et.al, “Searching the Web”, ACM Transactions on Internet Technology, Vol. 1, No. 1, August 2001, pp: 2–43CrossRefGoogle Scholar
  3. [3]
    Brian E Brewington, George Cybenko, “How Dynamic is the Web”, URL:http://www9.org/w9cdrom/264/264.html
  4. [4]
    Colin H. West, “Protocol Validation in Complex Systems”, Proceedings of ACM SIGCOMM’ 89 Symposium: Communications Architecture & Protocols, Austin, Texas, September, 19-20, 1989. Computer Communication Review, Vol. 19, No. 4, pp: 303–312.Google Scholar
  5. [5]
    Jacob W Green, “Hyper Dog: Up to date Web Monitoring through Meta Computers”, MS Report, Baltimore, Maryland, October 2000.Google Scholar
  6. [6]
    Lawrence S, Giles C. L, “Searching the World Wide Web”, Science, Vol. 280, No. 5360, April 1998, pp:98–100 URL: http://www.sciencemag.org CrossRefGoogle Scholar
  7. [7]
    Lin F., Chu P and Liu M., “Protocol Verification and Using Reachability Analysis”, Proceedings of ACM SIGCOMM’87 pp: 126–135.Google Scholar
  8. [8]
    W. May, G. Lausen, “Information Extraction from the Web”, TR. No. 136, Institute for Informatics, Albert-Ludwigs University, Germany, March 2000.Google Scholar
  9. [9]
    Mei Kobayashi, Koichi Takeda, “Information Retrieval on the Web”, ACM Computing surveys, Vol. 32, Issue 2, June 2000, pp: 144–173CrossRefGoogle Scholar
  10. [10]
    Michalis Faloutsas et al, “On Power-Law Relationships of the Internet Topology”, Proceedings of ACM SIGCOMM, Cambridge, USA, August 1999, pp: 251–262Google Scholar
  11. [12]
    Sergy Brin, Lawrence Page, “The Anatomy of Large Scale Hyper textual Web Search Engine”, URL: http://www7.scu.edu.au/programme/fullpapers/1921/com1921.htm
  12. [13]
    J Talim et al, “Controlling the Robots of Web Search Engines”, Proceedings of ACM SIGMETRICS 2001, pp: 236–244.Google Scholar
  13. [14]
    K. Tarnay, “Protocol Specification and Testing”, Plenum Press, ISBN: 0-306-43574-8Google Scholar
  14. [15]
    Venkat N Padmanabhan, Lili Qiu, “The Content Access Dynamics of a Busy Web Site: Findings and Implications”, Proceedings of ACM SIGCOMM 2000, pp: 111–123Google Scholar
  15. [16]
    Vijay Gupta, Ray Campbell, “Internet Search Engine Freshness by Web Server Help”, TR-UIUCDCS-R-2000-2153, Digital Computer Library.Google Scholar
  16. [17]
    Wen-Chen Hu, Yining Chen, “An Overview of World Wide Web Search Technologies”, In the proceedings of 5th World Multi Conference on Systems, Cybernetics, Informatics, SCI2001, Orlando, Florida, 22-25 July 2001.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • K. Satya Sai Prakash
    • 1
  • S. V. Raghavan
    • 1
  1. 1.Dept. of Computer Science and EngineeringIndian Institute of Technology MadrasIndia

Personalised recommendations