Structural Change of Domain-Specific Web-Page Repository for Efficient Searching

  • Debajyoti MukhopadhyayEmail author
  • Sukanta Sinha
Part of the Cognitive Intelligence and Robotics book series (CIR)


In Chapter “ Domain Specific Crawler Design” we have discussed in detail various types of domain specific Web crawler. Web crawler crawls the Web-pages from World Wide Web (WWW) and store them in a repository. Domain specific Web crawlers crawl only domain specific Web-pages [1–4]. A domain specific Web search engine is produced search results by considering the domain specific Web-pages, which is already crawled by the domain specific Web crawler [5–6].


  1. 1.
    T. Berners-Lee, M. Fischetti, Weaving the Web: The Original Design and Ultimate Destiny of the World Wide Web by Its Inventor (HarperBusiness, New York, 1999)Google Scholar
  2. 2.
    B.M. Leiner, V.G. Cerf, D.D. Clark, R.E. Kahn, L. Kleinrock, D.C. Lynch, J. Postel, L.G. Roberts, S. Wolff, A brief history of internet. ACM Comput. Commun. 35(1), 22–31 (2009). Scholar
  3. 3.
    W. Willinger, R. Govindan, S. Jamin, V. Paxson, S. Shenker, Scaling phenomena in the internet, in Proceedings of the National Academy of Sciences (New York, 2002), pp. 2573–2580Google Scholar
  4. 4.
    J.J. Rehmeyer, Mapping a Medusa: The internet spreads its tentacles. Sci. News 171(25), 387–388 (2007). Scholar
  5. 5.
    M.E. Bates, D. Anderson, Free, fee-based and value-added information services Factiva, in The Factiva 2002 White Paper Series (Dow-Jones Reuters Business Interactive, LLC, 2002)Google Scholar
  6. 6.
    D. Hawking, N. Craswell, P. Bailey, K. Griffihs, Measuring search engine quality. Inf. Retrieval. Elsevier 4(1), 33–59 (2001)CrossRefGoogle Scholar
  7. 7.
    T. Joachims, Optimizing search engines using clickthrough data, In Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD ‘02, Edmonton, Alberta, Canada, 2002), pp. 133–142Google Scholar
  8. 8.
    D. Mukhopadhyay, S.R. Singh, in Two Novel Methodologies for Searching the Web: Confidence Based and Hyperlink-Content Based. Haldia Institute of Technology, Department of Computer Science & Engineering Research Report (2003)Google Scholar
  9. 9.
    R. Baeza-Yates, C. Hurtado, M. Mendoza, G. Dupret, Modeling user search behavior, In Proceedings of the Third Latin American Web Congress (LA-WEB’2005, Buenos Aires, Argentina, 2005), pp. 242–251Google Scholar
  10. 10.
    O. Hoeber, Web information retrieval support systems: The future of Web search, In IEEE/WIC/ACM international conference on web intelligence and intelligent agent technology (WI-IAT’08, IEEE Computer Society, 2008), pp. 29–32Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  1. 1.Web Intelligence and Distributed Computing Research Lab, Computer Engineering DepartmentNHITM of Mumbai UniversityKavesar, Thane (W)India
  2. 2.Wipro LimitedBrisbaneAustralia

Personalised recommendations