Abstract
Today’s Web is very huge and evolving continually in dynamic nature. Search engines are the interface to retrieve information from huge repository of the World Wide Web. Due to the difficulty in accessing the information from massive storage of Web, search engines depend on the crawlers for locating and retrieving relevant Web pages. A Web crawler is a software system, which systematically finds and retrieves Web pages from the Web documents. Crawlers use many Web search algorithms for retrieving Web pages. This paper proposes a competent Web search crawling algorithm, which is derived from page rank and BFS Web search algorithm to enhance the efficiency of the relevant information search. In this paper, an attempt has been made to study and examine the work nature of crawlers and crawling algorithms in search engines for efficient information retrieval.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
K.S. Shetty, S. Bhat, S. Singh, Symbolic verification of web crawler functionality and its properties, in International Conference on Computer Communication and Informatics (ICCCI, 2012)
A. Tripathy, P.K. Patra, A web mining architectural model of distributed crawler for internet searches using PageRank algorithm, in IEEE Asia-Pacific Services Computing Conference (2008)
A. Guerriero, F. Ragni, C. Martines, A dynamic URL assignment method for parallel web crawler. IEEE
A. Vadivel, S.G. Shaila, R.D. Mahalakshmi, J. Karthika, Component based effective web crawler and indexer using web services, in IEEE-International Conference on Advances in Engineering, Science and Management (ICAESM, 2012)
R.R. Trujillo, Simulation tool to study focused web crawling strategies (2006)
Accuracy, Precision, Recall and F-Score. Wikipedia, the free encyclopedia
S. Jaiganesh, P. Babu, K. Nimmati Satheesh, Comparative study of various web search algorithms for the improvement of web crawler. Int. J. Eng. Res. Technol. (IJERT) 2(4) (2013)
Y. Yang, Y. Du, Y. Hai, Z. Gao, A topic-specific web crawler with web page hierarchy based on HTML Dom-Tree, in Asia-Pacific Conference on Information Processing (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer India
About this paper
Cite this paper
Saranya, S., Zoraida, B., Victor Paul, P. (2015). A Study on Competent Crawling Algorithm (CCA) for Web Search to Enhance Efficiency of Information Retrieval. In: Suresh, L., Dash, S., Panigrahi, B. (eds) Artificial Intelligence and Evolutionary Algorithms in Engineering Systems. Advances in Intelligent Systems and Computing, vol 325. Springer, New Delhi. https://doi.org/10.1007/978-81-322-2135-7_2
Download citation
DOI: https://doi.org/10.1007/978-81-322-2135-7_2
Published:
Publisher Name: Springer, New Delhi
Print ISBN: 978-81-322-2134-0
Online ISBN: 978-81-322-2135-7
eBook Packages: EngineeringEngineering (R0)