Web Characteristics and Evolution
Web characteristics are properties related to collections of documents accessible via the World Wide Web. There are vast numbers of properties that can be characterized. Some examples include the number of words in a document, the length of a document in bytes, the language a document is authored in, the mime-type of a document, properties of the URL that indentifies a document, HTML tags used to author a document, and the hyperlink structure created by the collection of documents.
As in the physical world, the process of change that the web continually undergoes is identified as web evolution. The web is a tremendously dynamic place, with new users, servers, and pages entering and leaving the system continuously, which causes the web to change very rapidly. Web evolution encompasses changes in all web characteristics, as defined above.
As early as 1994, researchers were interested in studying characteristics of the World Wide Web. As documented by...
- 4.Broder A, Kumar R, Maghoul F, Raghavan P, Rajagopalan S, Stata R, Tomkins A, Wiener J. Graph structure in the web: experiments and models. In: Proceedings of the 8th International World Wide Web Conference; 2002.Google Scholar
- 5.Charikar MS. Similarity estimation techniques from rounding algorithms. In: Proceedings of the 34th Annual ACM Symposium on Theory of Computing; 2002. p. 380–88.Google Scholar
- 6.Cho J, Garcia-Molina H. The evolution of the web and implications for an incremental crawler. In: Proceedings of the 26th International Conference on Very Large Data Bases; 2000. p. 200–09.Google Scholar
- 7.Douglis F, Feldmann A, Krishnamurthy B, Mogul JC. Rate of change and other metrics: a live study of the world wide web. In: Proceedings of the 1st USENIX Symposium on Internet Technologies and Systems; 1997.Google Scholar
- 8.Fetterly D, Manasse M, Najork M, Wiener J. A large-scale study of the evolution of web pages. In: Proceedings of the 12th International World Wide Web Conference; 2003. p. 669–78.Google Scholar
- 9.Henzinger M. Finding near-duplicate web pages: a large-scale evaluation of algorithms. In: Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval; 2006. p. 284–91.Google Scholar
- 10.Henzinger MR, Heydon A, Mitzenmacher M, Najork~M. On near-uniform url sampling. Comput Netw. 2000;33(1–6):294–308.Google Scholar
- 12.Pitkow JE. Summary of www characterizations. Comput Netw. 1998;30(1–7):551–8.Google Scholar
- 13.Woodruff A, Aoki PM, Brewer EA, Gauthier P, Rowe LA. An investigation of documents from the world wide web. Comput Netw. 1996;28(7–11):963–80.Google Scholar