Abstract
Given their critical role as gateways to Web content, the search results a Web search engine provides to its users have an out-sized impact on the way each user views the Web. Previous studies have shown that popular Web search engines like Google employ sophisticated personalization engines that can occasionally provide dramatically inconsistent views of the Web to different users. Unfortunately, even if users are aware of this potential, it is not straightforward for them to determine the extent to which a particular set of search results differs from those returned to other users, nor the factors that contribute to this personalization.
We present the design and implementation of Bobble, a Web browser extension that contemporaneously executes a user’s Google search query from a variety of different world-wide vantage points under a range of different conditions, alerting the user to the extent of inconsistency present in the set of search results returned to them by Google. Using more than 75,000 real search queries issued by over 170 users during a nine-month period, we explore the frequency and nature of inconsistencies that arise in Google search queries. In contrast to previously published results, we find that 98% of all Google search results display some inconsistency, with a user’s geographic location being the dominant factor influencing the nature of the inconsistency.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
More personalization on bing with adaptive search, http://www.youtube.com/watch?v=CgrzhyHCnfw
Dou, Z., Song, R., Wen, J.-R.: A large-scale evaluation and analysis of personalized search strategies. In: Proceedings of the 16th International Conference on World Wide Web. ACM (2007)
Making search more relevant, http://www.google.com/goodtoknow/data-on-google/more-relevant/
Guha, S., Cheng, B., Francis, P.: Challenges in measuring online advertising systems. In: Proceedings of the 10th ACM SIGCOMM Conference on Internet Measurement. ACM (2010)
Hannak, A., Sapieżyński, P., Kakhki, A.M., Krishnamurthy, B., Lazer, D., Mislove, A., Wilson, C.: Measuring Personalization of Web Search. In: Proceedings of the Twenty-Second International World Wide Web Conference (WWW 2013), Rio de Janeiro, Brazil (May 2013)
Mikians, J., Gyarmati, L., Erramilli, V., Laoutaris, N.: Detecting price and search discrimination on the internet. In: Proceedings of the 11th ACM Workshop on Hot Topics in Networks. ACM (2012)
Pariser, E.: The Filter Bubble: What the Internet is Hiding from You. Penguin Press (2011)
Planetlab: An open platform for developing, deploying, and accessing planetary-scale services, http://planet-lab.org/
Selenium - web browser automation, http://seleniumhq.org/
What is a #1 google ranking worth? http://training.seobook.com/google-ranking-value
Teevan, J., Dumais, S.T., Horvitz, E.: Beyond the commons: Investigating the value of personalizing web search. In: Proceedings of the Workshop on New Technologies for Personalized Information Access (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Xing, X., Meng, W., Doozan, D., Feamster, N., Lee, W., Snoeren, A.C. (2014). Exposing Inconsistent Web Search Results with Bobble. In: Faloutsos, M., Kuzmanovic, A. (eds) Passive and Active Measurement. PAM 2014. Lecture Notes in Computer Science, vol 8362. Springer, Cham. https://doi.org/10.1007/978-3-319-04918-2_13
Download citation
DOI: https://doi.org/10.1007/978-3-319-04918-2_13
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-04917-5
Online ISBN: 978-3-319-04918-2
eBook Packages: Computer ScienceComputer Science (R0)