Skip to main content

Abstract

We considered the measured vs. perceived web performance case study. The work aimed to find a relationship between the automatically measured times of loading elements on web pages with zoological articles and the feelings of users regarding these loading times. We found that the following automatically measured performance metrics, translate the best into the perceived performance evaluated by the users: (i) page_loading, measured by Selenium; (ii) first_meaningful_paint, measured by PageSpeed Insights; (iii) domInteractive measured by Browsertime; and (iv) contentEventLoad, measured by Browsertime. In research carried out with the use of Selenium; however, there is a problem of changes in the interface that make the measurement unable to be performed correctly. A possible solution to this problem could be to change the used CSS selectors from selectors picked from the website itself to selectors defined based on the analysis of the selected HTML code. Another solution would be to use tools that allow, for example, to detect all graphic files on the website and design navigation based on them.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. New Industry Benchmarks for Mobile Page Speed - Think With Google. https://www.thinkwithgoogle.com/marketing-resources/data-measurement/mobile-page-speed-new-industry-benchmarks/. Accessed 28 May 2019

  2. How Fast Should Your Web Page Load and How To Speed Up Your Website. https://www.hobo-web.co.uk/your-website-design-should-load-in-4-seconds/. Accessed 19 Jun 2019

  3. Average Page Load Times for 2018 - How does yours compare? - MachMetrics Speed Blog. https://www.machmetrics.com/speed-blog/average-page-load-times-websites-2018/. Accessed 19 Jun 2019

  4. Szalek, K., Borzemski, L.: Conversion rate gain with web performance optimization. A case study. In: Information Systems Architecture and Technology: Proceedings of 39th International Conference on Information Systems Architecture and Technology – ISAT 2018, AISC, vol. 852, pp. 312–323. Springer

    Google Scholar 

  5. Politi, R., Sereno, M., Sereno, M., Ruffo, G., Schifanella, R.: WALTy: a user behavior tailored tool for evaluating web application performance. In: Third IEEE International Symposium on Network Computing and Applications, 2004 (NCA 2004), Proceedings, pp. 77–86. IEEE (2004)

    Google Scholar 

  6. Eckersley, P.: How unique is your web browser? In: International Symposium on Privacy Enhancing Technologies Symposium, pp. 1–18. Springer (2010)

    Google Scholar 

  7. Zhu, K., Fu, J., Li, Y.: Research the performance testing and performance improvement strategy in web application. In: 2010 2nd International Conference on Education Technology and Computer, pp. V2–328. IEEE (2010)

    Google Scholar 

  8. Butkiewicz, M., Madhyastha, H.V., Sekar, V.: Understanding website complexity: measurements, metrics, and implications. In: Proceedings of the 2011 ACM SIGCOMM Internet Measurement Conference, pp. 313–328. ACM (2011)

    Google Scholar 

  9. Liandin, Z.: WebProphet: automating performance prediction for web services. In: NSDI, vol. 10, pp. 143–158 (2010)

    Google Scholar 

  10. Wangandin, X.S.: Demystifying page load performance with WProf. In: Presented as part of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13), pp. 473–485 (2013)

    Google Scholar 

  11. Ihm, S., Pai, V.S.: Towards understanding modern web traffic. In: Proceedings of the 2011 ACM SIGCOMM Conference on Internet Measurement Conference, pp. 295–312. ACM (2011)

    Google Scholar 

  12. Borzemski, L., Nowak, Z.: An empirical study of web quality: measuring the web from Wroclaw University of Technology campus. In: Engineering Advanced Web Applications 4th International Workshop on Web-Oriented Software Technologies/4th International Conference on Web Engineering, Munich, Germany, 28–30 2004, pp. 307–320 (2004)

    Google Scholar 

  13. Borzemski, L.: Testing, measuring, and diagnosing web sites from the users’ per- spective. Int. J. Enterp. Inf. Syst. (IJEIS) 2(1), 54–66 (2006)

    Article  Google Scholar 

  14. Prokopiuk, J., Nowak, Z.: The influence of HTTP/2 on user-perceived web application performance. Studia Informatica 38(3), 73–88 (2017)

    Google Scholar 

  15. Gaspard, C., Goldberg, S., Itani, W., Bertino, E., Nita-Rotaru, C.: SINE: cache-friendly integrity for the web. In: 2009 5th IEEE Workshop on Secure Network Protocols, pp. 7–12. IEEE (2009)

    Google Scholar 

  16. Cao, P., Zhang, J., Beach, K.: Active cache: caching dynamic contents on the web. In: Proceedings of the IFIP International Conference on Distributed Systems Platforms and Open Distributed Processing, pp. 373–388. Springer-Verlag (2009)

    Google Scholar 

  17. Resource Timing Level 2, W3C Working Draft 26 June 2019. https://www.w3.org/TR/resource-timing-2/. Accessed 06 Jun 2019

  18. Egger, S., Hossfeld, T., Schatz, R., Fiedler, M.: Waiting times in quality of experience for web-based services. In: Fourth International Workshop on Quality of Multimedia Experience, pp. 86–96. IEEE (2012)

    Google Scholar 

  19. Aladwani, A.M., Palvia, P.C.: Developing and validating an instrument for measuring user-perceived web quality. Inform. Manage. 39(6), 467–476 (2002)

    Article  Google Scholar 

  20. Guse, D., Schuck, S., Hohlfeld, O., Raake, A., Möller, S.: Subjective quality of webpage loading: the impact of delayed and missing elements on quality ratings and task completion time. In: 2015 Seventh International Workshop on Quality of Multimedia Experience (QoMEX), pp. 1–6. IEEE (2015)

    Google Scholar 

  21. Petrov, B., Vechev, M., Sridharan, M., Dolby, J.: Race detection for web applications. In: ACM SIGPLAN Notices, vol. 47, no. 6, pp. 251–262. ACM (2012)

    Article  Google Scholar 

  22. Bui, D.H., Liu, Y., Kim, H., Shin, I., Zhao, F.: Rethinking energy-performance trade-off in mobile web page loading. In: Proceedings of the 21st Annual International Conference on Mobile Computing and Networking, pp. 14–26. ACM (2015)

    Google Scholar 

  23. Wang, Z., Lin, F.X., Zhong, L., Chishtie, M.: Why are web browsers slow on smartphones?. In: Proceedings of the 12th Workshop on Mobile Computing Systems and Application, pp. 91–96. ACM (2011)

    Google Scholar 

  24. mPulse—Real-Time Performance Management and RUM—Akamai. https://www.akamai.com/us/en/products/performance/mpulse-real-user-monitoring.jsp. Accessed 18 Feb 2019

  25. Akamai GitHub. https://github.com/akamai. Accessed 18 Feb 2019

  26. Features—GTmetrix. https://gtmetrix.com/features.html. Accessed Feb 2019

  27. Lighthouse—Tools for Web Developer. https://developers.google.com/web/tools/lighthouse/#get-started. Accessed 18 May 2019

  28. About PageSpeed Insights—PageSpeed Insights—Google Develope. https://developers.google.com/speed/docs/insights/v5/about\#score. Accessed 18 Feb 2019

  29. YSlow - Official Open Source Project Website. http://yslow.org/. Accessed Feb 2019

  30. Selenium - Web Browser Automation. https://www.seleniumhq.org/. Accessed 18 May 2019

  31. Introduction to Browsertime. https://www.sitespeed.io/documentation/browsertime/introduction/. Accessed 18 May 2019

  32. Welcome to the wonderful world of Web Performance. https://www.sitespeed.io/. Accessed 18 May 2019

  33. Coach Introduction. https://www.sitespeed.io/documentation/coach/introduction/. Accessed 18 May 2019

  34. Use PageXray to convert HAR files to a more readable format. https://www.sitespeed.io/documentation/pagexray/. Accessed 18 May 2019

  35. Throttle - Simulate slow network connection. https://www.sitespeed.io/documentation/throttle/. Accessed 18 May 2019

  36. Web Performance of the World’s Top 100 E-Commerce Sites in 2018. https://royal.pingdom.com/web-performance-top-100-e-commerce-sites-in-2018/#section3. Accessed 22 Jun 2019

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Leszek Borzemski .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Borzemski, L., Kędras, M. (2020). Measured vs. Perceived Web Performance. In: Borzemski, L., Świątek, J., Wilimowska, Z. (eds) Information Systems Architecture and Technology: Proceedings of 40th Anniversary International Conference on Information Systems Architecture and Technology – ISAT 2019. ISAT 2019. Advances in Intelligent Systems and Computing, vol 1050. Springer, Cham. https://doi.org/10.1007/978-3-030-30440-9_27

Download citation

Publish with us

Policies and ethics