Abstract
Mashup tools are platforms that enable end users to combine components from multiple sources and thus create, deploy, and share their own web applications. The aim of this paper is to present and discuss the findings of two empirical studies on evaluation of mashup tools by means of subjective and objective measuring instruments. In the first study, data were gathered with the employment of SUS post-use questionnaire and Tobii eye-tracking device, and in the second, by applying the retrospective thinking aloud method. The analysis of collected data uncovered strengths and weaknesses of evaluated mashup tools. In addition, the relevance that users assign to quality in use attributes in the context of mashup tools has been determined.
Chapter PDF
Similar content being viewed by others
Keywords
References
Bangor, A., Kortum, P., Miller, J.: Determining What Individual SUS Scores Mean: Adding an Adjective Rating Scale. Journal of Usability Studies 4(3), 114–123 (2009)
Bastien, J.M., Scapin, D.L.: Ergonomic Criteria for the Evaluation of Human-Computer Interfaces. Technical Report no. 156. INRIA, Rocquencourt (1993)
Brooke, J.: SUS: a “quick and dirty” usability scale. In: Jordan, P.W., Thomas, B., Weerdmeester, B.A., McClelland, I.L. (eds.) Usability Evaluation in Industry, pp. 189–194. Taylor and Francis, London (1996)
Cappiello, C., Daniel, F., Koschmider, A., Matera, M., Picozzi, M.: A Quality Model for Mashups. In: Auer, S., Díaz, O., Papadopoulos, G.A. (eds.) ICWE 2011. LNCS, vol. 6757, pp. 137–151. Springer, Heidelberg (2011)
Cappiello, C., Daniel, F., Matera, M.: A Quality Model for Mashup Components. In: Gaedke, M., Grossniklaus, M., Díaz, O. (eds.) ICWE 2009. LNCS, vol. 5648, pp. 236–250. Springer, Heidelberg (2009)
Cedillo, P., Fernandez, A., Insfran, E., Abrahão, S.: Quality of Web Mashups: A Systematic Mapping Study. In: Sheng, Q.Z., Kjeldskov, J. (eds.) ICWE Workshops 2013. LNCS, vol. 8295, pp. 66–78. Springer, Heidelberg (2013)
De Vrieze, P., Xu, L., Bouguettaya, A., Yang, J., Chen, J.: Process-Oriented Enterprise Mashups. In: Proceedings of the Workshops at the 4th International Conference on Grid and Pervasive Computing, pp. 64–71. IEEE, Geneva (2009)
Fichter, D., Wisniewski, J.: They Grow Up So Fast: Mashups in the Enterprise. Online 33(3), 54–57 (2009)
Hoyer, V., Fischer, M.: Market Overview of Enterprise Mashup Tools. In: Bouguettaya, A., Krueger, I., Margaria, T. (eds.) ICSOC 2008. LNCS, vol. 5364, pp. 708–721. Springer, Heidelberg (2008)
Insfran, E., Cedillo, P., Fernández, A., Abrahão, S., Matera, M.: Evaluating the Usability of Mashups Applications. In: Proceedings of the 8th International Conference on the Quality of Information and Communications Technology, pp. 323–326. IEEE, Lisbon (2012)
ISO/IEC 25010:2011. Systems and software engineering – Systems and software Quality Requirements and Evaluation (SQuaRE) – System and software quality models (2011)
Koschmider, A., Hoyer, V., Giessmann, A.: Quality Metrics for Mashups. In: Proceedings of the Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists, pp. 376–380. ACM, Bela-Bela (2010)
Malinga, M., Gruner, S., Koschmider, A.: Quality and usability of mashup tools: criteria and evaluation. In: Proceedings of the Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists, pp. 154–159. ACM, East London (2013)
Nestler, T.: Towards a mashup-driven end-user programming of SOA-based applications. In: Proceedings of the 10th International Conference on Information Integration and Web-based Applications & Services, pp. 551–554. ACM, Linz (2008)
Olsina, L., Rossi, G.: Measuring Web Application Quality with WebQEM. IEEE Multimedia 9(4), 20–29 (2002)
Orehovački, T., Bubaš, G., Kovačić, A.: Taxonomy of Web 2.0 Applications with Educational Potential. In: Cheal, C., Coughlin, J., Moore, S. (eds.) Transformation in Teaching: Social Media Strategies in Higher Education, pp. 43–72. Informing Science Press, Santa Rosa (2012)
Orehovački, T., Granić, A., Kermek, D.: Evaluating the Perceived and Estimated Quality in Use of Web 2.0 Applications. The Journal of Systems and Software 86(12), 3039–3059 (2013)
Pang, M., Suh, W., Hong, J., Kim, J., Lee, H.: A New Web Site Quality Assessment Model for the Web 2.0 Era. In: Murugesan, S. (ed.) Handbook of Research on Web 2.0, 3.0, and X.0: Technologies, Business, and Social Applications, pp. 387–410. IGI Global, Hershey (2010)
Picozzi, M., Rodolfi, M., Cappiello, C., Matera, M.: Quality-Based Recommendations for Mashup Composition. In: Daniel, F., Facca, F.M. (eds.) ICWE 2010 Workshops. LNCS, vol. 6385, pp. 360–371. Springer, Heidelberg (2010)
Seffah, A., Donyaee, M., Kline, R.B., Padda, H.K.: Usability measurement and metrics: A consolidated model. Software Quality Journal 14(2), 159–178 (2006)
Young, G.O.: The Mashup Opportunity – How To Make Mone in The Evolving Mashup Ecosystem. Forrester Research (2008), http://mdc.jackbe.com/enterprise-mashup/sites/default/files/Forrester_The_Mashup_Opportunity_May2008_0.pdf
Zhao, Z., Bhattarai, S., Liu, J., Crespi, N.: Mashup Services to Daily Activities – End-user Perspective in Designing a Consumer Mashups. In: Proceedings of the 13th International Conference on Information Integration and Web-based Applications and Services, pp. 222–229. ACM, Ho Chi Minh City (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Orehovački, T., Granollers, T. (2014). Subjective and Objective Assessment of Mashup Tools. In: Marcus, A. (eds) Design, User Experience, and Usability. Theories, Methods, and Tools for Designing the User Experience. DUXU 2014. Lecture Notes in Computer Science, vol 8517. Springer, Cham. https://doi.org/10.1007/978-3-319-07668-3_33
Download citation
DOI: https://doi.org/10.1007/978-3-319-07668-3_33
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07667-6
Online ISBN: 978-3-319-07668-3
eBook Packages: Computer ScienceComputer Science (R0)