Study of the Usability of the WYRED Ecosystem Using Heuristic Evaluation
The WYRED ecosystem is a composition of Open Source tools and the people involved in the project, i.e., partners, stakeholders and young people between the ages of 7 and 30 years. The main component of this ecosystem is the WYRED Platform. The WYRED Platform relies on communities, which are a set of interaction spaces where conversations and research projects are developed. Every community has a person or persons in charge of its management, which are the so-called facilitators, and also a set of members, mainly young people, interacting through discussion threads. The high levels of interaction required to accomplish the WYRED Platform’s goals lead to the necessity of ensuring that the system is accepted by its final users. Given this need, a preliminary study was performed to analyze the usability of the Platform from the point of view of young people. However, it is also crucial that the ecosystem meets usability criteria for the facilitators, due to their role of encouraging young people to participate and serving as a guide in the conversations taking place within communities, as well as in the research projects developed by the young people about different topics related to the digital society. Therefore, a usability study targeting facilitators was carried out to reach insights about how these users value the system’s usability. This usability study was performed through a combination of two techniques, a heuristic analysis by experts and the Computer System Usability Questionnaire to collect the experience of the real users.
KeywordsDigital society Heuristic evaluation Usability European project Technological ecosystem Software ecosystem Youth
This research was supported by the Spanish Ministry of Education, Culture and Sport under a FPU fellowship (FPU17/03276).
With the support of the EU Horizon 2020 Programme in its “Europe in a changing world – inclusive, innovative and reflective Societies (HORIZON 2020: REV-INEQUAL-10-2016: Multi-stakeholder Platform for enhancing youth digital opportunities)” Call. Project WYRED (netWorked Youth Research for Empowerment in the Digital society) (Grant agreement No. 727066). The sole responsibility for the content of this webpage lies with the authors. It does not necessarily reflect the opinion of the European Union. The European Commission is not responsible for any use that may be made of the information contained therein.
- 1.Burch, S.: Information society and knowledge society. In: Ambrosi, A., Peugeot, V., Pimienta, D. (eds.) Word Matters: multicultural perspectives on information societies. C&F Éditions, Caen (2005)Google Scholar
- 2.UNESCO: Towards Knowledge Societies. An Interview with Abdul Waheed Khan (2003)Google Scholar
- 3.Buckingham, D.: Youth, Identity, and Digital Media. The MIT Press, Cambridge (2007)Google Scholar
- 4.García-Peñalvo, F.J., Kearney, N.A.: Networked youth research for empowerment in digital society: the WYRED project. In: García-Peñalvo, F.J. (ed.) Proceedings of the Fourth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM 2016), Salamanca, Spain, November 2–4, 2016, pp. 3–9. ACM, New York (2016)Google Scholar
- 6.García-Peñalvo, F.J.: WYRED project. Educ. Knowl. Soc. 18, 7–14 (2017)Google Scholar
- 7.García-Peñalvo, F.J., García-Holgado, A.: WYRED, a platform to give young people the voice on the influence of technology in today’s society. A citizen science approach. In: Villalba-Condori, K.O., García-Peñalvo, F.J., Lavonen, J., Zapata-Ros, M. (eds.) Proceedings of the II Congreso Internacional de Tendencias e Innovación Educativa – CITIE 2018, Arequipa, Perú, November 26–30, 2018, pp. 128–141. CEUR-WS.org, Aachen (2019)Google Scholar
- 9.García-Peñalvo, F.J., García-Holgado, A., Vázquez-Ingelmo, A., Seoane Pardo, A.M.: Analyzing the usability of the WYRED Platform with undergraduate students to improve its features. Universal Access in the information society in press (2019)Google Scholar
- 10.Brooke, J.: SUS-A quick and dirty usability scale. Usability Eval. Ind. 189, 4–7 (1996)Google Scholar
- 11.Nielsen, J.: Heuristic evaluation. In: Nielsen, J., Mack, R.L. (eds.) Usability Inspection Methods, vol. 17, pp. 25–62. Wiley, Hoboken (1994)Google Scholar
- 12.Sauro, J., Lewis, J.R. Morgan Kaufmann, Boston (2012)Google Scholar
- 15.Hedlefs Aguilar, M.I., de la Garza González, A., Sánchez Miranda, M.P., Garza Villegas, A.A.: Spanish adaptation of computer system usability questionnaire CSUQ. Revista Iberoamericana de las Ciencias Computacionales e Informática, vol. 4 (2015)Google Scholar
- 16.Sauro, J., Lewis, J.R.: Quantifying the User Experience: Practical Statistics for User Research. Morgan Kaufmann, Amsterdam (2016)Google Scholar
- 17.Vázquez-Ingelmo, A.: Code repository that supports the analysis of the usability test (through the CSUQ questionnaire) applied to the WYRED Platform (2019)Google Scholar
- 19.Brooke, J.: SUS: a retrospective. J. Usability Stud. 8, 29–40 (2013)Google Scholar