An Experience of Textual Evaluation Using the MALTU Methodology

  • Marilia S. MendesEmail author
  • Elizabeth Furtado
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10914)


This paper presents an experience of textual evaluation in Usability and User eXperience in an academic system. The methodology used for the textual evaluation was MALTU. In this study, we analyzed 650 postings from an academic system and these posts have gone through a process of textual evaluation whose results will be presented in this paper.


Textual evaluation Usability User eXperience (UX) Postings related to the use (PRUs) 



This project is funded by the Fundação Cearense de Apoio a Desenvolvimento Científico e Tecnológico (FUNCAP) and supported by LINCE Laboratories (Laboratory of Computer Science and Software Engineering) and LUQS (Laboratory of user studies and Quality of use of the Systems).


  1. 1.
    Bargas-avila, J.A., Hornbæk, K.: Old wine in new bottles or novel challenges: a critical analysis of empirical studies of user experience. In: CHI 2011, Vancouver, pp. 2689–2698 (2011)Google Scholar
  2. 2.
    Bevan, N.: What is the difference between the purpose of usability and user experience evaluation methods? In: UXEM 2009, INTERACT 2009, Uppsala, Sweden, pp. 24–28 (2009)Google Scholar
  3. 3.
    Castillo, C., Mendoza, M., Poblete, B.: Information credibility on Twitter. In: Proceedings of the 20th international Conference on World Wide Web, Hyderabad, India, pp. 675–684 (2011)Google Scholar
  4. 4.
    Freitas, L., Silva, T., Mendes, M.: Avaliação do Spotify – uma experiência de avaliação textual utilizando a metodologia MALTU. In: IHC 2016, São Paulo, Brazil (2016)Google Scholar
  5. 5.
    Hassenzahl, M., Diefenbach, S., Goritz, A.: Needs, affect, and interactive products. J. Interact. Comput. 22(5), 353–362 (2010)CrossRefGoogle Scholar
  6. 6.
    Hedegaard, S., Simonsen, J. G.. Extracting usability and user experience information from online user reviews. In: Proceedings of CHI 2013, Paris, France, pp. 2089–2098 (2013)Google Scholar
  7. 7.
    ISO DIS 9241 - 210:2008: Ergonomics of human system interaction - Part 210: Human -centred design for interactive systems (formerly known as 13407)Google Scholar
  8. 8.
    Ketola, P., Roto, V.: Exploring user experience measurement needs. In: 5th COST294-MAUSE Open Workshop on Valid Useful User Experience Measurement (2008)Google Scholar
  9. 9.
    Korhonen, H., Arrasvuori, J., Väänänen-vainio-mattila, K.: Let users tell the story. In: Proceedings of CHI 2010, pp. 4051–4056 (2010)Google Scholar
  10. 10.
    Lima, A., Silva, P., Cruz, L., Mendes, M.: Investigating the polarity of user postings in a social system. In: 19th International Conference on Human-Computer Interaction, HCII 2017 (2017)CrossRefGoogle Scholar
  11. 11.
    Mao, H., Shuai, X., Kapadia, A.: Loose tweets: an analysis of privacy leaks on Twitter. In: Proceedings of WPES 2011, Chicago, IL, USA, pp. 1–12 (2011)Google Scholar
  12. 12.
    Mendes, M.S.: MALTU - model for evaluation of interaction in social systems from the users textual language, 200 f. Thesis (Ph.D. in Computer Science) – Federal University of Ceará (UFC), Fortaleza, CE – Brazil (2015)Google Scholar
  13. 13.
    Mendes, M.S., Furtado, E.S., Furtado, V., Castro, M.F.: Investigating usability and user experience from the user postings in social systems. In: HCI International (2015)CrossRefGoogle Scholar
  14. 14.
    Mendes, M.S., Furtado, E.S., Militao, G., Castro, M.F.: Hey, I have a problem in the system. Who can help me? An investigation of Facebook users interaction when facing privacy problems. In: HCI International, pp. 391–403 (2015)Google Scholar
  15. 15.
    Mendes, M.S., Furtado, E., Castro, M.F.: Do users write about the system in use? An investigation from messages in natural language on Twitter. In: 7th Euro American Association on Telematics and Information Systems, Valparaiso, Chile (2014)Google Scholar
  16. 16.
    Mendes, M., Furtado, E.: UUX-Posts: a tool for extracting and classifying postings related to the use of a system. In: VIII Latin American Conference on Human-Computer Interaction, CLIHC 2017 (2017)Google Scholar
  17. 17.
    Mendes, M., Furtado, E., Furtado, V., Castro, M.: How do users express their emotions regarding the social system in use? A classification of their postings by using the emotional analysis of Norman. HCI Int. 2014, 229–241 (2014)Google Scholar
  18. 18.
    Obrist, M., Roto, V., Väänänen-vainio-mattila, K.: User experience evaluation – do you know which method to use? In: CHI 2009, pp. 2763–2766 (2009)Google Scholar
  19. 19.
    Oliveira, D., Furtado, E., Mendes, M.: Do users express values during use of social systems? A classification of their postings in personal, social and technical values. In: HCI International, Los Angeles, CA, USA (2016)Google Scholar
  20. 20.
    Olsson, T., Salo, M.: Narratives of satisfying and unsatisfying experiences of current mobile augmented reality applications. In: CHI 2012, pp. 2779–2788 (2012)Google Scholar
  21. 21.
    Partala, T., Kallinen, A.: Understanding the most satisfying and unsatisfying user experiences: emotions, psychological needs, and context. Proc. Interact. Comput. 24(1), 25–34 (2012)CrossRefGoogle Scholar
  22. 22.
    Preece, J., Rogers, Y., Sharp, H.: Interaction Design: Beyond Human-Computer Interaction. Wiley, New York (2002)Google Scholar
  23. 23.
    Reynolds, B., Venkatanathan, J., Gonçalves, J., Kostakos, V.: Sharing ephemeral information in online social networks: privacy perceptions and behaviours. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds.) INTERACT 2011. LNCS, vol. 6948, pp. 204–215. Springer, Heidelberg (2011). Scholar
  24. 24.
    SIGAA: Integrated Management System for Academic Activities. Accessed 10 Mar 2018
  25. 25.
    Silva, T., Freitas, L., Mendes, M.: Beyond traditional evaluations - users view in app stores. In: IHC 2017, Joinville, Brazil (2017)Google Scholar
  26. 26.
    Tuch, A.N., Trusell, R.N., Hornbæk, K.: Analyzing users’ narratives to understand experience with interactive products. In: Proceedings of CHI 2013, pp. 2079–2088 (2013)Google Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Federal University of Ceará (UFC)RussasBrazil
  2. 2.University of Fortaleza (UNIFOR)FortalezaBrazil

Personalised recommendations