Abstract
The Communicability Evaluation Method (CEM) is based on Semiotic Engineering HCI theory and involves observing users in a controlled environment and capturing with software the user-system interaction. The analysis involves 3 steps: (1) tagging: watching the user-system interaction video, identifying the communicative breakdowns, associating one of CEM´s utterance (from a predefined set of 13) to the breakdown; (2) interpretation: interpreting the problems that are being indicated by the tagging performed in the first step; (3) semiotic profiling: reconstructing the intended communication being conveyed by the system and the problems identified. Originally CEM requires the evaluator to perform all 3 steps. In this paper we investigate the possibility of users themselves performing the tagging step of the analysis and the costs and benefits of such a procedure. If users are able to identify and tag breakdowns they can directly communicate the problems they have experienced. Our results have shown that user tagging is possible and pointed to various directions in which it could be very useful. We present the case study performed, the results found and discuss costs and benefits of such procedure.
Chapter PDF
Similar content being viewed by others
Keywords
References
Carroll, J.M.: HCI models, theories, and frameworks: toward a multidisciplinary science. Morgan Kaufmann, Menlo Park (2003)
de Souza, C.S.: The semiotic engineering of human-computer interaction. MIT Press, Cambridge (2005)
de Souza, C.S., Leitão, C.F.: Semiotic engineering methods for scientific research in HCI. Morgan & Claypool, Princeton (2009)
Ericsson, K.A., Simon, H.A.: Protocol analysis: Verbal Reports as Data. MIT Press, Cambridge (1993)
Greenberg, S., Buxton, B.: Usability evaluation considered harmful (some of the time). In: Proceedings of ACM CHI 2008, Italy, pp. 111–120 (2008)
Frøkjær, E., Hornbæk, K.: Cooperative usability testing: complementing usability tests with user-supported interpretation sessions. In: Proc. of CHI 2005, pp. 1383–1386. ACM (2005)
Guan, Z., Lee, S., Cuddihy, E., Ramey, J.: The validity of the stimulated retrospective think-aloud method as measured by eye tracking. In: CHI 2006, pp. 1253–1262. ACM (2006)
Mattos, B., Prates, R.: An overview of the communicability evaluation method for collaborative systems. In: IADIS International Conference WWW/Internet, pp. 129–136 (2011)
Prates, R.O., de Souza, C.S., Barbosa, S.D.J.: A method for evaluating the communicability of user interfaces. ACM Interactions 7(1), 31–38 (2000)
Prates, R.O., Barbosa, S., de Souza, C.S.: A case study for evaluating interface design through communicability. In: Proceedings of DIS 2000, pp. 308–317. ACM (2000)
Preece, J., Rogers, Y., Sharp, H., Benyon, D., Holland, S., Carey, T.: Human-computer interaction. Addison-Wesley, Reading (1994)
Sharp, H., Rogers, Y., Preece, J.: Interaction Design: Beyond Human Computer Interaction. Wiley (2011), Case Study 14.3 Communicability Evaluation, http://www.id-book.com/casestudy_14-3.php (last visit Januaury 2014)
Teague, R., et al.: Concurrent vs. Post-Task Usability Test Ratings. In: Proc. CHI 2001, pp. 289–290. ACM Press (2001)
Salgado, L.C.C., Bim, S.A., de Souza, C.S.: Comparação entre os métodos de avaliação de base cognitiva e semiótica. In: Proceedings of IHC 2006. SBC, pp. 158–167 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Mattos, B.A.M., Pereira, R.L.S., Prates, R.O. (2014). Can Users Speak for Themselves? Investigating Users Ability to Identify Their Own Interactive Breakdowns. In: Kurosu, M. (eds) Human-Computer Interaction. Theories, Methods, and Tools. HCI 2014. Lecture Notes in Computer Science, vol 8510. Springer, Cham. https://doi.org/10.1007/978-3-319-07233-3_48
Download citation
DOI: https://doi.org/10.1007/978-3-319-07233-3_48
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07232-6
Online ISBN: 978-3-319-07233-3
eBook Packages: Computer ScienceComputer Science (R0)