A Method to Evaluate Disabled User Interaction: A Case Study with Down Syndrome Children

  • Isys Macedo
  • Daniela G. Trevisan
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8009)


Testing products with representative users is a key factor for user-centered design. When such representative users are disabled children the user testing process becomes a challenge and in this case evaluation methods based on heuristics and inspection could not attend the final user needs. The major purpose of our research is to provide an evaluation method that could measure disabled children interaction. This work first discusses the development of the coding scheme based on the detailed video analysis method which was adapted to observe interaction of children with Down syndrome. After that we demonstrate the method reliability by applying the cohen’s kappa coefficient and the any-two agreement measure. Finally we discuss how this method could be used to evaluate usability and fun problems.


Usability game evaluation children interaction down-syndrome 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Brandão, A., et al.: JECRIPE: stimulating cognitive abilities of children with Down Syndrome in pre-scholar age using a game approach. In: Proceedings of the 7th International Conference on Advances in Computer Entertainment Technology (ACE 2010), pp. 15–18. ACM, New York (2010)CrossRefGoogle Scholar
  2. 2.
    Barendregt, W., Bekker, M.M.: Developing a coding scheme for detecting usability and fun problems in computer games for young children. Behavior Research Methods 38(3), 382–389 (2006)CrossRefGoogle Scholar
  3. 3.
    Hertzum, M., Ebbe, J.N.: The Evaluator Effect: A Chilling Fact about Usability Evaluation Methods. International Journal of Human-Computer Interaction 15(1), 183–204 (2003)CrossRefGoogle Scholar
  4. 4.
    Carletta, J.: Assessing agreement on classification tasks: The kappa statistic. Computational Linguistics 22(2), 249–254 (1996)Google Scholar
  5. 5.
    Vermeeren, A.P.O.S., den Bouwmeester, K., Aasman, J., de Ridder, H.: DEVAN: A detailed video analysis of user test data. Behaviour & Information Technology 21, 403–423 (2002)CrossRefGoogle Scholar
  6. 6.
    Brandão, A., Trevisan, D.G., Brandão, L., Moreira, B., Nascimento, G., Vasconcelos, C.N., Clua, E., Mourão, P.: Semiotic Inspection of a Game for Children with Down Syndrome. In: Proceedings of the Brazilian Symposium on Games and Digital Entertainment (SBGAMES 2010), pp. 199–210. IEEE Computer Society, Washington, DC (2010)CrossRefGoogle Scholar
  7. 7.
    Dix, A., Finlay, J., Abowd, G.D., Beale, R.: Human-Computer Interaction, 3rd edn. Pearson (2004)Google Scholar
  8. 8.
    Jokisuu, E., Langdon, P., Clarkson, P.J.: Modelling Cognitive Impairment to Improve Universal Access. In: Stephanidis, C. (ed.) Universal Access in HCI, Part II, HCII 2011. LNCS, vol. 6766, pp. 42–50. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  9. 9.
    Read, J.C., Macfarlane, S.J., Casey, C.: Endurability, Engagement and Expectations: Measuring Children’s Fun. In: Proceedings of the Interaction Design and Children, pp. 189–198. Shaker Publishing, Germany (2002)Google Scholar
  10. 10.
    Macfarlane, S., Sim, G., Horton, M.: Assessing usability and fun in educational software. In: Proceedings of the 4th Conference on Interaction Design and Children (IDC 2005), pp. 103–109. ACM, New York (2005)CrossRefGoogle Scholar
  11. 11.
    Robson, C.: Real World Research: A resource for social scientists and practitioner researchers. Blackwell Publishers, Malden (1993)Google Scholar
  12. 12.
    Malone, T.W., Lepper, M.R.: Making learning fun: A taxonomy of intrinsic motivations for learning. In: Snow, R.E., Farr, M.J. (eds.) Aptitude, Learning, and Interaction III: Cognitive and Affective Process Analysis, pp. 223–253. Erlbaum, Hillsdale (1987)Google Scholar
  13. 13.
    Barendregt, W., Bekker, M.M., Speerstra, M.: Empirical evaluation of usability and fun in computer games for children. In: Rauterberg, M., Menozzi, M., Wesson, J. (eds.) Proceedings of the IFIP 8th International Conference on Human–Computer Interaction, pp. 705–708. IOS Press, Amsterdam (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Isys Macedo
    • 1
  • Daniela G. Trevisan
    • 1
  1. 1.IC – Instituto de ComputaçãoUniversidade Federal FluminenseRio de JaneiroBrasil

Personalised recommendations