A Generic Approach to Evaluate the Success of Online Communities

  • Raoudha Chebil
  • Wided Lejouad Chaari
  • Stefano A. Cerri
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10448)


The success of online communities depends on different aspects and has been subject of several evaluation works. Most of the existing works in this scope are not generalizable due to their strong dependence to the considered community characteristics. Face to this finding, our aim is to propose a generic approach to evaluate and to improve the success of online communities. This paper starts by an identification of the success determinants of online communities including the participants, the technology as well as the common goal. After that, we propose a generic evaluation approach based on two levels. The first level consists in a failure detection based on a quantification of the success determinants. The second level focuses on a failure explanation and an identification of the most plausible causes of the detected failures. This approach was applied to evaluate the success of a social network-based community; it gave reliable results.


Online community Success evaluation Failure detection Failure explanation Social networks 


  1. 1.
    Antunes, P., Herskovic, V., Ochoa, S.F., Pino, J.A.: Structuring dimensions for collaborative systems evaluation. ACM Comput. Surv. CSUR 44(8), 1–28 (2012)Google Scholar
  2. 2.
    Baker, K., Greenberg, S., Gutwin, C.: Empirical development of a heuristic evaluation methodology for shared workspace groupware. In: Proceedings of the 2002 ACM Conference on Computer Supported Cooperative Work (CSCW 2002), pp. 96–105 (2002)Google Scholar
  3. 3.
    Dumas, J.S., Redish, J.: A practical guide to usability testing. Intellect books, Bristol (1999)Google Scholar
  4. 4.
    El-Kechaï, N., Després, C.: Rechercher les causes des actions erronées du formé pour les proposer au formateur. In: Actes de la conférence Environnements Informatiques pour l’Apprentissage Humain EIAH. Lausanne (2007)Google Scholar
  5. 5.
    Hollnagel, E.: Cognitive Reliability and Error Analysis Method. Elsevier Science, Oxford (1998)Google Scholar
  6. 6.
    Lin, H.F.: Determinants of successful virtual communities: contributions from system characteristics and social factors. Inf. Manag. 45(8), 522–527 (2008)CrossRefGoogle Scholar
  7. 7.
    Norman, G.: Likert scales, levels of measurement and the laws of statistics. Adv. Health Sci. Educ. 15(5), 625–632 (2010)CrossRefGoogle Scholar
  8. 8.
    Pinelle, D., Gutwin, C., Greenberg, S.: Task analysis for groupware usability evaluation: modeling shared-workspace tasks with the mechanics of collaboration. ACM Trans. Comput. Hum. Interact. TOCHI 10, 281–311 (2003)CrossRefGoogle Scholar
  9. 9.
    Preece, J.: Sociability and usability in online communities: determining and measuring success. Behav. Inf. Technol. 20(5), 347–356 (2001)CrossRefGoogle Scholar
  10. 10.
    Rheingold, H.: A slice of my life in my virtual community. High noon on the electronic frontier: conceptual issues in cyberspace, pp. 413–36 (1996)Google Scholar
  11. 11.
    Sentz, K., Ferson, S.: Combination of vidence in Dempster-Shafer theory, vol. 4015. Citeseer, Princeton (2002)CrossRefGoogle Scholar
  12. 12.
    Thomas, P., Labat, J.-M., Muratet, M., Yessad, A.: How to evaluate competencies in game-based learning systems automatically? In: Cerri, S.A., Clancey, W.J., Papadourakis, G., Panourgia, K. (eds.) ITS 2012. LNCS, vol. 7315, pp. 168–173. Springer, Heidelberg (2012). doi: 10.1007/978-3-642-30950-2_22CrossRefGoogle Scholar
  13. 13.
    Vassileva, J.: Motivating participation in social computing applications: a user modeling perspective. User Model. User Adapt. Interact. 22(1), 177–201 (2012)MathSciNetCrossRefGoogle Scholar
  14. 14.
    Wulf, V., Misaki, K., Atam, M., Randall, D., Rohde, M.: On the ground’in sidi bouzid: investigating social media use during the tunisian revolution. In: Proceedings of the 2013 Conference on Computer Supported Cooperative Work, pp. 1409–1418. ACM (2013)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Raoudha Chebil
    • 1
  • Wided Lejouad Chaari
    • 1
  • Stefano A. Cerri
    • 2
  1. 1.National School of Computer Studies (ENSI)Manouba University (UMA)ManoubaTunisia
  2. 2.The Montpellier Laboratory of Informatics, Robotics, and Microelectronics (LIRMM), University of Montpellier (UM), National Center for Scientific Research (CNRS)MontpellierFrance

Personalised recommendations