Effects of Teamwork versus Group Work on Signal Detection in Cyber Defense Teams

  • Prashanth Rajivan
  • Michael Champion
  • Nancy J. Cooke
  • Shree Jariwala
  • Genevieve Dube
  • Verica Buchanan
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8027)


Cyber security is critical for any modern day organization’s operations. Organizational structure and reward policies not conducive for teamwork may be affecting the performance of cyber defense analysts. Past research shows that team interaction could lead to better cyber defense performance. However, the value of team work in the cyber defense context has not been demonstrated using empirical methodologies. To explore this, we conducted a study on the effects of teamwork versus group work (i.e., looking at both the team and individual levels) on signal detection performance of cyber security defense analysts using the synthetic task environment called CyberCog. The results from the preliminary analysis conducted reveal that simply encouraging analysts to work as a team and providing team-level rewards leads to better team performance in cyber defense analysis.


Cyber Defense Performance Team Cognition Team Performance Synthetic Task Environment CyberCog 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ponemon, I.: 2012 cost of cyber crime study. Ponemon Institute, United states (2012)Google Scholar
  2. 2.
    DAmico, A., Whitley, K., Tesone, D., OBrien, B., Roth, E.: Achieving cyber defense situational awareness: A cognitive task analysis of information assurance analysts. In: Human Factors and Ergonomics Society Annual Meeting Proceedings, pp. 229–233 (2005)Google Scholar
  3. 3.
    D’Amico, A., Whitley, K.: The Real Work of Computer Network Defense Analysts. In: VizSEC 2007, pp. 19–37 (2008)Google Scholar
  4. 4.
    Boyce, M.W., Duma, K.M., Hettinger, L.J., Malone, T.B., Wilson, D.P., Lockett-Reynolds, J.: Human performance in cybersecurity. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, pp. 1115–1119 (2011)Google Scholar
  5. 5.
    Liu, P.: Computer-aided Human Centric Cyber Situation Awareness (2009)Google Scholar
  6. 6.
    Champion, M., Rajivan, P., Cooke, N.J., Jariwala, S.: Team-based cyber defense analysis. In: 2012 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA), pp. 218–221 (2012)Google Scholar
  7. 7.
    Salas, E., Dickinson, T.L., Converse, S.A., Tannenbaum, S.I.: Toward an understanding of team performance and training. Teams their Training and Performance, 3–29 (1992)Google Scholar
  8. 8.
    Salas, E., Cooke, N.J., Rosen, M.A.: On teams, teamwork, and team performance: Discoveries and developments. Human Factors: The Journal of the Human Factors and Ergonomics Society 50, 540–547 (2008)CrossRefGoogle Scholar
  9. 9.
    Cooke, N.J., Gorman, J.C., Winner, J.L.: Team cognition. In: Handbook of Applied Cognition, pp. 239–268 (2007)Google Scholar
  10. 10.
    Cannon-Bowers, J.A., Salas, E.: Reflections on shared cognition. J. Organ. Behav. 22, 195–202 (2001)CrossRefGoogle Scholar
  11. 11.
    Jariwala, S., Champion, M., Rajivan, P., Cooke, N.J.: Influence of team communication and coordination on the performance of teams at the iCTF competition. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, pp. 458–462 (2012)Google Scholar
  12. 12.
    Cooke, N.J., Rivera, K., Shope, S.M., Caukwell, S.: A synthetic task environment for team cognition research. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, pp. 303–308 (1999)Google Scholar
  13. 13.
    Rajivan, P.: CyberCog A Synthetic Task Environment for Measuring Cyber Situation Awareness (Master’s Thesis). Retrieved from ProQuest Dissertations & Theses (PQDT) Database (2011)Google Scholar
  14. 14.
    Stanislaw, H., Todorov, N.: Calculation of signal detection theory measures. Behavior Research Methods 31, 137–149 (1999)CrossRefGoogle Scholar
  15. 15.
    Hart, S.G., Staveland, L.E.: Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Human Mental Workload 1, 139–183 (1988)CrossRefGoogle Scholar
  16. 16.
    Lewis, K.: Measuring transactive memory systems in the field: scale development and validation. J. Appl. Psychol. 88, 587 (2003)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Prashanth Rajivan
    • 1
  • Michael Champion
    • 1
  • Nancy J. Cooke
    • 1
  • Shree Jariwala
    • 1
  • Genevieve Dube
    • 2
  • Verica Buchanan
    • 1
  1. 1.CERTT LabArizona State UniversityMesaUSA
  2. 2.Université LavalQuebecCanada

Personalised recommendations