Skip to main content
SpringerLink
Log in
Book cover

Multiple Criteria Decision Making and Aiding pp 95–143Cite as

Integrating Managerial Preferences into the Qualitative Multi-Criteria Evaluation of Team Members

  • Chapter
  • First Online:

Part of the book series: International Series in Operations Research & Management Science ((ISOR,volume 274))

Abstract

Managers can find it challenging to assess team members consistently and fairly. The ideal composition of qualities possessed by good team members depends on the organization, the team, and the manager. To enable managers to elucidate the qualities they require, we make use of an innovative methodology. This methodology is based on a multi-criteria decision aiding process, starting with the identification and definition of the dimensions that will be used to evaluate team members, then the inference of the manager’s preferences through a multi-step protocol combining multiple types of preference models, and finally extracting a set of rules that can support the manager in his/her tasks. We illustrate this methodology in the case of free/libre/open-source software development teams, where we were able to elicit the characteristics of a good, acceptable, or bad contributor based on multiple managers’ perspectives. We additionally provide an example on how to reproduce this experiment using the MCDA package for the R statistical environment.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD   89.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    Denise Paolucci and Mark Smith, Web 2.0 Expo SF, 2010, https://www.slideshare.net/dreamwidth/build-your-own-contributors-one-part-at-a-time.

  2. 2.

    Linux kernel mailing list. Google Groups, https://groups.google.com/d/msg/fa.linux.kernel/iQtWFALi4JA/eSzv64_tOvoJ. Other quotations from L. Torvalds may be found in Wikiquote: https://en.wikiquote.org/wiki/Linus_Torvalds.

References

  • Allen, M. S., Greenlees, I., & Jones, M. (2013). Personality in sport: A comprehensive review. International Review of Sport and Exercise Psychology, 6(1), 184–208.

    Article  Google Scholar 

  • Barcomb, A., Grottke, M., Stauffert, J.-P., Riehle, D., & Jahn, S. (2015). How developers acquire FLOSS skills. In Proceedings of the 11th international conference on open source systems (OSS 2015). Berlin: Springer.

    Chapter  Google Scholar 

  • Bassellier, G., & Benbasat, I. (2004). Business competence of information technology professionals: Conceptual development and influence on IT-business partnerships. MIS Quarterly, 28, 673–694.

    Article  Google Scholar 

  • Beecham, S. (2014). Motivating software engineers working in virtual teams across the globe. In Software project management in a changing world (pp. 247–273). Berlin: Springer.

    Google Scholar 

  • Beecham, S., & Noll, J. (2015). What motivates software engineers working in global software development? In P. Abrahamsson, L. Corral, M. Oivo, & B. Russo (Eds.), International conference on product-focused software process improvement (pp. 193–209). Berlin: Springer.

    Chapter  Google Scholar 

  • Bigaret, S., Hodgett, R., Meyer, P., Mironova, T., & Olteanu, A.-L. (2017). Supporting the multi-criteria decision aiding process: R and the MCDA package. EURO Journal on Decision Processes, 5(1–4), 169–194.

    Article  Google Scholar 

  • Bouyssou, D., & Marchant, T. (2007). An axiomatic approach to noncompensatory sorting methods in MCDM, I: The case of two categories. European Journal of Operational Research, 178(1), 217–245.

    Article  Google Scholar 

  • Bouyssou, D., & Marchant, T. (2007). An axiomatic approach to noncompensatory sorting methods in MCDM, II: More than two categories. European Journal of Operational Research, 178(1), 246–276.

    Article  Google Scholar 

  • Bouyssou, D., Marchant, T., Pirlot, M., Tsoukiàs, A., & Vincke, P. (2006). Evaluation and decision models with multiple criteria: Stepping stones for the analyst (vol. 86, 1st ed.). Boston: International Series in Operations Research and Management Science.

    Google Scholar 

  • Capraro, M., & Riehle, D. (2017). Inner source definition, benefits, and challenges. ACM Computing Surveys (CSUR), 49(4), 67.

    Google Scholar 

  • Carillo, K. D. A., & Marsan, J. (2016). “The dose makes the poison”—exploring the toxicity phenomenon in online communities. In International conference on information systems ICIS.

    Google Scholar 

  • Castilla, E. J., & Benard, S. (2010). The paradox of meritocracy in organizations. Administrative Science Quarterly, 55(4), 543–676.

    Article  Google Scholar 

  • Chen, S.-J., & Lin, L. (2004) Modeling team member characteristics for the formation of a multifunctional team in concurrent engineering. IEEE Transactions on Engineering Management, 51(2), 111–124.

    Article  Google Scholar 

  • David, P., Ghosh, R. A., Glott, R., González-Barahona, J. M. Federico Heinz, & Shapiro, J. (2007). Free/libre and open source software: Worldwide impact study. FLOSS World D31: Track 1 International Report.

    Google Scholar 

  • Deshpande, S., & Richardson, I. (2009) Management at the outsourcing destination-global software development in India. In Fourth IEEE International Conference on Global Software Engineering, 2009. ICGSE 2009 (pp. 217–225). Piscataway: IEEE.

    Google Scholar 

  • Dias, L. C., & Clímaco, J. N. (1999). On computing ELECTRE’s credibility indices under partial information. Journal of Multi-Criteria Decision Analysis, 8(2), 74–92.

    Article  Google Scholar 

  • Dias, L. C., & Clímaco, J. N. (2000). ELECTRE TRI for groups with imprecise information on parameter values. Group Decision and Negotiation, 9(5), 355–377.

    Article  Google Scholar 

  • Dias, L. C., Mousseau, V., Figueira, J., & Clímaco, J. N. (2002). An aggregation/disaggregation approach to obtain robust conclusions with ELECTRE TRI. European Journal of Operational Research, 138(2), 332–348.

    Article  Google Scholar 

  • Driskell, J. E., Goodwin, G. F., Salas, E., & O’Shea, P. G. (2006). What makes a good team player? Personality and team effectiveness. Group Dynamics: Theory, Research, and Practice, 10(4), 249.

    Article  Google Scholar 

  • Fitzgerald, B. (2006). The transformation of open source software. MIS Quarterly, 30(3), 587–598.

    Article  Google Scholar 

  • Gilson, L. L., Maynard, M. T., Young, N. C. J., Vartiainen, M., & Hakonen, M. (2015). Virtual teams research: 10 years, 10 themes, and 10 opportunities. Journal of Management, 41(5), 1313–1337.

    Article  Google Scholar 

  • Gosling, S. D., Rentfrow, P. J., & Swann, W. B. Jr. (2003). A very brief measure of the big-five personality domains. Journal of Research in Personality, 37(6), 504–528.

    Article  Google Scholar 

  • Grant, R. M. (1996). Toward a knowledge-based theory of the firm. Strategic Management Journal, 17, 109–122.

    Article  Google Scholar 

  • Guimera, R., Uzzi, B., Spiro, J., & Amaral, L. A. N. (2005). Team assembly mechanisms determine collaboration network structure and team performance. Science, 308(5722), 697–702.

    Article  Google Scholar 

  • Hess, C., & Ostrom, E. (2006). Introduction: An overview of the knowledge commons. In C. Hess & E. Ostrom (Eds.), Understanding knowledge as a commons. From theory to practice (pp. 3–26). Cambridge: MIT Press.

    Chapter  Google Scholar 

  • IEEE Spectrum. (2016). The 2016 top programming languages. Available from: http://spectrum.ieee.org/computing/software/the-2016-top-programming-languages

    Google Scholar 

  • Ihaka, R., & Gentleman, R. (1996). R: A language for data analysis and graphics. Journal of Computational and Graphical Statistics, 5(3), 299–314.

    Google Scholar 

  • Introduction to R. (2018) . https://www.datacamp.com/courses/free-introduction-to-r. Accessed March 15 2018.

  • Jarvenpaa, S. L., Knoll, K., & Leidner, D. E. (1998). Is anybody out there? Antecedents of trust in global virtual teams. Journal of Management Information Systems, 14(4), 29–64.

    Article  Google Scholar 

  • Katsikopoulos, K. V., Durbach, I. N., & Stewart, T. J. (2017). When should we use simple decision models? A synthesis of various research strands. Omega, 81, 17–25.

    Article  Google Scholar 

  • Kayworth, T. R., & Leidner, D. E. (2002). Leadership effectiveness in global virtual teams. Journal of Management Information Systems, 18(3), 7–40.

    Article  Google Scholar 

  • Keeney, R. L., & Raiffa, H. (1976). Decisions with multiple objectives: Preferences and value tradeoffs. New York: Wiley.

    Google Scholar 

  • Kimmelmann, N. (2013). Career in open source? Relevant competencies for successful open source developers. IT–Information Technology, 55(5), 204–212.

    Google Scholar 

  • Kogut, B., & Zander, U. (1992). Knowledge of the firm, combinative capabilities, and the replication of technology. Organization Science, 3(3), 383–397.

    Article  Google Scholar 

  • Kudaravalli, S., Faraj, S., & Johnson, S. L. (2017). A configural approach to coordinating expertise in software development teams. MIS Quarterly, 41(1), 43–64.

    Article  Google Scholar 

  • Leroy, A., Mousseau, V.., & Pirlot, M. (2011). Learning the parameters of a multiple criteria sorting method. In R. Brafman, F. Roberts, & A. Tsoukiàs (Eds.), Algorithmic decision theory (vol. 6992, pp. 219–233). Berlin: Springer.

    Chapter  Google Scholar 

  • Locander, W.B., Albert Napier, H., & Scamell, R. W. (1979). A team approach to managing the development of a decision support system. MIS Quarterly, 3, 53–63.

    Article  Google Scholar 

  • Malinowski, J., Weitzel, T., & Keim, T. (2008). Decision support for team staffing: An automated relational recommendation approach. Decision Support Systems, 45(3), 429–447.

    Article  Google Scholar 

  • Mc Crae, R.R., & Costa, P. T. (1989). Reinterpreting the Myers-Briggs type indicator from the perspective of the five-factor model of personality. Journal of Personality, 57(1), 17–40.

    Article  Google Scholar 

  • Meyer, P., & Olteanu, A.-L. (2017). Integrating large positive and negative performance differences into multicriteria majority-rule sorting models. Computers & Operations Research, 81, 216–230.

    Article  Google Scholar 

  • Miller, G. A. (1956). The magical number seven, plus or minus two: Some limits on our capacity for processing information. The Psychological Review, 63(2), 81–97.

    Article  Google Scholar 

  • Moreno-León, J., Robles, G., & Román-González, M. (2016). Examining the relationship between socialization and improved software development skills in the scratch code learning environment. Journal of Universal Computer Science, 22(12), 1533–1557.

    Google Scholar 

  • Mousseau, V., Dias, L. C., & Figueira, J. (2006). Dealing with inconsistent judgments in multiple criteria sorting models. 4OR, 4(3), 145–158.

    Article  Google Scholar 

  • Mousseau, V., Dias, L. C., Figueira, J., Gomes, C., & Clímaco, J. N. (2003) Resolving inconsistencies among constraints on the parameters of an MCDA model. European Journal of Operational Research, 147(1), 72–93.

    Article  Google Scholar 

  • Mousseau, V., Figueira, J.., & Naux, J. P. (2001). Using assignment examples to infer weights for ELECTRE TRI method: Some experimental results. European Journal of Operational Research, 130(2), 263–275.

    Article  Google Scholar 

  • Mousseau, V., & Słowiński, R. (1998). Inferring an ELECTRE TRI model from assignment examples. Journal of Global Optimization, 12(2), 157–174.

    Article  Google Scholar 

  • Myers, I. B., McCaulley, M. H., & Most, R. (1985). Manual: A guide to the development and use of the Myers-Briggs Type Indicator (vol. 1985). Palo Alto: Consulting Psychologists Press.

    Google Scholar 

  • Myers, M. D. (1997). Qualitative research in information systems. Management Information Systems Quarterly, 21(2), 241–242.

    Article  Google Scholar 

  • Nafus, D. (2012). ‘Patches don’t have gender’: What is not open in open source software. New Media & Society, 14(4), 669–683.

    Article  Google Scholar 

  • Ngo The, A., & Mousseau, V. (2002). Using assignment examples to infer category limits for the ELECTRE TRI method. Journal of Multi-Criteria Decision Analysis, 11(1), 29–43.

    Article  Google Scholar 

  • Noll, J., Beecham, S., Richardson, I., & Canna, C. N. (2016). A global teaming model for global software development governance: A case study. In 2016 IEEE 11th International Conference on Global Software Engineering (ICGSE) (pp. 179–188). Piscataway: IEEE.

    Chapter  Google Scholar 

  • Olteanu, A.-L., & Meyer, P. (2014). Inferring the parameters of a majority rule sorting model with vetoes on large datasets. In DA2PL 2014: From Multicriteria Decision Aid to Preference Learning (pp. 87–94).

    Google Scholar 

  • Rammstedt, B., & John, O. P. (2007). Measuring personality in one minute or less: A 10-item short version of the big five inventory in English and German. Journal of Research in Personality, 41(1), 203–212 (2007)

    Article  Google Scholar 

  • Reagle, J. (2012). “Free as in sexist?” Free culture and the gender gap. First Monday, 18(1), 2012.

    Google Scholar 

  • Roy, B. (1991). The outranking approach and the foundations of ELECTRE methods. Theory and Decision, 31, 49–73.

    Article  Google Scholar 

  • Roy, B. (1996). Multicriteria methodology for decision aiding. Dordrecht: Kluwer Academic.

    Book  Google Scholar 

  • Ryan, A. M., Wiechmann, D., & Hemingway, M. (2003). Designing and implementing global staffing systems: Part II - best practices. Human Resource Management, 42(1), 85–94.

    Article  Google Scholar 

  • Sarker, S., Ahuja, M., Sarker, S., & Kirkeby, S. (2011). The role of communication and trust in global virtual teams: A social network perspective. Journal of Management Information Systems, 28(1), 273–310.

    Article  Google Scholar 

  • Scacchi, W. (2007). Free/open source software development: Recent research results and methods. Advances in Computers, 69, 243–295.

    Article  Google Scholar 

  • Simon, H. A. (1976). Administrative behavior; a study of decision-making processes in administrative organization-3. New York: The Free Press.

    Google Scholar 

  • Sobrie, O., Mousseau, V., & Pirlot, M. (2013). Learning a majority rule model from large sets of assignment examples. In International Conference on Algorithmic Decision Theory ADT. Lecture notes in computer science (vol. 8176, pp. 336–350). Berlin: Springer.

    Chapter  Google Scholar 

  • Stewart, G. L. (2006). A meta-analytic review of relationships between team design features and team performance. Journal of Management, 32(1), 29–55.

    Article  Google Scholar 

  • Stol, K.-J., Babar, M. A., Avgeriou, P., & Fitzgerald, B. (2011). A comparative study of challenges in integrating open source software and inner source software. Information and Software Technology, 53(12), 1319–1336.

    Article  Google Scholar 

  • Stol, K.-J., & Fitzgerald, B. (2014). Two’s company, three’s a crowd: A case study of crowdsourcing software development. In Proceedings of the 36th International Conference on Software Engineering, ICSE 2014 (pp. 187–198). New York: ACM.

    Chapter  Google Scholar 

  • Teece, D. J., Pisano, G., & Shuen, A. () Dynamic capabilities and strategic management. Strategic Management Journal, 18(7), 509–533.

    Article  Google Scholar 

  • Tsoukiàs, A. (2007). On the concept of decision aiding process: An operational perspective. Annals of Operations Research, 154(1), 3–27.

    Article  Google Scholar 

  • Turner, J. R., & Müller, R. (2003). On the nature of the project as a temporary organization. International Journal of Project Management, 21(1), 1–8.

    Article  Google Scholar 

  • Varni, G., Volpe, G., & Camurri, A. (2010). A system for real-time multimodal analysis of nonverbal affective social interaction in user-centric media. IEEE Transactions on Multimedia, 12(6), 576–590.

    Article  Google Scholar 

  • Venables, B., Smith, D., Gentleman, R., & Ihaka, R. (1998). Notes on R: A programming environment for data analysis and graphics. Auckland: University of Auckland.

    Google Scholar 

  • Wageman, R. (2001). How leaders foster self-managing team effectiveness: Design choices versus hands-on coaching. Organization Science, 12(5), 559–577.

    Google Scholar 

  • Wingreen, S. C., Blanton, J. E., Newton, S. K., & Domino, M. (2005). Assessing the IT training and development climate: An application of the Q-methodology. In Proceedings of the 2005 ACM SIGMIS CPR Conference on Computer Personnel Research (pp. 12–23). New York: ACM.

    Chapter  Google Scholar 

  • Wuchty, S., Jones, B., & Uzzi, B. (2007). The increasing dominance of teams in the production of knowledge. Science, 316, 1036–1039.

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported, in part, by Science Foundation Ireland grants 10/CE/I1855 and 13/RC/2094 to Lero—the Irish Software Research Centre (www.lero.ie).

We would like to thank the six FLOSS community managers who participated in this research and Pr. Mathieu Simonnet, who provided input on the modeling of psychological traits.

Author information

Authors and Affiliations

  1. Lero - The Irish Software Engineering Research Centre, University of Limerick, Limerick, Ireland

    Ann Barcomb

  2. IMT Atlantique, LEGO-M@rsouin, University of Bretagne Loire, Brest, France

    Nicolas Jullien

  3. IMT Atlantique, Lab-STICC, University of Bretagne Loire, Brest, France

    Patrick Meyer

  4. Lab-STICC, CNRS, Université de Bretagne Sud, Lorient, France

    Alexandru-Liviu Olteanu

Authors
  1. Ann Barcomb
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nicolas Jullien
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Patrick Meyer
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Alexandru-Liviu Olteanu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ann Barcomb .

Editor information

Editors and Affiliations

  1. Logistics Management Department, Helmut-Schmidt-University/University of the Federal Armed Forces Hamburg, Hamburg, Germany

    Sandra Huber

  2. Logistics Management Department, Helmut-Schmidt-University/University of the Federal Armed Forces Hamburg, Hamburg, Germany

    Martin Josef Geiger

  3. Universidade Federal de Pernambuco, Recife, Pernambuco, Brazil

    Adiel Teixeira de Almeida

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Barcomb, A., Jullien, N., Meyer, P., Olteanu, AL. (2019). Integrating Managerial Preferences into the Qualitative Multi-Criteria Evaluation of Team Members. In: Huber, S., Geiger, M., de Almeida, A. (eds) Multiple Criteria Decision Making and Aiding. International Series in Operations Research & Management Science, vol 274. Springer, Cham. https://doi.org/10.1007/978-3-319-99304-1_4

Download citation

Publish with us

Policies and ethics

Search

Navigation