Advertisement

Performance-Based Tests: Using Role Plays to Assess Communication Skills

  • Edith BraunEmail author
  • Ulrike Schwabe
  • Daniel Klein
Reference work entry

Abstract

Modelling and job-related assessment of vocational competences has been traditionally a major aspect for vocational education and training (VET) in order to adequately define and train necessary competences in the context of a dynamic, ever-changing occupational world, as the “ASCOT” research initiative has demonstrated. Similarly, one of the main objectives of higher education (HE) consists in preparing students for the demands of the labor market. This implies that not only discipline-specific competences and expert knowledge need to be acquired during studies but also more generic competences like communication skills. In order to be able to assess such generic learning outcomes of HE, performance-based test instruments are required.

Within this chapter, a conceptual framework as well as the method of such a performance-based test of students’ communication skills will be presented. In vivo role plays are used in order to assess the relevant communication skills, respectively. Using Habermas’ (1981) theory of communicative action, the conceptual elements corresponding with the two distinct types of communicative action, which are strategic and understanding-oriented communication, have been extracted. Furthermore, empirical results concerning the relation between discipline-specific competences of economics and observed performance of communication skills will be reported. The data were collected from a sample of nearly 500 students from ten different HE institutions within Germany.

The discussion will firstly address the application for assessment practice in HE as well as the potential limitations of the test; and secondly possible synergy effects between HE and VET assessment practices will be reflected.

Keywords

Communication skills Generic skills Ever-changing occupational world Performance in complex situations Transfer between VET and HE 

References

  1. AK DQR (2011) The Germans qualification framework for lifelong learning. https://www.dqr.de/media/content/The_German_Qualifications_Framework_for_Lifelong_Learning.pdf. Accessed 28 Oct 2017
  2. Baethge M, Winther E (2015) ASCOT Kompetenzmessung in der Berufsbildung – Ansatz, Ergebnisse und Perspektiven der BMBF Forschungsinitiative. http://ascot-vet.net/_media/1_ASCOT_Impulsvortrag_Winther_Baethge.pdf. Accessed 28 Oct 2017
  3. Beard RL, Salas E, Prince C (1995) Enhancing transfer of training: using role-play to foster teamwork in the cockpit. Int J Aviat Psychol 5:131–143CrossRefGoogle Scholar
  4. Blömeke S, Zlatkin-Troitschanskaia O, Kuhn C, Fege J (eds) (2013) Modeling and measuring competencies in higher education: tasks and challenges. Sense Publishers, RotterdamGoogle Scholar
  5. Blömeke S, Gustafson J-E, Shavelson R (2015) Beyond dichotomies: competence viewed as a continuum. Z Psychol 223:3–13Google Scholar
  6. Bologna Declaration (1999) Der Europäische Hochschulraum. Gemeinsame Erklärung der Europäischen Bildungsminister, Bologna, 19 Juni 1999. http://uniko.ac.at/modules/download.php?key=2708_DE_O&cs=2C55. Accessed 28 Oct 2017
  7. Braun E, Mishra Sh (2016) Which tool for what assessment? In: Huisman J, Tight M (eds) Theory and method in higher education research. Emerald Group, Bingley, pp 47–68CrossRefGoogle Scholar
  8. Braun E, Brachem J-C (2017) The labour market’s requirement profiles for higher education graduates. In: Kyndt E, Donche V, Trigwell K, Lindblom-Ylänne S (eds) Higher education transitions: theory and research. Routledge, Abingdon, pp 219–237CrossRefGoogle Scholar
  9. Braun E, Schwabe U, Klein D (in revision) Kompetenzorientierte Prüfung kommunikativer Fähigkeiten von Studierenden: Vorstellung eines Messinstruments. DiagnosticaGoogle Scholar
  10. Braun E, Athanassiou G, Pollerhof K, Schwabe U (2018) Wie lassen sich kommunikative Kompetenzen messen? – Konzeption einer kompetenzorientierten Prüfung kommunikativer Fähigkeiten von Studierenden. Beiträge zur Hochschulforschung 40:34–55Google Scholar
  11. Chan RY, Brown GTL, Ludlow LH (2014) What is the purpose of higher education? A comparison of institutional and student perspectives on the goals and purposes of completing a bachelor’s degree in the 21st century. The American Education Research Association (AERA) annual conference, PhiladelphiaGoogle Scholar
  12. Dietzen A, Monnier M, Tschöpe T (2012) Soziale Kompetenzen von medizinischen Fachangestellten messen. Entwicklung eines Verfahrens im Projekt CosMed. Berufsbild Wiss Prax 6:24–28Google Scholar
  13. Dietzen A, Monnier M, Srebny C, Tschöpe T (2015) Soziale Kompetenz Medizinischer Fachangestellter: Was genau ist das und wie kann man sie messen? bwp@ Spezial 10 – Berufsbildung im Gesudheitsbereich 10:1–18Google Scholar
  14. Dublin Descriptors (2004) Shared ‘Dublin’ descriptors for short cycle, first cycle, second cycle and third cycle awards. Working Document on JQI Meeting in Dublin. https://www.uni-due.de/imperia/md/content/bologna/dublin_descriptors.pdf. Accessed 28 Oct 2017
  15. Embretson SE, Reise SP (2013) Item response theory for psychologists. Psychology Press, LondonCrossRefGoogle Scholar
  16. Enders J, De Boer H, File J, Jongbloed B, Westerheijden D (2011) Reform of higher education in Europe In: Enders J, De Boer H, Westerheijden DF (eds) Reform of higher education in Europe. Sense Publichers: Rotterdam. pp 1–10CrossRefGoogle Scholar
  17. European Union (2000) Lisbon strategy. http://www.europarl.europa.eu/summits/lis1_de.htm. Accessed 28 Oct 2017
  18. European Commission (2011) Supporting growth and jobs- an agenda for the modernisation of Europe’s higher education systems. European Commission, BrusselsGoogle Scholar
  19. Gehmlich V (2007) Qualifikationsrahmen Betriebswirtschaftslehre, Bologna Reader II, Neue Texte und Hilfestellungen zur Umsetzung des Bologna Prozesses an deutschen Hochschulen. http://www.hrk.de/fileadmin/redaktion/hrk/02-Dokumente/02-10-Publikationsdatenbank/Beitr-2007-05_Bologna_Reader_II.pdf. Accessed 28 Oct 2017
  20. Habermas J (1981) Theorie des kommunikativen Handelns, Band 1 Handlungsrationalität und gesellschaftliche Rationalisierung. Suhrkamp, Frankfurt/MainGoogle Scholar
  21. Harendza S, Kadmon M, Berberat P (2016) ÄKHOM – Ärztliche Kompetenzen: Hamburg-Oldenburg-München. In: Zlatkin-Troitschanskaia O, Pant HA, Lautenbach C, Toepper M (eds) Kompetenzmodelle und Instrumente der Kompetenzerfassung im Hochschulsektor – Validierungen und methodische Innovationen (KoKoHs): Übersicht der Forschungsprojekte. KoKoHs Working Papers 10:56–59. https://www.kompetenzen-im-hochschulsektor.de/files/2018/05/WP10_final_032016.pdf. Accessed 28 Oct 2017
  22. Kultusministerkonferenz (2017) Qualifikationsrahmen für Deutsche Hochschulabschlüsse. (Im Zusammenwirken von Hochschulrektorenkonferenz, Kultusministerkonferenz und Bundesministerium für Bildung und Forschung). https://www.hrk.de/fileadmin/redaktion/hrk/02-Dokumente/02-03-Studium/02-03-02-Qualifikationsrahmen/2017_Qualifikationsrahmen_HQR.pdf. Accessed 28 Oct 2017
  23. Lauterbach O (2015) Erfassung wirtschaftswissenschaftlicher Fachkompetenzen von Studierenden in Startkohorte 5 des Nationalen Bildungspanels – Technischer Bericht (NEPS Working Paper No. 51). Bamberg: Leibniz-Institut für Bildungsverläufe, Nationales Bildungspanel. https://www.neps-data.de/Portals/0/Working%20Papers/WP_LI.pdf. Accessed 28 Oct 2017
  24. Masten AS, Coatsworth JD (1998) The development of competence in favorable and unfavorable environments. Am Psychol 53(2):205–220CrossRefGoogle Scholar
  25. OECD (2013) OECD skills outlook 2013. First results from the survey of adult skills. OECD Publishing, ParisCrossRefGoogle Scholar
  26. OECD (2017) Education at a glance 2017. OECD indicators. OECD Publishing, ParisCrossRefGoogle Scholar
  27. Prenzel M, Gogolin I, Krüger H-H (eds) (2007) Kompetenzdiagnostik. VS Verlag, WiesbadenGoogle Scholar
  28. Van Ments M (1999) The effective use of role-play: practical techniques for improving learning. Kogan Page, LondonGoogle Scholar
  29. Westerheijden DF, Stensaker B, Rosa MJ (eds) (2007) Quality assurance in higher education: trends in regulation, translation and transformation. Springer, DordrechtGoogle Scholar
  30. Winther E (2010) Kompetenzmessung in der beruflichen Bildung. Bertelsmann, BielefeldGoogle Scholar
  31. Winther E, Seeber S, Wuttke E (eds) (2016) Kompetenzmodell in der beruflichen Bildung. Themenh Unterrichtswissenschaft 44:106–203Google Scholar
  32. Wissenschaftsrat (2015) Empfehlungen zum Verhältnis von Hochschulbildung und Arbeitsmarkt, Bielefeld, Drs. 4925-15Google Scholar
  33. Zlatkin-Troitschanskaia O, Pant HA (eds) (2016) Valid assessment of student competencies in higher education – challenges, methodological innovations, and perspectives for educational measurement. Special Issue in J Educ Meas 53:251–440Google Scholar
  34. Zlatkin-Troitschanskaia O, Shavelson R, Kuhn C (2015) The international state of research on measurement of competency in higher education. Stud High Educ 40:393–411CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Teaching and Learning in Higher EducationJustus-Liebig UniversitaetGiessenGermany
  2. 2.Research Area Educational Careers and Graduate EmploymentGerman Centre for Higher Education Research and Science Studies (DZHW)HannoverGermany
  3. 3.International Centre for Higher Education Research Kassel (INCHER-Kassel)Kassel UniversityKasselGermany

Section editors and affiliations

  • Esther Winther
    • 1
  1. 1.Vocational Education and TrainingUniversity of Duisburg-EssenDuisburgGermany

Personalised recommendations