Skip to main content
SpringerLink
Log in

International Comparison of a Performance-Based Assessment in Higher Education

  • Chapter
  • First Online:
Assessment of Learning Outcomes in Higher Education

Part of the book series: Methodology of Educational Measurement and Assessment ((MEMA))

Abstract

In late 2012, the Italian National Agency for the Evaluation of the University and Research Systems (ANVUR) and the Council for Aid to Education (CAE) collaborated on two experimental studies of an assessment of generic learning outcomes of tertiary students. The instrument (CLA+ International/TECO) was administered to students graduating from Italian universities. Their results and outcomes were benchmarked against graduating university students in the United States. This chapter presents results from the two studies and discusses implications and future investigations and demonstrates the feasibility of internationally assessing generic learning outcomes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Please visit http://cae.org/images/uploads/pdf/CLA_Practice_Assessment.pdf for a sample assessment.

  2. 2.

    Please see http://cae.org/images/uploads/pdf/CLA_Plus_Scoring_Rubric.pdf for the CLA+ scoring rubric.

References

  • ANVUR. (2014). Assessing the generic competencies aquired by students graduating from Italian universities. Retrieved from Rome, Italy.

    Google Scholar 

  • Benjamin, R., Klein, S., Steedle, J. T., Zahner, D., Elliot, S., & Patterson, J. A. (2012). The case for generic skills and performance assessment in the United States and international settings. CAE – Occasional Paper. Retrieved from http://www.collegiatelearningassessment.org/files/The_Case_for_Generic_Skills_and_Performance_Assessment_in_the_United_States_and_International_Settings.pdf

  • Blömeke, S., Zlatkin-Troitschanskaia, O., Kuhn, C., & Fege, J. (2013). Modeling and measuring competencies in higher education. Rotterdam: Springer.

    Book  Google Scholar 

  • Geisinger, K. F. (1994). Cross-cultural normative assessment: Translation and adaptation issues influencing the normative interpretation of assessment instruments. Psychological Assessment, 6(4), 304.

    Article  Google Scholar 

  • Gick, M. L., & Holyoak, K. J. (1980). Analogical problem solving. Cognitive Psychology, 12(3), 306–355.

    Article  Google Scholar 

  • Gick, M. L., & Holyoak, K. J. (1983). Schema induction and analogical transfer. Cognitive Psychology, 15(1), 1–38.

    Article  Google Scholar 

  • Hambleton, R. K. (Ed.). (2004). Adapting educational and psychological tests for cross-cultural assessment. Psychology Press.

    Google Scholar 

  • Hart Research Associates. (2006). How should colleges prepare students to succeed in today’s global economy? – Based on surveys among employers and recent college graduates. Retrieved from Washington, DC.

    Google Scholar 

  • Kahl, S. (2008). The assessment of 21st century skills: Something old, something new, something borrowed. Paper presented at the Council of Chief State School Officers 38th National conference on Student Assessment, Orlando, FL.

    Google Scholar 

  • Klein, S., Zahner, D., Benjamin, R., Bolus, R., & Steedle, J. T. (2013). Observations on AHELO’s generic skills strand methodology and findings. New York: Council for Aid to Education.

    Google Scholar 

  • Levy, F., & Murname, R. J. (2004). Education and the changing job market: An education centered on complex thinking and communicating is a graduate’s passport to prosperity. Educational Leadership, 62(2), 80–83.

    Google Scholar 

  • OECD. (2011). AHELO feasibility study progress report. Retrieved from Paris, France.

    Google Scholar 

  • OECD. (2012a). AHELO feasibility study report. Retrieved from Paris, France.

    Google Scholar 

  • OECD. (2012b). AHELO feasibility study report. Retrieved from Paris, France.

    Google Scholar 

  • OECD. (2012c). Assessment of higher education learning outcomes. Feasibility study report. Volume1 – Design and implementation. Retrieved from http://oecd.org/edu/skills-beyond-school/AHELOFSReportVolume1.pdf

  • OECD. (2013a). Assessment of higher education learning outcomes. Feasibility study report. Volume3 – Further insights. Retrieved from http://www.oecd.org/edu/skills-beyond-school/AHELOFSReportVolume3.pdf

  • OECD. (2013b). OECD skills outlook 2013: First results from the Survey of Adult Skills. Retrieved from Paris, France.

    Google Scholar 

  • OECD. (2016). PISA FAQ. Retrieved from https://www.oecd.org/pisa/aboutpisa/pisafaq.htm

  • Penfield, R. D., & Lam, T. C. M. (2000). Assessing differential item functioning in performance assessment: Review and recommendations. Educational Measurement: Issues and Practice, 19, 5–15.

    Article  Google Scholar 

  • Steedle, J. T., & Bradley, M. (2012). Majors matter: Differential performance on a test of general college outcomes. Paper presented at the Annual Meeting of the American Educational Research Association, Vancouver, Canada.

    Google Scholar 

  • Wolf, R., & Zahner, D. (2015). Mitigation of test bias in international, cross-cultural assessments of higher-order thinking skills. In Y. Rosen, S. Ferrara, & M. Mosharraf (Eds.), Handbook of research on technology tools for real-world skill development. Hershey: IGI Global.

    Google Scholar 

  • Wolf, R., Zahner, D., & Benjamin, R. (2015). Methodological challenges in international comparative post-secondary assessment programs: Lessons learned and the road ahead. Studies in Higher Education, 1–11. https://doi.org/10.1080/03075079.2015.1004239

  • Wollack, J. A. (1997). A nominal response model approach to detect answer copying. Applied Psychological Measurement, 21, 307–320.

    Article  Google Scholar 

  • Zahner, D. (2014). CLA+ standard setting study final report. Retrieved from New York, NY. http://cae.org/images/uploads/pdf/cla_ss.pdf

  • Zahner, D., & James, J. K. (2016). Predictive validity of a critical thinking assessment of post-college outcomes. Paper presented at the American Educational Research Association, Washington, DC.

    Google Scholar 

  • Zahner, D., & Steedle, J. T. (2014). Evaluating performance task scoring comparability in an international testing program. Paper presented at the American Educational Research Association, Philadelphia, PA.

    Google Scholar 

  • Zucker, S., Sassman, C., & Case, B. J. (2004). Cognitive labs. San Antonio, TX: Harcourt Assessment. Retrieved, 10(11), 2006.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Council for Aid to Education (CAE), New York, NY, USA

    Doris Zahner

  2. Agency for the Evaluation of Universities and Research Institutes (ANVUR), Rome, Italy

    Alberto Ciolfi

Authors
  1. Doris Zahner
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alberto Ciolfi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Doris Zahner .

Editor information

Editors and Affiliations

  1. Johannes Gutenberg University, Mainz, Germany

    Olga Zlatkin-Troitschanskaia

  2. Johannes Gutenberg University, Mainz, Germany

    Miriam Toepper

  3. Humboldt-Universität zu Berlin, Berlin, Germany

    Hans Anand Pant

  4. Humboldt-Universität zu Berlin, Berlin, Germany

    Corinna Lautenbach

  5. Johannes Gutenberg University, Mainz, Germany

    Christiane Kuhn

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Zahner, D., Ciolfi, A. (2018). International Comparison of a Performance-Based Assessment in Higher Education. In: Zlatkin-Troitschanskaia, O., Toepper, M., Pant, H., Lautenbach, C., Kuhn, C. (eds) Assessment of Learning Outcomes in Higher Education. Methodology of Educational Measurement and Assessment. Springer, Cham. https://doi.org/10.1007/978-3-319-74338-7_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-74338-7_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-74337-0

  • Online ISBN: 978-3-319-74338-7

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics

Search

Navigation