Advertisement

Portuguese university students’ conceptions of assessment: taking responsibility for achievement

  • Maria Assunção FloresEmail author
  • Gavin Brown
  • Diana Pereira
  • Clara Coutinho
  • Patrícia Santos
  • Cláudia Pinheiro
Article

Abstract

After 20 years of the Bologna Declaration, Portuguese universities claim to be implementing student-centred and involved assessment practices. Student conceptions of assessment matter when innovations and reforms in assessment practices are being implemented. This study is part of a larger research project entitled “Assessment in higher education: the potential of alternative methods” funded by the Portuguese Foundation for Science and Technology (Government Funding Agency) (PTDC/MHCCED/2703/2014). This paper surveys a large sample (N = 5549) of Portuguese students in five public universities with a Portuguese version of the Students Conceptions of Assessment (SCoA-VI) inventory, previously validated in Brazil. Confirmatory factor analysis recovered the eight SCoA factors reported in the Brazilian context. Differences in mean score for the eight factors were trivial for institutional and student factors. Overall, students agreed that assessment for student improvement was not ignored. Scale inter-correlations revealed interesting inverse relations between improvement and irrelevance functions.

Keywords

Conceptions of assessment Higher education Students’ conceptions Improvement Accountability 

Notes

Acknowledgements

Statistical assistance was provided by Anran Zhao, a doctoral candidate at The University of Auckland, with funding from the Faculty of Education and Social Work.

Funding information

The project reported in this paper was funded by the Portuguese Foundation for Science and Technology (Government Funding Agency) (PTDC/MHCCED/2703/2014) and co-financed by European Regional Development Funds (FEDER), Competitiveness and Internationalization Operational Program (POCI-01-0145-FEDER-007562).

References

  1. Barreira, C., Bidarra, G., Monteiro, F., Vaz-Rebelo, P., & Alferes, V. (2017). Avaliação das aprendizagens no ensino superior. Perceções de professores e estudantes nas universidades portuguesas [Assessment in higher education: perceptions of university teachers and students in Portuguese universities]. Revista Iberoamericana de Educación Superior, 8(21), 24–36.Google Scholar
  2. Biggs, J. (2003). Teaching for quality learning at university. Buckingham: SHRE and Open University Press.Google Scholar
  3. Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7–74.Google Scholar
  4. Bollen, K. A. (1989). Structural equations with latent variables. New York: Wiley.Google Scholar
  5. Boud, D. (1995). Assessment and learning: contradictory or complementary? In P. Knight (Ed.), Assessment for learning in higher education (pp. 35–48). London: Kogan Page.Google Scholar
  6. Boud, D., & Falchikov, N. (2007). Rethinking assessment in higher education: learning for the long term. New York: Routledge.Google Scholar
  7. Brown, G. T. L. (2008). Students’ conceptions of assessment inventory (SCoA Version VI) [Measurement instrument]. Auckland: University of Auckland.  https://doi.org/10.17608/k6.auckland.4596820.v1.Google Scholar
  8. Brown, G. T. L. (2011). Self-regulation of assessment beliefs and attitudes: a review of the students’ conceptions of assessment inventory. Educational Psychologist, 31(6), 731–748.Google Scholar
  9. Brown, G. T. L. (2013). Student conceptions of assessment across cultural and contextual differences: university student perspectives of assessment from Brazil, China, Hong Kong, and New Zealand. In G. A. D. Liem & A. B. I. Bernardo (Eds.), Advancing cross-cultural perspectives on educational psychology: a festschrift for Dennis McInerney (pp. 143–167). Charlotte: Information Age Publishing.Google Scholar
  10. Brown, G. T. L., & Harris, L. R. (2012). Student conceptions of assessment by level of schooling: further evidence for ecological rationality in belief systems. Australian Journal of Educational and Developmental Psychology, 12, 46–59.Google Scholar
  11. Brown, G. T. L., & Hattie, J. A. (2012). The benefits of regular standardized assessment in childhood education: guiding improved instruction and learning. In S. Suggate & E. Reese (Eds.), Contemporary debates in childhood education and development (pp. 287–292). London: Routledge.Google Scholar
  12. Brown, G. T. L., & Hirschfeld, G. (2008). Students’ conceptions of assessment: links to outcomes. Assessment in Education: Principles, Policy & Practice, 15(1), 3–17.Google Scholar
  13. Brown, S., & Knight, P. (1994). Assessing learners in higher education. London: Kogan Page.Google Scholar
  14. Brown, G. T. L., & Walton, K. F. (2017). The effect of conceptions of assessment upon reading achievement: an evaluation of the influence of self-efficacy and interest. Interdisciplinary Education and Psychology, 1(103).  https://doi.org/10.31532/InterdiscipEducPsychol.1.1.003.
  15. Brown, G. T. L., & Wang, Z. (2013). Illustrating assessment: How Hong Kong university students conceive of the purposes of assessment. Studies in Higher Education, 38(7), 1037–1057.  https://doi.org/10.1080/03075079.2011.616955.Google Scholar
  16. Brown, G. T. L., & Wang, Z. (2016). Understanding university student conceptions of assessment: cultural similarities and jurisdictional differences between Hong Kong and China. Social Psychology of Education, 19, 151–173.Google Scholar
  17. Brown, G., Bull, J., & Pendlebury, M. (1997). Assessing student learning in higher education. London: Routledge.Google Scholar
  18. Brown, G. T. L., Irving, S. E., & Peterson, E. R. (2009a). The more I enjoy it the less I achieve: the negative impact of socio-emotional purposes of assessment and feedback on academic performance. Paper presented at EARLI 2009 biennial conference, Amsterdam, NL.Google Scholar
  19. Brown, G. T. L., Irving, S. E., Peterson, E. R., & Hirschfeld, G. H. F. (2009b). Use of interactive-informal assessment practices: New Zealand secondary students’ conceptions of assessment. Learning and Instruction, 19(2), 97–111.  https://doi.org/10.1016/j.learninstruc.2008.02.003.Google Scholar
  20. Brown, G. T. L., Peterson, E., & Irving, S. (2009c). Self-regulatory beliefs about assessment predict mathematics achievement. In D. M. McInerney, G. T. L. Brown, & G. A. D. Liem (Eds.), Students perspectives on assessment: what students can tell us about assessment for learning (pp. 159–186). Charlotte: Information Age.Google Scholar
  21. Brown, G. T. L., Pishghadam, R., & Shayesteh Sadafian, S. (2014). Iranian university students’ conceptions of assessment. Assessment Matters, 6, 5–33.Google Scholar
  22. Brown, G. T. L., Peterson, E. R., & Yao, E. S. (2016). Student conceptions of feedback: impact on self-regulation, self-efficacy, and academic achievement. British Journal of Educational Psychology, 86(4), 606–629.  https://doi.org/10.1111/bjep.12126.Google Scholar
  23. Brown, G. T. L., Harris, L. R., O'Quin, C., & Lane, K. E. (2017). Using multi-group confirmatory factor analysis to evaluate cross-cultural research: identifying and understanding non-invariance. International Journal of Research & Method in Education, 40(1), 66–90.  https://doi.org/10.1080/1743727X.2015.1070823.Google Scholar
  24. Burnham, K. P., & Anderson, D. R. (2004). Multimodel inference: understanding AIC and BIC in model selection. Sociological Methods & Research, 33(2), 261–304.  https://doi.org/10.1177/0049124104268644.Google Scholar
  25. Chen, J., & Brown, G. T. L. (2018). Chinese secondary school students' conceptions of assessment and achievement emotions: endorsed purposes lead to positive and negative feelings. Asia Pacific Journal of Education, 38(1), 91–109.  https://doi.org/10.1080/02188791.2018.1423951.Google Scholar
  26. Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159.Google Scholar
  27. De Oliveira, J., & Flores, M. A. (2017). Conceções e práticas avaliativas no Ensino Superior: aprendendo com os alunos [Conceptions and practices of assessment in Higher Education: learning with students]. In M. A. Flores, M. P. Alves, E. A. Machado, & S. Fernandes (Orgs.), Atas do I Congresso Internacional sobre Avaliação das Aprendizagens e Sucesso Escolar (pp. 9–14). Braga: Centro de Investigação em Estudos da Criança (CIEC). ISBN 978-972-8952-45-7.Google Scholar
  28. Decree-Law n° 42/2005. (2005). Ministry of Science, Innovation and higher education. Google Scholar
  29. DiStefano, C., Zhu, M., & Mîndrilă, D. (2009). Understanding and using factor scores: considerations for the applied researcher. Practical Assessment, Research & Evaluation, 14(20) http://pareonline.net/getvn.asp?v=14&n=20.
  30. Dochy, F., & McDowell, L. (1997). Assessment as a tool for learning. Studies in Educational Evaluation, 23(4), 279–298.Google Scholar
  31. European Commission, Directorate General Education and Culture. (2006). The extent and impact of higher education curricular reform across Europe: final report to the Directorate-General for Education and Culture of the European Commission.Google Scholar
  32. Fan, X., & Sivo, S. A. (2007). Sensitivity of fit indices to model misspecification and model types. Multivariate Behavioral Research, 42(3), 509–529.  https://doi.org/10.1080/00273170701382864.Google Scholar
  33. Fernandes, D. (2009). Educational assessment in Portugal. Assessment in education: Principles, Policy & Practice, 16(2), 227–247.Google Scholar
  34. Fernandes, D. (2014). Práticas de ensino e de avaliação de docentes de quatro universidades portuguesas [Practices of teaching and assessment in four Portuguese universities]. In D. Fernandes, A. Borralho, C. Barreira, A. Monteiro, D. Catani, E. Cunha, & P. Alves (Eds.), Avaliação, ensino e aprendizagens em Portugal e no Brasil: realidades e perspectivas (pp. 97–135). Lisboa: Educa.Google Scholar
  35. Fernandes, D. (2015). Pesquisa de percepções e práticas de avaliação no ensino universitário português [Review of perceptions and practices of assessment in higher education]. Estudos em Avaliação Educacional, 26(63), 596–629.Google Scholar
  36. Fletcher, R., Meyer, L., Anderson, H., Johnston, P., & Rees, M. (2012). Faculty and students conceptions of assessment in higher education. Higher Education, 64(1), 119–133.Google Scholar
  37. Flores, M., Veiga Simão, M., Barros, A., & Pereira, D. (2015). Perceptions of effectiveness, fairness and feedback of assessment methods: a study in higher education. Studies in Higher Education, 40(9), 1523–1534.Google Scholar
  38. Gonçalves, R. (2012). Avaliação das Aprendizagens dos Estudantes de Enfermagem em Ensino Clínico: das concepções e práticas docentes à apresentação de propostas de intervenção [Assessing student learning in nursing in clinical teaching: from conceptions and practices to proposals of intervention] (Unpublished doctoral thesis). University of Coimbra, Coimbra, Portugal.Google Scholar
  39. Gulikers, J., Kester, L., Kirschner, P., & Bastiaens, T. (2008). The effect of practical experience on perceptions of assessment authenticity, study approach, and learning outcomes. Learning and Instruction, 18, 172–186.Google Scholar
  40. Hirschfeld, G. H. F., & Brown, G. T. L. (2009). Students’ conceptions of assessment: factorial and structural invariance of the SCoA across sex, age, and ethnicity. European Journal of Psychological Assessment, 25(1), 30–38.  https://doi.org/10.1027/1015-5759.25.1.30.Google Scholar
  41. IBM. (2017). AMOS (Version 25.0.0) [computer program]. Wexford: Amos Development Corporation.Google Scholar
  42. Landim, M. V., Matos, D. A. S., & Brown, G. T. L. (2015). A avaliação sob o ponto de vista dos estudantes: O uso de desenhos para a análise de concepções de avaliação [Assessment from the point of view of students. The use of drawing to analyse conceptions of assessment]. Psicologia, Educação e Cultura, 19(2), 55–74.Google Scholar
  43. Lipnevich, A. A., & Smith, J. K. (2009). The effects of feedback on student examination performance. Journal of Experimental Psychology: Applied, 15, 319–333.Google Scholar
  44. Marsh, H. W., Hau, K.-T., & Wen, Z. (2004). In search of golden rules: comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling, 11(3), 320–341.  https://doi.org/10.1207/s15328007sem1103_2.Google Scholar
  45. Matos, D. (2010). A avaliação no ensino superior: conceções múltiplas de estudantes Brasileiros [Assessment in higher education: multiple conceptions of Brazilian students] (Unpublised doctoral thesis). Universidade Federal de Minas Gerais, Brasil.Google Scholar
  46. Matos, D. A. S., & Brown, G. T. L. (2015). Comparing university student conceptions of assessment: Brazilian and New Zealand beliefs. In C. Carvalho & J. Conboy (Eds.), Feedback, identidade, trajetórias escolares: Dinâmicas e consequências (pp. 177–194). Lisbon: Universidade de Lisboa, Instituto de Educação.Google Scholar
  47. Matos, D., Cirino, S., & Brown, G. (2009). Students’ conceptions of assessment in higher education in Brazil. In D. M. McInerney, G. T. L. Brown, & G. A. D. Liem (Eds.), Student perspectives of assessment. What students can tell us about assessment for learning (pp. 235–253). North Carolina: Information age.Google Scholar
  48. Matos, D. A. S., Brown, G. T. L., & Cirino, S. D. (2012). Concepções de avaliação de alunos universitários: uma revisão da literatura [Conceptions of assessment of students in higher education: a literature review]. Estudos em Avaliação Educacional, São Paulo, 23(52), 204–231.Google Scholar
  49. Matos, D. A. S., Cirino, S. D., Brown, G. T. L., & Leite, W. L. (2013). A avaliação no ensino superior: Concepções múltiplas de estudantes Brasileiros [Assessment in higher education: Multiple conceptions of Brazilian students]. Estudos em Avaliação Educacional, 24(54), 172–193.  https://doi.org/10.18222/eae245420131907.Google Scholar
  50. Matos, D. A. S., Brown, G. T. L., & Gomes, C. (2019). Bifactor invariance analysis of student conceptions of assessment inventory. Psico-USF, 24(4).Google Scholar
  51. McMillan, J. H. (2016). Section discussion: student perceptions of assessment. In G. T. L. Brown & L. R. Harris (Eds.), Handbook of human and social conditions in assessment (pp. 221–243). New York: Routledge.Google Scholar
  52. Myers, C., & Myers, S. (2015). The use of learner-centered assessment practices in the United States: the influence of individual and institutional contexts. Studies in Higher Education, 40(10), 1904–1918.Google Scholar
  53. Novak, E., & Johnson, T. (2012). Assessment of students’ emotions in game-based learning. In D. Ifenthaler, D. Eseryel, & X. Ge (Eds.), Assessment in game-based learning: foundations, innovations, and perspectives (pp. 379–399). New York: Springer.Google Scholar
  54. Otunuku, M., Brown, G. T. L., & Airini. (2013). Tongan secondary students’ conceptions of schooling in New Zealand relative to their academic achievement. Asia Pacific Education Review, 14(3), 345–357.  https://doi.org/10.1007/s12564-013-9264-y.Google Scholar
  55. Panadero, E., Fraile, J., Fernández Ruiz, J., Castilla-Estévez, D., & Ruiz, M. A. (2018). Spanish university assessment practices: examination tradition with diversity by faculty. Assessment & Evaluation in Higher Education. Online first.  https://doi.org/10.1080/02602938.2018.1512553.
  56. Pereira, D. (2016). Assessment in higher education and quality of learning: perceptions, practices and implications (Unpublished doctoral thesis). University of Minho, Braga, Portugal.Google Scholar
  57. Pereira, D., Flores, M., & Niklasson, L. (2016a). Assessment revisited: a review of research in assessment and evaluation in higher education. Assessment & Evaluation in Higher Education, 41(7), 1008–1032.Google Scholar
  58. Pereira, D., Flores, M., Veiga Simão, A., & Barros, A. (2016b). Effectiveness and relevance of feedback in higher education: a study of undergraduate students. Studies in Educational Evaluation, 49, 7–14.Google Scholar
  59. Pereira, D., Flores, M., & Barros, A. (2017a). Perceptions of Portuguese undergraduate students about assessment: a study in five public universities. Educational Studies, 43, 442–463.Google Scholar
  60. Pereira, D., Niklasson, L., & Flores, M. A. (2017b). Students’ perceptions of assessment: a comparative analysis between Portugal and Sweden. Higher Education, 73(1), 153–173.Google Scholar
  61. Peterson, E., & Irving, E. (2008). Secondary school students’ conceptions of assessment and feedback. Learning and Instruction, 18, 238–250.Google Scholar
  62. Peterson, E. R., Brown, G. T. L., & Jun, M. C. (2015). Achievement emotions in higher education: a diary study exploring emotions across an assessment event. Contemporary Educational Psychology, 42(1), 82–96.  https://doi.org/10.1016/j.cedpsych.2015.05.002.Google Scholar
  63. Pitt, E., & Norton, L. (2017). Now that’s the feedback I want!’ Students’ reactions to feedback on graded work and what they do with it. Assessment & Evaluation in Higher Education, 41, 1–18.Google Scholar
  64. Race, P. (1995). What has assessment done for us - and to us? In P. Knight (Ed.), Assessment for learning in higher education (pp. 61–74). London: Kogan Page.Google Scholar
  65. Rieskamp, J., & Reimer, T. (2007). Ecological rationality. In R. F. Baumeister & K. D. Vohs (Eds.), Encyclopedia of social psychology (pp. 273–275). Thousand Oaks: Sage.Google Scholar
  66. Ryan, R., & Henderson, M. (2018). Feeling feedback: students’ emotional responses to educator feedback. Assessment & Evaluation in Higher Education, 43(6), 880–892.Google Scholar
  67. Segers, M., & Tillema, H. (2011). How Dutch secondary teachers and students conceive the purpose of assessment? Studies in Educational Evaluation, 37, 49–54.Google Scholar
  68. Solomonidou, G., & Michaelides, M. (2017). Students’ conceptions of assessment purposes in a low stakes secondary-school context: a mixed methodology research. Studies in Educational Evaluation, 52, 35–41.Google Scholar
  69. Struyven, K., & Devesa, J. (2016). Students’ perceptions of novel forms of assessment. In G. T. L. Brown & L. R. Harris (Eds.), Handbook of human and social conditions in assessment (pp. 129–144). New York: Routledge.Google Scholar
  70. Struyven, K., Dochy, F., & Janssens, S. (2005). Students’ perceptions about evaluation and assessment in higher education: a review. Assessment & Evaluation in Higher Education, 30(4), 331–347.Google Scholar
  71. Wang, Z., & Brown, G. (2014). Hong Kong tertiary students’ conceptions of assessment of academic ability. Higher Education Research and Development, 33(5), 1063–1077.  https://doi.org/10.1080/07294360.2014.890565.Google Scholar
  72. Webber, K. (2012). The use of learner-centered assessment in US colleges and universities. Research in Higher Education, 53(2), 201–228.Google Scholar
  73. Weekers, A. M., Brown, G., & Veldkamp, B. P. (2009). Analyzing the dimensionality of the students’ conceptions of Assessment inventory. In D. M. McInerney, G. T. L. Brown, & G. A. D. Liem (Eds.), Student perspectives on assessment: What students can tell us about assessment for learning (pp. 135–157). Charlotte: Information Age Publishing.Google Scholar
  74. Wheaton, B., Muthén, B., Alwin, D. F., & Summers, G. F. (1977). Assessing reliability and stability in panel models. Sociological Methodology, 8, 84–136.  https://doi.org/10.2307/270754.Google Scholar
  75. Winstone, N., & Boud, D. (2019). Exploring cultures of feedback practice: the adoption of learning-focused feedback practices in the UK and Australia. Higher Education Research and Development, 38(2), 411–425.  https://doi.org/10.1080/07294360.2018.1532985.Google Scholar
  76. Wise, S. L., & Cotten, M. R. (2009). Test-taking effort and score validity: the influence of student conceptions of assessment. In D. M. McInerney, G. T. L. Brown, & G. A. D. Liem (Eds.), Student perspectives on assessment: what students can tell us about assessment for learning (pp. 187–205). Charlotte: Information Age Publishing.Google Scholar
  77. Zimmerman, B. (2008). Investigating self-regulation and motivation: historical background, methodological developments, and future prospects. American Educational Research Journal, 45(1), 166–183.Google Scholar

Copyright information

© Springer Nature B.V. 2019

Authors and Affiliations

  • Maria Assunção Flores
    • 1
    Email author
  • Gavin Brown
    • 2
  • Diana Pereira
    • 1
  • Clara Coutinho
    • 1
  • Patrícia Santos
    • 1
  • Cláudia Pinheiro
    • 1
  1. 1.Research Centre on Child Studies (CIEC), Institute of EducationUniversity of MinhoBragaPortugal
  2. 2.Faculty of Education and Social WorkUniversity of AucklandAucklandNew Zealand

Personalised recommendations