Skip to main content

A Prototype for the Automatic Assessment of Critical Thinking

  • Conference paper
  • First Online:

Part of the book series: Smart Innovation, Systems and Technologies ((SIST,volume 158))

Abstract

Critical Thinking is a complex construct to define and understand, also due to a variety of definitions in the field. In recent years, different ways to assess Critical Thinking have been developed, based on methods such as natural language processing. The present paper describes a prototype developed for automatic Critical Thinking assessment in the presence of open-ended questions or essays. The prototype is designed to assess four areas related to Critical Thinking in open questions: basic linguistic skills, relevance, importance and novelty. Future development of the prototype will require the inclusion of new indicators, such as argumentation and critical evaluation.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Byrnes, J.P., Dunbar, K.N.: The nature and development of critical-analytic thinking. Educ. Psychol. Rev. 26(4), 477–493 (2014)

    Article  Google Scholar 

  2. Ennis, R.H., Millman, J., Tomko, T.N.: Cornell Critical Thinking Tests Level X & Level Z: Manual. Midwest Publications, Pacific Grove, CA (1985)

    Google Scholar 

  3. Ennis, R.H., Weir, E.E.: The Ennis-Weir critical thinking essay test: an instrument for teaching and testing. Midwest Publications (1985)

    Google Scholar 

  4. Facione, P.: Critical thinking: a statement of expert consensus for purposes of educational assessment and instruction (The Delphi Report) (1990)

    Google Scholar 

  5. Gordon, T.F., Prakken, H., Walton, D.: The Carneades model of argument and burden of proof. Artif. Intell. 171(10-15), 875–896 (2007)

    Article  MathSciNet  Google Scholar 

  6. Guiller, J., Durndell, A., Ross, A.: Peer interaction and critical thinking: face-to-face or online discussion? Learn. Instr. 18(2), 187–200 (2008)

    Article  Google Scholar 

  7. Ku, K.Y.L.: Assessing students’ critical thinking performance: urging for measurements using multi-response format. Think. Skills Creat. 4(1), 70–76 (2009)

    Article  Google Scholar 

  8. Liu, O.L., Frankel, L., Roohr, K.C.: Assessing critical thinking in higher education: current state and directions for next-generation assessment. ETS Res. Rep. Ser. 2014(1), 1–23 (2014)

    Article  Google Scholar 

  9. Moore, T.: Critical thinking: seven definitions in search of a concept. Stud. High. Educ. 38(4), 506–522 (2013)

    Article  Google Scholar 

  10. Newman, D.R., Webb, B., Cochrane, C.: A content analysis method to measure critical thinking in face-to-face and computer supported group learning. Interpers. Comput. Technol. 3(2), 56–77 (1995)

    Google Scholar 

  11. Poce, A., Corcione, L., Iovine, A.: Content analysis and critical thinking. An assessment study. CADMO (2012)

    Google Scholar 

  12. Poce, A., Corcione, L., Iovine, A.: Contributi per la definizione di una tecnologia critica interdisciplinare. Cadmo (2013)

    Google Scholar 

  13. Poce, A.: Developing critical perspectives on technology in education: a tool for MOOC evaluation. Eur. J. Open Distance E-learn. 18(1) (2015)

    Google Scholar 

  14. Watson, G.: Watson-Glaser Critical Thinking Appraisal. Psychological Corporation, San Antonio, TX (1980)

    Google Scholar 

  15. Wegerif, R., et al.: Exploring creative thinking in graphically mediated synchronous dialogues. Comput. Educ. 54(3), 613–621 (2010)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Poce Antonella .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Antonella, P., Carlo, D.M., Francesca, A. (2020). A Prototype for the Automatic Assessment of Critical Thinking. In: Rehm, M., Saldien, J., Manca, S. (eds) Project and Design Literacy as Cornerstones of Smart Education. Smart Innovation, Systems and Technologies, vol 158. Springer, Singapore. https://doi.org/10.1007/978-981-13-9652-6_13

Download citation

Publish with us

Policies and ethics