ReadME – Generating Personalized Feedback for Essay Writing Using the ReaderBench Framework
Writing quality is an important component in defining students’ capabilities. However, providing comprehensive feedback to students about their writing is a cumbersome and time-consuming task that can dramatically impact the learning outcomes and learners’ performance. The aim of this paper is to introduce a fully automated method of generating essay feedback in order to help improve learners’ writing proficiency. Using the TASA (Touchstone Applied Science Associates, Inc.) corpus and the textual complexity indices reported by the ReaderBench framework, more than 740 indices were reduced to five components using a Principal Component Analysis (PCA). These components may represent some of the basic linguistic constructs of writing. Feedback on student writing for these five components is generated using an extensible rule engine system, easily modifiable through a configuration file, which analyzes the input text and detects potential feedback at various levels of granularity: sentence, paragraph or document levels. Our prototype consists of a user-friendly web interface to easily visualize feedback based on a combination of text color highlighting and suggestions of improvement.
KeywordsAutomated writing evaluation Textual complexity Feedback generation and visualization Natural language processing
This research was partially supported by the README project “Interactive and Innovative application for evaluating the readability of texts in Romanian Language and for improving users’ writing styles”, contract no. 114/15.09.2017, MySMIS 2014 code 119286, as well as the FP7 2008-212578 LTfLL project.
- 4.Crossley, S.A., Kyle, K., McNamara, D.S.: To aggregate or not? Linguistic features in automatic essay scoring and feedback systems. J. Writ. Assess. 8(1), 1–16 (2015)Google Scholar
- 7.McNamara, D.S., Graesser, A., Cai, Z., Dai, J.: Coh-Metrix Common Core TERA version 1.0, vol. 2018 (2013). http://coh-metrix.commoncoretera.com
- 8.Zeno, S.M., Ivens, S.H., Millard, R.T., Duvvuri, R.: The Educator’s Word Frequency Guide. Touchstone Applied Science Associates Inc., Brewster (1995)Google Scholar
- 10.Dascalu, M.: Analyzing discourse and text complexity for learning and collaborating. In: Studies in Computational Intelligence, vol. 534. Springer, Cham (2014)Google Scholar
- 11.Dascalu, M., McNamara, D.S., Trausan-Matu, S., Allen, L.K.: Cohesion network analysis of CSCL participation. Behav. Res. Methods, 1–16 (2017)Google Scholar
- 12.Dascalu, M., Allen, K.A., McNamara, D.S., Trausan-Matu, S., Crossley, S.A.: Modeling comprehension processes via automated analyses of dialogism. In: CogSci 2017, pp. 1884–1889. Cognitive Science Society, London (2017)Google Scholar
- 13.Stone, P.J., Dunphy, D.C., Smith, M.S.: The general inquirer: a computer approach to content analysis (1966)Google Scholar