Functional, Frustrating and Full of Potential: Learners’ Experiences of a Prototype for Automated Essay Feedback
OpenEssayist is an automated feedback system designed to support university students as they write essays for assessment. A first generation prototype of this system was tested on a cohort of postgraduate distance learners at the UK Open University from September to December 2013. A case study approach was used to examine three participants’ experiences of the prototype. Findings from the case studies offered insight into how different users may perceive the usefulness, future potential and end-user of such a tool. This study has important implications for the next phase of development, when the role of OpenEssayist in supporting students’ learning will need to be more clearly understood.
Keywordsautomated feedback essay-writing software evaluation case study
Unable to display preview. Download preview PDF.
- 1.Van Labeke, N., Whitelock, D., Field, D., Pulman, S., Richardson, J.T.E.: OpenEssayist: extractive summarisation and formative assessment of free-text essays. In: Proceedings of the 1st International Workshop on Discourse-Centric Learning Analytics, Leuven, Belgium (April 2013a)Google Scholar
- 2.Van Labeke, N., Whitelock, D., Field, D., Pulman, S., Richardson, J.T.E.: What is my essay really saying? Using extractive summarization to motivate reflection and redrafting. In: Proceedings of the AIED Workshop on Formative Feedback in Interactive Learning Environments, Memphis, TN (July 2013b)Google Scholar
- 5.Burstein, J.C., Chodorow, M., Leacock, C.: Criterion(SM) Online Essay Evaluation: An Application for Automated Evaluation of Student Essays. In: Proceedings of the Fifteenth Conference on Innovative Applications of Artificial Intelligence, Acapulco, Mexico, pp. 3–10 (2003)Google Scholar
- 6.Rudner, L.M., Garcia, V., Welch, C.: An Evaluation of IntelliMetricTM Essay Scoring System. The Journal of Technology, Learning and Assessment 4(4) (2006)Google Scholar
- 8.Alden, B., Van Labeke, N., Whitelock, D., Richardson, J.T.E., Pulman, S., Field, D.: Using student experience as a model for designing an automatic feedback system for short essays. International Journal of E-Assessment (in press)Google Scholar
- 9.Chandrasegaran, A., Ellis, M., Poedjosoedarmo, G.: Essay Assist—Developing software for writing skills improvement in partnership with students. Regional Language Centre Journal 36(2), 137–155 (2005)Google Scholar
- 10.Roscoe, R.D., Varner, L.K., Weston, J.L., Crossley, S.A., McNamara, D.S.: The Writing Pal Intelligent Tutoring System: Usability Testing and Development. Computers and Composition (in press), http://126.96.36.199/pdf/Roscoe2012WritingPalTutor.pdf (accessed April 14, 2013)
- 11.Bryman, A.: Social Research Methods, 2nd edn. Oxford University Press, Oxford (2004)Google Scholar
- 12.Whitelock, D., Field, D., Pulman, S., Richardson, J.T.E., van Labeke, N.: Designing and testing visual representations of draft essays for higher education students. Paper Presented at the Discourse-Centric Learning Analytics (DCLA) Workshop, LAK 14 (March 2014)Google Scholar