Advertisement

Functional, Frustrating and Full of Potential: Learners’ Experiences of a Prototype for Automated Essay Feedback

  • Bethany Alden Rivers
  • Denise Whitelock
  • John T. E. Richardson
  • Debora Field
  • Stephen Pulman
Part of the Communications in Computer and Information Science book series (CCIS, volume 439)

Abstract

OpenEssayist is an automated feedback system designed to support university students as they write essays for assessment. A first generation prototype of this system was tested on a cohort of postgraduate distance learners at the UK Open University from September to December 2013. A case study approach was used to examine three participants’ experiences of the prototype. Findings from the case studies offered insight into how different users may perceive the usefulness, future potential and end-user of such a tool. This study has important implications for the next phase of development, when the role of OpenEssayist in supporting students’ learning will need to be more clearly understood.

Keywords

automated feedback essay-writing software evaluation case study 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Van Labeke, N., Whitelock, D., Field, D., Pulman, S., Richardson, J.T.E.: OpenEssayist: extractive summarisation and formative assessment of free-text essays. In: Proceedings of the 1st International Workshop on Discourse-Centric Learning Analytics, Leuven, Belgium (April 2013a)Google Scholar
  2. 2.
    Van Labeke, N., Whitelock, D., Field, D., Pulman, S., Richardson, J.T.E.: What is my essay really saying? Using extractive summarization to motivate reflection and redrafting. In: Proceedings of the AIED Workshop on Formative Feedback in Interactive Learning Environments, Memphis, TN (July 2013b)Google Scholar
  3. 3.
    Bruning, R., Dempsey, M., Kauffman, D.F., McKim, C.: Examining dimensions of self-efficacy for writing. Journal of Educational Psychology 105(1), 25–38 (2013)CrossRefGoogle Scholar
  4. 4.
    Whitelock, D.: Activating assessment for learning: Are we on the way with Web 2.0? In: Lee, M.J.W., McLoughlin, C. (eds.) Web 2.0-Based E-Learning: Applying Social Informatics for Tertiary Teaching, pp. 319–342. IGI Global, Hershey (2010)CrossRefGoogle Scholar
  5. 5.
    Burstein, J.C., Chodorow, M., Leacock, C.: Criterion(SM) Online Essay Evaluation: An Application for Automated Evaluation of Student Essays. In: Proceedings of the Fifteenth Conference on Innovative Applications of Artificial Intelligence, Acapulco, Mexico, pp. 3–10 (2003)Google Scholar
  6. 6.
    Rudner, L.M., Garcia, V., Welch, C.: An Evaluation of IntelliMetricTM Essay Scoring System. The Journal of Technology, Learning and Assessment 4(4) (2006)Google Scholar
  7. 7.
    Landauer, T.K., Laham, D., Foltz, P.: Automatic Essay Assessment. Assessment in Education: Principles, Policy & Practice 10(3), 295–308 (2003)CrossRefGoogle Scholar
  8. 8.
    Alden, B., Van Labeke, N., Whitelock, D., Richardson, J.T.E., Pulman, S., Field, D.: Using student experience as a model for designing an automatic feedback system for short essays. International Journal of E-Assessment (in press)Google Scholar
  9. 9.
    Chandrasegaran, A., Ellis, M., Poedjosoedarmo, G.: Essay Assist—Developing software for writing skills improvement in partnership with students. Regional Language Centre Journal 36(2), 137–155 (2005)Google Scholar
  10. 10.
    Roscoe, R.D., Varner, L.K., Weston, J.L., Crossley, S.A., McNamara, D.S.: The Writing Pal Intelligent Tutoring System: Usability Testing and Development. Computers and Composition (in press), http://129.219.222.66/pdf/Roscoe2012WritingPalTutor.pdf (accessed April 14, 2013)
  11. 11.
    Bryman, A.: Social Research Methods, 2nd edn. Oxford University Press, Oxford (2004)Google Scholar
  12. 12.
    Whitelock, D., Field, D., Pulman, S., Richardson, J.T.E., van Labeke, N.: Designing and testing visual representations of draft essays for higher education students. Paper Presented at the Discourse-Centric Learning Analytics (DCLA) Workshop, LAK 14 (March 2014)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Bethany Alden Rivers
    • 1
  • Denise Whitelock
    • 1
  • John T. E. Richardson
    • 1
  • Debora Field
    • 2
  • Stephen Pulman
    • 2
  1. 1.Institute of Educational TechnologyThe Open UniversityMilton KeynesUK
  2. 2.Computer Science DepartmentThe University of OxfordOxfordUK

Personalised recommendations