Abstract
Frequent quizzes are used to motivate students to study throughout the academic term instead of waiting until just before the examination. Teachers have been relying on the use of multiple-choice questions to reduce their grading effort. We have developed a tool that grades answers of essay questions automatically. The tool should be a welcome addition to a teacher’s arsenal for quiz preparation.
The teacher will provide the model answer of an essay question. Incorporating some heuristics into the Stanford Parser, our tool recognizes the parts of speech of each word and creates a parse tree from each sentence. It builds a semantic graph from the sentences in the model answer. The graph uses nodes to represent words and phrases. A directed arc connects two nodes to represent a relation. Currently, four types of arcs are used: attribute, possession, classification and action.
In the same way, our tool determines the semantic graph of the student answer. Our tool compares the graph of the model answer with the graph of the student answer. It calculates a score to reflect their similarity. The relative weights of nodes and arcs are adjustable. WordNet helps us to identify synonyms so that the two answers need not be using the same wording to be considered similar.
Our tool has some limitations. First, our semantic graph cannot handle timing sequences, for example, “event A happens before event B”. Second, our graph cannot handle conditional knowledge like “if X, then Y”. In the future, we may be able to introduce new arc types to address these limitations. Our prototype is not yet ready to replace the grading performed by teachers in formal assessment. But it may be useful to allow students to check their understanding during their self-study.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
MacDonald, M.C.: The lexical nature of syntactic ambiguity resolution. Psychol. Rev. 101(4), 676 (1994)
Smith, A.E.: Evaluation of unsupervised semantic mapping of natural language with Leximancer concept mapping. Behav. Res. Methods 38(2), 262–279 (2006)
Sowa, J.F.: Semantic networks. Encycl. Cogn. Sci. 6, 291–330 (2006)
De Marneffe, M.C., Manning, C.D.: Stanford typed dependencies manual, pp. 338–345. Technical report, Stanford University (2008)
Bird, S., Klein, E., Loper, E.: Natural language processing with Python. O’Reilly Media, Inc., Sebastopol (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lo, C.S., Au, O., Tong, B.K.B. (2015). Applying the Semantic Graph Approach to Automatic Essay Scoring. In: Lam, J., Ng, K., Cheung, S., Wong, T., Li, K., Wang, F. (eds) Technology in Education. Technology-Mediated Proactive Learning. ICTE 2015. Communications in Computer and Information Science, vol 559. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-48978-9_24
Download citation
DOI: https://doi.org/10.1007/978-3-662-48978-9_24
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-48977-2
Online ISBN: 978-3-662-48978-9
eBook Packages: Computer ScienceComputer Science (R0)