Modularized and Attention-Based Recurrent Convolutional Neural Network for Automatic Academic Paper Aspect Scoring

  • Feng QiaoEmail author
  • Lizhen Xu
  • Xiaowei Han
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11242)


Thousands of academic papers are submitted at top venues each year. Manual audits are time-consuming and laborious. And the result may be influenced by human factors. This paper investigates a modularized and attention-based recurrent convolutional network model to represent academic paper and predict aspect scores. This model treats input text as module-document hierarchies, uses attention pooling CNN and LSTM to represent text, and outputs prediction with a linear layer. Empirical results on PeerRead data show that this model give the best performance among the baseline models.


Aspect scoring Convolutional neural network Deep learning LSTM Attention pooling 


  1. Alikaniotis, D., Yannakoudakis, H., Rei, M.: Automatic text scoring using neural networks. arXiv preprint arXiv:1606.04289 (2016)
  2. Dong, F., Zhang, Y.: Automatic features for essay scoring – an empirical study. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp. 1072–1077 (2016)Google Scholar
  3. Taghipour, K., Ng, H.T.: A neural approach to automated essay scoring. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp. 1882–1891 (2016)Google Scholar
  4. De Silva, P.U.K., Vance, C.K.: Preserving the quality of scientific research: peer review of research articles. In: De Silva, P.U.K., Vance, C.K. (eds.) Scientific Scholarly Communication. FLS, pp. 73–99. Springer, Cham (2017). Scholar
  5. Langford, J., Guzdial, M.: The arbitrariness of reviews, and advice for school administrators. Commun. ACM Blog 58(4), 12–13 (2015)CrossRefGoogle Scholar
  6. Larkey, L.S.: Automatic essay grading using text categorization techniques. In: Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 90–95. ACM (1998)Google Scholar
  7. Rudner, L.M., Liang, T.: Automated essay scoring using bayes’ theorem. J. Technol. Learn. Assess. 1(2), 3 (2002)Google Scholar
  8. Chen, H., He, B.: Automated essay scoring by maximizing human-machine agreement. In: Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pp. 1741–1752 (2013)Google Scholar
  9. Yannakoudakis, H., Briscoe, T., Medlock, B.: A new dataset and method for automatically grading ESOL texts. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, vol. 1, pp. 180–189. Association for Computational Linguistics (2011)Google Scholar
  10. Attali, Y., Burstein, J.: Automated essay scoring with e-rater R v. 2.0. ETS Res. Rep. Ser. 2, i–21 (2004)Google Scholar
  11. Phandi, P., Chai, K.M.A., Ng, H.T.: Flexible domain adaptation for automated essay scoring using correlated linear regression (2015)Google Scholar
  12. Zesch, T., Wojatzki, M., Akoun, D.S.: Task-independent features for automated essay grading. In: Proceedings of the Tenth Workshop on Innovative Use of NLP for Building Educational Applications, pp. 224–232 (2015)Google Scholar
  13. Dong, F., Zhang, Y., Yang, J.: Attention based recurrent convolutional neural network for automatic essay scoring. In: Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017), pp. 153–162 (2017)Google Scholar
  14. Li, J., Luong, M.-T., Jurafsky, D.: A hierarchical neural autoencoder for paragraphs and documents. arXiv preprint arXiv:1506.01057 (2015)
  15. Tang, D., Qin, B., Liu, T.: Document modeling with gated recurrent neural network for sentiment classification. In: EMNLP, pp. 1422–1432 (2015)Google Scholar
  16. Kang, D., et al.: A Dataset of Peer Reviews (PeerRead): Collection, Insights and NLP Applications. arXiv:1804.09635v1 (2018)

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.School of Computer Science and EngineeringSoutheast University NanjingNanjingChina

Personalised recommendations