Abstract
Ontology-based Multiple Choice Question (MCQ) generation has a relatively short history. Many attempts have been carried out to develop methods to generate MCQs from ontologies. However, there is still a need to understand the applicability of these methods in real educational settings. In this paper, we present an empirical evaluation of ontology-based MCQ generation. We examine the feasibility of applying ontology-based MCQ generation methods by educators with no prior experience in ontology building. The findings of this study show that this is feasible and can result in generating a reasonable number of educationally useful questions with good predictions about their difficulty levels.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Alsubait, T., Parsia, B., Sattler, U.: Automatic generation of analogy questions for student assessment: an ontology-based approach. In: ALT-C 2012 Conference Proceedings (2012)
Alsubait, T., Parsia, B., Sattler, U.: Mining ontologies for analogy questions: a similarity-based approach. In: OWLED (2012)
Alsubait, T., Parsia, B., Sattler, U.: Next generation of e-assessment: automatic generation of questions. International Journal of Technology Enhanced Learning 4(3/4), 156–171 (2012)
Alsubait, T., Parsia, B., Sattler, U.: A similarity-based theory of controlling mcq difficulty. In: Second International Conference on e-Learning and e-Technologies in Education (ICEEE), pp. 283–288 (2013)
Alsubait, T., Parsia, B., Sattler, U.: Generating multiple choice questions from ontologies: lessons learnt. In: The 11th OWL: Experiences and Directions Workshop (OWLED2014) (2014)
Alsubait, T., Parsia, B., Sattler, U.: Measuring similarity in ontologies: how bad is a cheap measure? In: 27th Inernational Workshop on Description Logics (DL-2014) (2014)
Baader, F., Calvanese, D., McGuinness, D.L., Nardi, D., Patel-Schneider, P.F.: The Description Logic Handbook: Theory, Implementation and Applications. Cambridge University Press, second edition (2007)
Bloom, B.S., Krathwohl, D.R.: Taxonomy of educational objectives: The classification of educational goals by a committee of college and university examiners. Handbook 1. Cognitive domain. Addison-Wesley, New York (1956)
Davis, B.G.: Tools for Teaching. Jossey-Bass, San Francisco (2001)
Gavrilova, T., Farzan, R., Brusilovsky, P.: One practical algorithm of creating teaching ontologies. In: 12th International Network-Based Education Conference NBE, pp. 29–37 (2005)
Haladyna, T.M.: Developing and validating multiple-choice test items. Hillsdale: Lawrence Erlbaum (1994)
Haladyna, T.M., Downing, S.M.: How many options is enough for a multiple choice test item? Educational & Psychological Measurement 53(4), 999–1010 (1993)
Horridge, M.: A practical guide to building OWL ontologies using Protégé 4 and CO-ODE tools (edition 1.3.) (2011). http://owl.cs.manchester.ac.uk/tutorials/protegeowltutorial/
Horridge, M., Bechhofer, S.: The OWL API: A Java API for working with OWL 2 ontologies. In: Proceedings of the 6th International Workshop on OWL: Experiences and Directions (OWLED) (2009)
Miller, M., Linn, R., Gronlund, N.: Measurement and Assessment in Teaching, Tenth Edition. Pearson (2008)
Mitkov, R., An Ha, L., Karamani, N.: A computer-aided environment for generating multiple-choice test items, cambridge University Press. Natural Language Engineering 12(2), 177–194 (2006)
Papasalouros, A., Kotis, K., Kanaris, K.: Automatic generation of multiple-choice questions from domain ontologies. In: IADIS e-Learning 2008 conference, Amsterdam (2008)
Paxton, M.: A linguistic perspective on multiple choice questioning. Assessment & Evaluation in Higher Education 25(2), 109–119 (2001)
Rudner, L.: Elements of adaptive testing. Implementing the Graduate Management Admission Test Computerized Adaptive Test, pp. 151–165. Springer, New York (2010)
Sidick, J.T., Barrett, G.V., Doverspike, D.: Three-alternative multiple-choice tests: An attractive option. Personnel Psychology 47, 829–835 (1994)
Sosnovsky, S., Gavrilova, T.: Development of educational ontology for C-programming. In: Proceedings of the XI-th International Conference Knowledge-Dialogue-Solution, vol. 1, pp. 127–132. FOI ITHEA (2006)
Sumita, E., Sugaya, F., Yamamoto, S.: Measuring non-native speakers prociency of english using a test with automatically-generated fill-in-the-blank questions. In: Proceedings of the Second Workshop on Building Educational Applications using Natural Language Processing, Ann Arbor, US, pp. 61–68 (2005)
Tsarkov, D., Horrocks, I.: FaCT++ description logic reasoner: System description. In: Furbach, U., Shankar, N. (eds.) Automated Reasoning. LNCS, vol. 4130, pp. 292–297. Springer, Heidelberg (2006)
Williams, S.: Generating mathematical word problems. In: 2011 AAAI Fall Symposium Series (2011)
Zitko, B., Stankov, S., Rosic, M., Grubisic, A.: Dynamic test generation over ontology-based knowledge representation in authoring shell. Expert Systems with Applications: An International Journal 36(4), 8185–8196 (2008)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Alsubait, T., Parsia, B., Sattler, U. (2015). Generating Multiple Choice Questions From Ontologies: How Far Can We Go?. In: Lambrix, P., et al. Knowledge Engineering and Knowledge Management. EKAW 2014. Lecture Notes in Computer Science(), vol 8982. Springer, Cham. https://doi.org/10.1007/978-3-319-17966-7_7
Download citation
DOI: https://doi.org/10.1007/978-3-319-17966-7_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-17965-0
Online ISBN: 978-3-319-17966-7
eBook Packages: Computer ScienceComputer Science (R0)