Automatic Labeling of Forums Using Bloom’s Taxonomy
The labeling of discussion forums using the cognitive levels of Bloom’s taxonomy is a time-consuming and very expensive task due to the big amount of information that needs to be labeled and the need of an expert in the educational field for applying the taxonomy according to the messages of the forums. In this paper we present a framework in order to automatically label messages from discussion forums using the categories of Bloom’s taxonomy. Several models were created using three kind of machine learning approaches: linear, Rule-Based and combined classifiers. The models are evaluated using the accuracy, the F1-measure and the area under the ROC curve. Additionally, a statistical significance of the results is performed using a McNemar test in order to validate them. The results show that the combination of a linear classifier with a Rule-Based classifier yields very good and promising results for this difficult task.
KeywordsCSCL Bloom’s taxonomy logistic regression classifier Rule-Based classifier combined classifiers
Unable to display preview. Download preview PDF.
- 1.Bloom, B.S., Engelhart, M., Furst, E.J., Hill, W.H., Krathwohl, D.R.: Taxonomy of Educational Objectives: The Classification of Educational Goals. In: Handbook I: Cognitive Domain, vol. 19, Longman, Green (1956)Google Scholar
- 2.Chang, W., Chung, M.: Automatic applying Bloom’s taxonomy to classify and analysis the cognition level of English question items. In: 2009 Joint Conferences on Pervasive Computing (JCPC), pp. 727–734 (2009)Google Scholar
- 3.Chiluiza, K., Echeverria, V.: Cognitive and Meta-Cognitive Skills Measurement: What about the Task in Web 2.0 Environments? In: Proceedings of Society for Information Technology & Teacher Education International Conference, pp. 1685–1690 (2012)Google Scholar
- 5.Jolliffe, I.: Principal Component Analysis. Wiley Online Library (2005)Google Scholar
- 8.Miyake, N.: Computer supported collaborative learning. In: The SAGE Handbook of E-Learning Research, pp. 248–267. SAGE Publications Ltd. (2007)Google Scholar
- 10.Pincay, J., Ochoa, X.: Automatic Classification of Answers to Discussion Forums According to the Cognitive Domain of Blooms Taxonomy using Text Mining and a Bayesian Classifier. In: Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications, pp. 626–634 (2013)Google Scholar
- 14.Yusof, N., Hui, C.J.: Determination of Bloom’s cognitive level of question items using artificial neural network. In: 10th International Conference on Intelligent Systems Design and Applications (ISDA), pp. 866–870 (2010)Google Scholar