Abstract
Intelligent tutoring systems rely on learner models in order to recommend useful learning resources. Learner models suffer from incomplete and inaccurate information about learners. In learning networks, learners share their knowledge and experiences online and collaboratively perform problem-solving tasks. In this paper, we present an approach that calculates learners’ competence scores based on their contributions and social interactions in a learning network. We aim at more comprehensive and accurate learner models, which allow more suitable recommendations of learning resources. Competence scores range from 0 to 100 points, each associated with a confidence level representing the calculation’s reliability. For evaluation, we conducted an experiment with 14 master students at university. The results show that our approach tends to underestimate competences, while it calculates 54% of the scores accurately. Student feedback suggests to apply our approach for recommending future courses as well as forming student groups.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Almeida, J., Gonçalves, M., Figueiredo, F., Pinto, H., Belem, F.: On the quality of information for web 2.0 services. IEEE Internet Computing 14(6), 47–55 (2010)
Balog, K., De Rijke, M.: Determining expert profiles (with an application to expert finding). In: IJCAI 2007: Proc. 20th Intern. Joint Conf. on Artificial Intelligence, pp. 2657–2662 (2007)
Blooma, M., Chua, A., Goh, D.: Selection of the best answer in cqa services. In: 2010 Seventh International Conference on Information Technology, pp. 534–539. IEEE (2010)
Campbell, C., Maglio, P., Cozzi, A., Dom, B.: Expertise identification using email communications. In: Proceedings of the Twelfth International Conference on Information and Knowledge Management, pp. 528–531. ACM (2003)
Demartini, G.: Finding experts using wikipedia. In: Proceedings of the Workshop on Finding Experts on the Web with Semantics (FEWS 2007) at ISWC/ASWC2007, Busan, South Korea (2007)
Dillenbourg, P.: What do you mean by collaborative learning. In: Dillenbourg, P. (ed.) Collaborative-learning: Cognitive and Computational Approaches, pp. 1–16. Elsevier, Oxford (1999)
Dorn, J., Hochmeister, M.: Techscreen: Mining competencies in social software. In: The 3rd International Conference on Knowledge Generation, Communication and Management, Orlando, FLA, pp. 115–126 (2009)
Dunning, D., Heath, C., Suls, J.: Flawed self-assessment. Psychological Science in the Public Interest 5(3), 69 (2004)
Hiltz, S., Turoff, M.: What makes learning networks effective? Communications of the ACM 45(4), 59 (2002)
Hochmeister, M., Daxböck, J.: A User Interface for Semantic Competence Profiles. In: Konstan, J.A., Conejo, R., Marzo, J.L., Oliver, N. (eds.) UMAP 2011. LNCS, vol. 6787, pp. 159–170. Springer, Heidelberg (2011)
Hu, M., Lim, E., Sun, A., Lauw, H., Vuong, B.: Measuring article quality in wikipedia: models and evaluation. In: Proceedings of the Sixteenth ACM Conference on Conference on information and Knowledge Management, pp. 243–252. ACM (2007)
Kay, J., Lum, A.: Exploiting readily available web data for scrutable student models. In: Proceedings of the 2005 Conference on Artificial Intelligence in Education: Supporting Learning through Intelligent and Socially Informed Technology, pp. 338–345. IOS Press (2005)
Manouselis, N., Drachsler, H., Vuorikari, R., Hummel, H., Koper, R.: Recommender systems in technology enhanced learning. Recommender Systems Handbook, 387–415 (2011)
Mockus, A., Herbsleb, J.: Expertise browser: a quantitative approach to identifying expertise. In: Proceedings of the 24th International Conference on Software Engineering, pp. 503–512. ACM (2002)
Shami, N., Ehrlich, K., Gay, G., Hancock, J.: Making sense of strangers’ expertise from signals in digital artifacts. In: Proceedings of the 27th International Conference on Human factors in Computing Systems, pp. 69–78. ACM (2009)
Zhang, J., Ackerman, M., Adamic, L.: Expertise networks in online communities: structure and algorithms. In: Proceedings of the 16th International Conference on World Wide Web, pp. 221–230. ACM (2007)
Zhu, J., Goncalves, A., Uren, V., Motta, E., Pacheco, R.: Mining web data for competency management. In: Proceedings of the 2005 IEEE/WIC/ACM International Conference on Web Intelligence, pp. 94–100. IEEE (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hochmeister, M. (2012). Calculate Learners’ Competence Scores and Their Reliability in Learning Networks. In: Niedrite, L., Strazdina, R., Wangler, B. (eds) Workshops on Business Informatics Research. BIR 2011. Lecture Notes in Business Information Processing, vol 106. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29231-6_14
Download citation
DOI: https://doi.org/10.1007/978-3-642-29231-6_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-29230-9
Online ISBN: 978-3-642-29231-6
eBook Packages: Computer ScienceComputer Science (R0)