Abstract
Evaluation frameworks have been presented that suggest layered evaluation of adaptive systems along two dimensions: (i) the software development cycle, and (ii) the component of the adaptive system that shall be looked at. We argue that a third dimension is crucial: the question whether an evaluation should take place in the lab or in the field. We present a refined systematization of evaluation approaches using the evaluation of the adaptive WIL system APOSDLE as an example.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Lindstaedt, S.N., Aehnelt, M., de Hoog, R.: Supporting the Learning Dimension of Knowledge Work. In: Cress, U., Dimitrova, V., Specht, M. (eds.) EC-TEL 2009. LNCS, vol. 5794, pp. 639–644. Springer, Heidelberg (2009)
Brusilovsky, P., Karagiannidis, C., Sampson, D.: The Benefits of Layered Evaluation of Adaptive Applications and Services. In: Workshop Proc. of UM 2001, pp. 1–8 (2001)
Paramythis, A., Weibelzahl, S., Masthoff, J.: Layered Evaluation of interactive adaptive systems: framework and formative methods. UMUAI 20, 383–453 (2010)
Weibelzahl, S., Lauer, C.U.: Framework for the evaluation of adaptive CBR-systems. In: Proc. of GWCBR 2001, Baden-Baden, Germany, pp. 254–263 (2001)
Van Velsen, L., Van Der Geest, T., Klaassen, R., Steehouder, M.: User-centered evaluation of adaptive and adaptable systems: a literature review. The Knowledge Engineering Review 23(3), 261–281 (2008)
Falk, A., Heckman, J.: Lab experiments are a major source of knowledge in the social sciences. Science 326, 535–538 (2009)
Ley, T., Kump, B., Albert, D.: A methodology for eliciting, modelling, and evaluating expert knowledge for an adaptive work-integrated learning system. Int. J. of Human-Computer Studies 68(4), 185–208 (2010)
Kump, B.: Evaluating the Domain Model of Adaptive Work-integrated Learning Systems. Unpublished Dissertation. University of Graz, Graz (2010)
Ley, T., Kump, B., Maas, A., Maiden, N., Albert, D.: Evaluating the Adaptation of a Learning System before the Prototype Is Ready: A Paper-Based Lab Study. In: Houben, G.-J., McCalla, G., Pianesi, F., Zancanaro, M. (eds.) UMAP 2009. LNCS, vol. 5535, pp. 331–336. Springer, Heidelberg (2009)
Ley, T., Kump, B., Gerdenitsch, C.: Scaffolding self-directed learning with personalized learning goal recommendations. In: De Bra, P., Kobsa, A., Chin, D. (eds.) UMAP 2010. LNCS, vol. 6075, pp. 75–86. Springer, Heidelberg (2010)
Pabst, C.: Validating the Adaptation Model of a Work-integrated Learning Environment: A Field Study. Unpublished Thesis, Dep’t of Psychology, Univ of Graz (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kump, B., Ley, T., Lindstaedt, S. (2011). Evaluating Adaptive Work-Integrated Learning Systems: From the Lab to the Field. In: Kloos, C.D., Gillet, D., Crespo García, R.M., Wild, F., Wolpers, M. (eds) Towards Ubiquitous Learning. EC-TEL 2011. Lecture Notes in Computer Science, vol 6964. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23985-4_36
Download citation
DOI: https://doi.org/10.1007/978-3-642-23985-4_36
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-23984-7
Online ISBN: 978-3-642-23985-4
eBook Packages: Computer ScienceComputer Science (R0)