Abstract
Despite a plethora of recommendations for personalization techniques, such approaches often lack empirical justification and their benefits to users remain obscure. The study described in this paper takes a step towards filling this gap by introducing an evidence-based approach for deriving adaptive interaction techniques. In a dialogue experiment with 36 dyads of computer experts and laypersons, we observed how experts tailored their written explanations to laypersons’ communicational needs. To support adaptation, the experts in the experimental condition were provided with information about the layperson’s knowledge level. In the control condition, the experts had no available information. During the composition of their answers, the experts in both conditions articulated their planning activities. Compared with the control condition, the experts in the experimental condition made a greater attempt to form a mental model about the layperson’s knowledge. As a result, they varied the type and proportion of the information they provided depending on the layperson’s individual knowledge level. Accordingly, such adaptive explanations helped laypersons reduce comprehension breakdowns and acquire new knowledge. These results provide evidence for theoretical assumptions regarding cognitive processes in text production and conversation. They empirically ground and advance techniques for adaptation of content in adaptive hypermedia systems. They are suggestive of ways in which explanations in recommender and decision support systems could be effectively adapted to the user’s knowledge background and goals.
Similar content being viewed by others
References
Alpert S.R., Karat J., Karat C.-M., Brodie C., Vergo J. (2003). User attitudes regarding a user-adaptive eCommerce web site. User Modeling and User-Adapted Interaction 13, 373–396
Boyle C., Encarnacion A.O. (1994), Metadoc: an adaptive hypertext reading system. User Modeling and User-Adapted Interaction 4, 1–19
Bromme R., Jucks R., Runde A. (2005), Barriers and biases in computer-mediated expert-layperson-communication. In: Bromme R., Hesse F.W., Spada H. (eds). Barriers and Biases in Computer-Mediated Knowledge Communication – and How they may be Overcome. Springer, New York, pp. 89–118
Bromme R., Nückles M., Rambow R. (1999), Adaptivity and anticipation in expert-laypeople communication. In: Brennan S.E., Giboin A., Traum D. (eds). Psychological Models of Communication in Collaborative Systems. AAAI Fall Symposium Series. Menlo Park, CA: AAAI, pp. 17–24
Bromme R., Rambow R., Nückles M. (2001), Expertise and estimating what other people know: the influence of professional experience and type of knowledge. Journal of Experimental Psychology Applied 7, 317–330
Brusilovsky P. (2001), Adaptive hypermedia. User Modeling and User-Adapted Interaction 11, 87–110
Carroll J., McKendree J. (1987), Interface design issues for advice-giving expert systems. Communications of the ACM 30, 14–31
Chapman K., Abraham C., Jenkins V., Fallowfield L. (2003), Lay understanding of terms used in cancer consultations. Psycho-Oncology 12, 557–566
Chi M., Glaser R., Farr M. (1988), The Nature of Expertise. Hillsdale, NJ, Erlbaum.
Chin D.N. (2000), Strategies for expressing concise, helpful answers. Artificial Intelligence Review 14, 333–350
Clark H.H. (1996), Using language. Cambridge: University Press.
Clark H.H., Brennan S.E. (1991). Grounding in communication. In: Resnick L.B., Levine J.M., Teasley S.D. (eds). Perspectives on Socially Shared Cognition. American Psychological Association, Washington, DC, pp. 127–149
Clark H.H., Murphy G.L. (1982), Audience design in meaning and reference. In: LeNy J.F., Kintsch W. (eds). Language and Comprehension. North-Holland Publishing Company, Amsterdam, pp. 287–299
Clark H.H., Schreuder R., Buttrick S. (1983), Common ground and the understanding of demonstrative reference. Journal of Verbal Learning and Verbal Behavior 22, 1–39
Cohen J., Cohen P. (1983), Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences. Hillsdale, NJ: Erlbaum
Cunningham, P., Doyle, D. and Loughrey, J. 2003, An evaluation of the usefulness of case-based explanation. In: Proceedings of the Fifth International Conference on Case-Based Reasoning. Berlin: Springer, pp. 122–130.
Dillon A., Gabbard R. (1998), Hypermedia as an educational technology: a review of the quantitative research literature on learner comprehension, control, and style. Review of Educational Research 68, 322–349
Dilts D.M., Lyth D.M. (2000), E-commerce and e-service quality. In: Edvardsson B., Brown S.W., Johnston R., Scheuing E.E. (eds). Service Quality in the New Economy: Interdisciplinary and International Dimensions. ISQA, New York, pp. 90–98
Doyle, D., Cunningham, P., Bridge, D. and Rahman, Y. 2004, Explanation oriented retrieval. In: Proceedings of the Seventh European Conference on Case-Based Reasoning. Berlin: Springer, pp. 157–168.
du Boulay B., Luckin R. (2001), Modelling human teaching tactics and strategies for tutoring systems. International Journal of Artificial Intelligence in Education 12, 235–256
Ericsson K.A., Simon H.A. (1993), Protocol Analysis: Verbal Reports as Data. Revised edition. The MIT Press, Cambridge, MA
Ericsson K.A., Smith J. (1991), Toward a General Theory of Expertise: Prospects and Limits. Cambridge University Press, Cambridge
Erkens G., Kanselaar G., Prangsma M., Jaspers J. (2003), Computer support for collaborative and argumentative writing. In: de Corte E., Verschaffel L., Entwistle N., van Merrienboer J. (eds). Powerful Learning Environments: Unravelling Basic Components and Dimensions. Pergamon, Amsterdam, pp. 159–177
Graesser A.C., Person N.K., Harter D., and the Tutoring Research Group 2001, Teaching tactics and dialog in AutoTutor. International Journal of Artificial Intelligence in Education 12, 257–279.
Hack T.F., Degner L.F., Dyck D.G. (1994), Relationship between preferences for decisional control and illness information among women with breast cancer: a quantitative and qualitative analysis. Social Science and Medicine 39, 279–289
Hayes J.R., Flower L. (1980), Identifying the organization of writing processes. In: Gregg L.W., Steinberg E.W. (eds). Cognitive Processes in Writing. Hillsdale, NJ, Erlbaum, pp. 3–30
Hayes J.R., Nash J.G. (1996), On the nature of planning in writing. In: Levy C.M., Ransdell S. (eds). The Science of Writing: Theories, Individual Differences, and Applications. Lawrence Erlbaum Associates, Mahwah, NJ, pp. 29–55
Hinds P.J. (1999), The curse of expertise: the effects of expertise and debiasing methods on predictions of novice performance. Journal of Experimental Psychology Applied 5, 205–221
Hoffman R.R. (1992), The Psychology of Expertise. Cognitive Research and Empirical Artificial Intelligence. Springer, New York
Horton W.S., Gerrig R.J. (2002), Speakers’ experiences and audience design: knowing when and knowing how to adjust utterances to addressees. Journal of Memory and Language 47, 589–606
Horton W.S., Keysar B. (1996), When do speakers take into account common ground. Cognition 59, 91–117
Janssen D., van Waes L., van den Bergh H. (1996), Effects of thinking aloud on writing processes. In: Levy C.M., Ransdell S. (eds). The Science of Writing: Theories, Individual Differences, and Applications. Lawrence Erlbaum Associates, Mahwah, NJ, pp. 233–250
Jonassen D.H. (2000), Toward a meta-theory of problem solving. Educational Technology Research and Development 48, 63–85
Keil F., Wilson R.A. (2000), Explaining explanation. In: Keil F., Wilson R.A. (eds). Explanation and Cognition. MIT Press, Cambridge, MA, pp. 1–18
Keysar B. (1998). Language users as problem solvers: just what ambiguity problem do they solve. In: Fussell S.R., Kreuz R.J. (eds). Social and Cognitive Psychological Approaches to Interpersonal Communication. Erlbaum, Hillsdale, NJ, pp. 175–200
Kobsa A., Koenemann J., Pohl W. (2001), Personalized hypermedia presentation techniques for improving online customer relationships. The Knowledge Engineering Review 16, 111–155
Kobsa, A., Müller, D. and Nill, A. 1994, KN-AHS: an adaptive hypertext client of the user modeling system BGP-MS. In: Proceedings of the Fourth International Conference on User Modeling, pp. 99–105. Reprinted in: M. T. Marbury and W. Wahlster (eds.): 1998, Intelligent User Interfaces. Los Altos, CA: Morgan Kaufman, pp. 372–378.
Levy M.C., Marek J.P., Lea J. (1996), Concurrent and retrospective protocols in writing research. In: Rijlaarsdam G., van den Bergh H., Couzijn M. (eds). Theories, Models and Methodology in Writing Research. Amsterdam University Press, Amsterdam, pp. 542–556
Maulden S.A. (2003), Information technology, the Internet, and the future of neurology. Neurologist 9, 149–159
McSherry, D. 2003, Explanation of retrieval mismatches in recommender system dialogues. In: Proceedings of the ICCBR 2003 Workshops. Norwegian University of Science and Technology, Department of Computer and Information Science, pp. 191–199.
McSherry, D. 2004, Explaining the pros and cons of conclusions in CBR. In: P. Funk and P. A. Gonzalez (eds.): Proceedings of the Seventh European Conference on Case-Based Reasoning, Madrid, Spain. Lecture Notes in Computer Science, Vol. 3155. Berlin: Springer, pp. 317–330.
McSherry D. (2005), Explanation in recommender systems. Artificial Intelligence Review 24, 179–197
Milosavljevic, M. and Oberlander, J. 1998, Dynamic hypertext catalogues: helping users to help themselves. In: Proceedings of the Ninth ACM International Hypertext Conference (Hypertext′ 98), Pittsburgh, USA, pp. 123–131.
Mohr L.A., Bitner M.J. (1991), Mutual understanding between customers and employees in service encounters. Advances in Consumer Research 18, 611–617
Nathan M.J., Koedinger K.R. (2000), An investigation of teachers’ beliefs of students’ algebra development. Cognition and Instruction 18, 209–237
Nickerson R.S. (1999), How we know – and sometimes misjudge – what others know: imputing one’s own knowledge to others. Psychological Bulletin 125, 737–759
Nückles M. (2001), Perspektivenübernahme von Experten in der Kommunikation mit Laien. Eine Experimentalserie im Internet [Experts’ Perspective Taking in Communication with Laypersons. A Web-Based Experimental Approach] Waxmann, Münster
Nückles M., Bromme R. (2002), Internet experts’ planning of explanations for laypersons: a Web experimental approach in the Internet domain. Experimental Psychology 49, 292–304
Nückles, M. and Stürz, A. in press, The assessment tool. A method to support asynchronous communication between computer experts and laypersons. Computers in Human Behavior.
Nückles M., Wittwer J., Renkl A. (2005), Information about a layperson’s knowledge supports experts in giving effective and efficient advice to laypersons. Journal of Experimental Psychology Applied 11, 219–236
Patel V.L., Arocha J.F., Kaufman D.R. (1999), Expertise and tacit knowledge in medicine. In: Sternberg R.J., Horvath J.A. (eds). Tacit Knowledge in Professional Practice: Researcher and Practitioner Perspectives. Lawrence Erlbaum Associates, Mahwah, NJ, pp. 75–99
Polichak J.W., Gerrig R.J. (1998), Common ground and everyday language use: comments on Horton and Keysar 1996. Cognition 66, 183–189
Renkl A. (1997), Learning from worked-out examples: a study on individual differences. Cognitive Science 21, 1–29
Richter T., Naumann J., Groeben N. (2000), Attitudes toward the computer: construct validation of an instrument with scales differentiated by content. Computers in Human Behavior 16, 473–491
Rikers R.M.J.P., Schmidt H.G., Boshuizen H.P.A. (2002), On the constraints of encapsulated knowledge: clinical case representations by medical experts and subexperts. Cognition and Instruction 20, 27–45
Rust R.T., Lemon K.N. (2001), E-service and the consumer. International Journal of Electronic Commerce 5, 85–101
Schober M.F. (1993), Spatial perspective-taking in conversation. Cognition 47, 1–24
S F. and Cassens, J. 2004, Explanation goals in case-based reasoning. In: Proceedings of the ECCBR 2004 Workshops (Technical Report 142-04). Universidad Complutense de Madrid, Departamento de Sistemas Informáticos y Programación, pp. 165–174.
Tversky A., Kahneman D. (1974), Judgement under uncertainty: heuristics and biases. Science 185, 1124–1131
Weber, G. and Specht, M.: 1997, User modeling and adaptive navigation support in WWW-based tutoring systems. In: A. Jameson, C. Paris and C. Tasso (eds.): Proceedings of the 6th International Conference on User Modeling. New York: Springer, pp. 289–300.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Nückles, M., Winter, A., Wittwer, J. et al. How do Experts Adapt their Explanations to a Layperson’s Knowledge in Asynchronous Communication? An Experimental Study. User Model User-Adap Inter 16, 87–127 (2006). https://doi.org/10.1007/s11257-006-9000-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11257-006-9000-y
Keywords
- adaptive instructional explanations
- advice-giving and recommender systems
- audience design
- cognitive processes in writing and written communication
- computer-mediated communication
- human experts’ adaptation strategies
- human tutoring
- natural language generation
- personalization techniques
- user-adapted communication