Skip to main content

Advertisement

Log in

How do Experts Adapt their Explanations to a Layperson’s Knowledge in Asynchronous Communication? An Experimental Study

  • Published:
User Modeling and User-Adapted Interaction Aims and scope Submit manuscript

Abstract

Despite a plethora of recommendations for personalization techniques, such approaches often lack empirical justification and their benefits to users remain obscure. The study described in this paper takes a step towards filling this gap by introducing an evidence-based approach for deriving adaptive interaction techniques. In a dialogue experiment with 36 dyads of computer experts and laypersons, we observed how experts tailored their written explanations to laypersons’ communicational needs. To support adaptation, the experts in the experimental condition were provided with information about the layperson’s knowledge level. In the control condition, the experts had no available information. During the composition of their answers, the experts in both conditions articulated their planning activities. Compared with the control condition, the experts in the experimental condition made a greater attempt to form a mental model about the layperson’s knowledge. As a result, they varied the type and proportion of the information they provided depending on the layperson’s individual knowledge level. Accordingly, such adaptive explanations helped laypersons reduce comprehension breakdowns and acquire new knowledge. These results provide evidence for theoretical assumptions regarding cognitive processes in text production and conversation. They empirically ground and advance techniques for adaptation of content in adaptive hypermedia systems. They are suggestive of ways in which explanations in recommender and decision support systems could be effectively adapted to the user’s knowledge background and goals.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Alpert S.R., Karat J., Karat C.-M., Brodie C., Vergo J. (2003). User attitudes regarding a user-adaptive eCommerce web site. User Modeling and User-Adapted Interaction 13, 373–396

    Article  Google Scholar 

  • Boyle C., Encarnacion A.O. (1994), Metadoc: an adaptive hypertext reading system. User Modeling and User-Adapted Interaction 4, 1–19

    Article  Google Scholar 

  • Bromme R., Jucks R., Runde A. (2005), Barriers and biases in computer-mediated expert-layperson-communication. In: Bromme R., Hesse F.W., Spada H. (eds). Barriers and Biases in Computer-Mediated Knowledge Communication – and How they may be Overcome. Springer, New York, pp. 89–118

    Chapter  Google Scholar 

  • Bromme R., Nückles M., Rambow R. (1999), Adaptivity and anticipation in expert-laypeople communication. In: Brennan S.E., Giboin A., Traum D. (eds). Psychological Models of Communication in Collaborative Systems. AAAI Fall Symposium Series. Menlo Park, CA: AAAI, pp. 17–24

    Google Scholar 

  • Bromme R., Rambow R., Nückles M. (2001), Expertise and estimating what other people know: the influence of professional experience and type of knowledge. Journal of Experimental Psychology Applied 7, 317–330

    Article  Google Scholar 

  • Brusilovsky P. (2001), Adaptive hypermedia. User Modeling and User-Adapted Interaction 11, 87–110

    Article  MATH  Google Scholar 

  • Carroll J., McKendree J. (1987), Interface design issues for advice-giving expert systems. Communications of the ACM 30, 14–31

    Article  Google Scholar 

  • Chapman K., Abraham C., Jenkins V., Fallowfield L. (2003), Lay understanding of terms used in cancer consultations. Psycho-Oncology 12, 557–566

    Article  Google Scholar 

  • Chi M., Glaser R., Farr M. (1988), The Nature of Expertise. Hillsdale, NJ, Erlbaum.

    Google Scholar 

  • Chin D.N. (2000), Strategies for expressing concise, helpful answers. Artificial Intelligence Review 14, 333–350

    Article  MATH  Google Scholar 

  • Clark H.H. (1996), Using language. Cambridge: University Press.

  • Clark H.H., Brennan S.E. (1991). Grounding in communication. In: Resnick L.B., Levine J.M., Teasley S.D. (eds). Perspectives on Socially Shared Cognition. American Psychological Association, Washington, DC, pp. 127–149

    Chapter  Google Scholar 

  • Clark H.H., Murphy G.L. (1982), Audience design in meaning and reference. In: LeNy J.F., Kintsch W. (eds). Language and Comprehension. North-Holland Publishing Company, Amsterdam, pp. 287–299

    Google Scholar 

  • Clark H.H., Schreuder R., Buttrick S. (1983), Common ground and the understanding of demonstrative reference. Journal of Verbal Learning and Verbal Behavior 22, 1–39

    Article  Google Scholar 

  • Cohen J., Cohen P. (1983), Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences. Hillsdale, NJ: Erlbaum

    Google Scholar 

  • Cunningham, P., Doyle, D. and Loughrey, J. 2003, An evaluation of the usefulness of case-based explanation. In: Proceedings of the Fifth International Conference on Case-Based Reasoning. Berlin: Springer, pp. 122–130.

  • Dillon A., Gabbard R. (1998), Hypermedia as an educational technology: a review of the quantitative research literature on learner comprehension, control, and style. Review of Educational Research 68, 322–349

    Google Scholar 

  • Dilts D.M., Lyth D.M. (2000), E-commerce and e-service quality. In: Edvardsson B., Brown S.W., Johnston R., Scheuing E.E. (eds). Service Quality in the New Economy: Interdisciplinary and International Dimensions. ISQA, New York, pp. 90–98

    Google Scholar 

  • Doyle, D., Cunningham, P., Bridge, D. and Rahman, Y. 2004, Explanation oriented retrieval. In: Proceedings of the Seventh European Conference on Case-Based Reasoning. Berlin: Springer, pp. 157–168.

  • du Boulay B., Luckin R. (2001), Modelling human teaching tactics and strategies for tutoring systems. International Journal of Artificial Intelligence in Education 12, 235–256

    Google Scholar 

  • Ericsson K.A., Simon H.A. (1993), Protocol Analysis: Verbal Reports as Data. Revised edition. The MIT Press, Cambridge, MA

    Google Scholar 

  • Ericsson K.A., Smith J. (1991), Toward a General Theory of Expertise: Prospects and Limits. Cambridge University Press, Cambridge

    Google Scholar 

  • Erkens G., Kanselaar G., Prangsma M., Jaspers J. (2003), Computer support for collaborative and argumentative writing. In: de Corte E., Verschaffel L., Entwistle N., van Merrienboer J. (eds). Powerful Learning Environments: Unravelling Basic Components and Dimensions. Pergamon, Amsterdam, pp. 159–177

    Google Scholar 

  • Graesser A.C., Person N.K., Harter D., and the Tutoring Research Group 2001, Teaching tactics and dialog in AutoTutor. International Journal of Artificial Intelligence in Education 12, 257–279.

    Google Scholar 

  • Hack T.F., Degner L.F., Dyck D.G. (1994), Relationship between preferences for decisional control and illness information among women with breast cancer: a quantitative and qualitative analysis. Social Science and Medicine 39, 279–289

    Article  Google Scholar 

  • Hayes J.R., Flower L. (1980), Identifying the organization of writing processes. In: Gregg L.W., Steinberg E.W. (eds). Cognitive Processes in Writing. Hillsdale, NJ, Erlbaum, pp. 3–30

    Google Scholar 

  • Hayes J.R., Nash J.G. (1996), On the nature of planning in writing. In: Levy C.M., Ransdell S. (eds). The Science of Writing: Theories, Individual Differences, and Applications. Lawrence Erlbaum Associates, Mahwah, NJ, pp. 29–55

    Google Scholar 

  • Hinds P.J. (1999), The curse of expertise: the effects of expertise and debiasing methods on predictions of novice performance. Journal of Experimental Psychology Applied 5, 205–221

    Article  Google Scholar 

  • Hoffman R.R. (1992), The Psychology of Expertise. Cognitive Research and Empirical Artificial Intelligence. Springer, New York

    Google Scholar 

  • Horton W.S., Gerrig R.J. (2002), Speakers’ experiences and audience design: knowing when and knowing how to adjust utterances to addressees. Journal of Memory and Language 47, 589–606

    Article  Google Scholar 

  • Horton W.S., Keysar B. (1996), When do speakers take into account common ground. Cognition 59, 91–117

    Article  Google Scholar 

  • Janssen D., van Waes L., van den Bergh H. (1996), Effects of thinking aloud on writing processes. In: Levy C.M., Ransdell S. (eds). The Science of Writing: Theories, Individual Differences, and Applications. Lawrence Erlbaum Associates, Mahwah, NJ, pp. 233–250

    Google Scholar 

  • Jonassen D.H. (2000), Toward a meta-theory of problem solving. Educational Technology Research and Development 48, 63–85

    Article  Google Scholar 

  • Keil F., Wilson R.A. (2000), Explaining explanation. In: Keil F., Wilson R.A. (eds). Explanation and Cognition. MIT Press, Cambridge, MA, pp. 1–18

    Google Scholar 

  • Keysar B. (1998). Language users as problem solvers: just what ambiguity problem do they solve. In: Fussell S.R., Kreuz R.J. (eds). Social and Cognitive Psychological Approaches to Interpersonal Communication. Erlbaum, Hillsdale, NJ, pp. 175–200

    Google Scholar 

  • Kobsa A., Koenemann J., Pohl W. (2001), Personalized hypermedia presentation techniques for improving online customer relationships. The Knowledge Engineering Review 16, 111–155

    Article  MATH  Google Scholar 

  • Kobsa, A., Müller, D. and Nill, A. 1994, KN-AHS: an adaptive hypertext client of the user modeling system BGP-MS. In: Proceedings of the Fourth International Conference on User Modeling, pp. 99–105. Reprinted in: M. T. Marbury and W. Wahlster (eds.): 1998, Intelligent User Interfaces. Los Altos, CA: Morgan Kaufman, pp. 372–378.

  • Levy M.C., Marek J.P., Lea J. (1996), Concurrent and retrospective protocols in writing research. In: Rijlaarsdam G., van den Bergh H., Couzijn M. (eds). Theories, Models and Methodology in Writing Research. Amsterdam University Press, Amsterdam, pp. 542–556

    Google Scholar 

  • Maulden S.A. (2003), Information technology, the Internet, and the future of neurology. Neurologist 9, 149–159

    Article  Google Scholar 

  • McSherry, D. 2003, Explanation of retrieval mismatches in recommender system dialogues. In: Proceedings of the ICCBR 2003 Workshops. Norwegian University of Science and Technology, Department of Computer and Information Science, pp. 191–199.

  • McSherry, D. 2004, Explaining the pros and cons of conclusions in CBR. In: P. Funk and P. A. Gonzalez (eds.): Proceedings of the Seventh European Conference on Case-Based Reasoning, Madrid, Spain. Lecture Notes in Computer Science, Vol. 3155. Berlin: Springer, pp. 317–330.

  • McSherry D. (2005), Explanation in recommender systems. Artificial Intelligence Review 24, 179–197

    Article  MATH  Google Scholar 

  • Milosavljevic, M. and Oberlander, J. 1998, Dynamic hypertext catalogues: helping users to help themselves. In: Proceedings of the Ninth ACM International Hypertext Conference (Hypertext′ 98), Pittsburgh, USA, pp. 123–131.

  • Mohr L.A., Bitner M.J. (1991), Mutual understanding between customers and employees in service encounters. Advances in Consumer Research 18, 611–617

    Google Scholar 

  • Nathan M.J., Koedinger K.R. (2000), An investigation of teachers’ beliefs of students’ algebra development. Cognition and Instruction 18, 209–237

    Article  Google Scholar 

  • Nickerson R.S. (1999), How we know – and sometimes misjudge – what others know: imputing one’s own knowledge to others. Psychological Bulletin 125, 737–759

    Article  Google Scholar 

  • Nückles M. (2001), Perspektivenübernahme von Experten in der Kommunikation mit Laien. Eine Experimentalserie im Internet [Experts’ Perspective Taking in Communication with Laypersons. A Web-Based Experimental Approach] Waxmann, Münster

    Google Scholar 

  • Nückles M., Bromme R. (2002), Internet experts’ planning of explanations for laypersons: a Web experimental approach in the Internet domain. Experimental Psychology 49, 292–304

    Google Scholar 

  • Nückles, M. and Stürz, A. in press, The assessment tool. A method to support asynchronous communication between computer experts and laypersons. Computers in Human Behavior.

  • Nückles M., Wittwer J., Renkl A. (2005), Information about a layperson’s knowledge supports experts in giving effective and efficient advice to laypersons. Journal of Experimental Psychology Applied 11, 219–236

    Article  Google Scholar 

  • Patel V.L., Arocha J.F., Kaufman D.R. (1999), Expertise and tacit knowledge in medicine. In: Sternberg R.J., Horvath J.A. (eds). Tacit Knowledge in Professional Practice: Researcher and Practitioner Perspectives. Lawrence Erlbaum Associates, Mahwah, NJ, pp. 75–99

    Google Scholar 

  • Polichak J.W., Gerrig R.J. (1998), Common ground and everyday language use: comments on Horton and Keysar 1996. Cognition 66, 183–189

    Article  Google Scholar 

  • Renkl A. (1997), Learning from worked-out examples: a study on individual differences. Cognitive Science 21, 1–29

    Article  Google Scholar 

  • Richter T., Naumann J., Groeben N. (2000), Attitudes toward the computer: construct validation of an instrument with scales differentiated by content. Computers in Human Behavior 16, 473–491

    Article  Google Scholar 

  • Rikers R.M.J.P., Schmidt H.G., Boshuizen H.P.A. (2002), On the constraints of encapsulated knowledge: clinical case representations by medical experts and subexperts. Cognition and Instruction 20, 27–45

    Article  Google Scholar 

  • Rust R.T., Lemon K.N. (2001), E-service and the consumer. International Journal of Electronic Commerce 5, 85–101

    Google Scholar 

  • Schober M.F. (1993), Spatial perspective-taking in conversation. Cognition 47, 1–24

    Article  Google Scholar 

  • S  F. and Cassens, J. 2004, Explanation goals in case-based reasoning. In: Proceedings of the ECCBR 2004 Workshops (Technical Report 142-04). Universidad Complutense de Madrid, Departamento de Sistemas Informáticos y Programación, pp. 165–174.

  • Tversky A., Kahneman D. (1974), Judgement under uncertainty: heuristics and biases. Science 185, 1124–1131

    Article  Google Scholar 

  • Weber, G. and Specht, M.: 1997, User modeling and adaptive navigation support in WWW-based tutoring systems. In: A. Jameson, C. Paris and C. Tasso (eds.): Proceedings of the 6th International Conference on User Modeling. New York: Springer, pp. 289–300.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Matthias Nückles.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Nückles, M., Winter, A., Wittwer, J. et al. How do Experts Adapt their Explanations to a Layperson’s Knowledge in Asynchronous Communication? An Experimental Study. User Model User-Adap Inter 16, 87–127 (2006). https://doi.org/10.1007/s11257-006-9000-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11257-006-9000-y

Keywords

Navigation