Skip to main content

Confrustion in Learning from Erroneous Examples: Does Type of Prompted Self-explanation Make a Difference?

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 11625))

Abstract

Confrustion, a mix of confusion and frustration sometimes experienced while grappling with instructional materials, is not necessarily detrimental to learning. Prior research has shown that studying erroneous examples can increase students’ experiences of confrustion, while at the same time helping them learn and overcome their misconceptions. In the study reported in this paper, we examined students’ knowledge and misconceptions about decimal numbers before and after they interacted with an intelligent tutoring system presenting either erroneous examples targeting misconceptions (erroneous example condition) or practice problems targeting the same misconceptions (problem-solving condition). While students in both conditions significantly improved their performance from pretest to posttest, students in the problem-solving condition improved significantly more and experienced significantly less confrustion. When controlling for confrustion levels, there were no differences in performance. This study is interesting in that, unlike prior studies, the higher confrustion that resulted from studying erroneous examples was not associated with better learning outcomes; instead, it was associated with poorer learning. We propose several possible explanations for this different outcome and hypothesize that revisions to the explanation prompts to make them more expert-like may have also made them – and the erroneous examples that they targeted – less understandable and less effective. Whether prompted self-explanation options should be modeled after the shorter, less precise language students tend to use or the longer, more precise language of experts is an open question, and an important one both for understanding the mechanisms of self-explanation and for designing self-explanation options deployed in instructional materials.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Adams, D., et al.: Using erroneous examples to improve mathematics learning with a web-based tutoring system. Comput. Hum. Behav. 36C, 401–411 (2014)

    Article  Google Scholar 

  2. Booth, J.L., Lange, K.E., Koedinger, K.R., Newton, K.J.: Using example problems to improve student learning in algebra: differentiating between correct and incorrect examples. Learn. Instr. 25, 24–34 (2013)

    Article  Google Scholar 

  3. Borasi, R.: Exploring mathematics through the analysis of errors. Learn. Math. 7(3), 2–8 (1987)

    Google Scholar 

  4. Isotani, S., Adams, D., Mayer, R.E., Durkin, K., Rittle-Johnson, B., McLaren, B.M.: Can erroneous examples help middle-school students learn decimals? In: Kloos, C.D., Gillet, D., Crespo García, R.M., Wild, F., Wolpers, M. (eds.) EC-TEL 2011. LNCS, vol. 6964, pp. 181–195. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-23985-4_15

    Chapter  Google Scholar 

  5. McLaren, B.M., Adams, D.M., Mayer, R.E.: Delayed learning effects with erroneous examples: a study of learning decimals with a web-based tutor. Int. J. Artif. Intell. Educ. 25(4), 520–542 (2015)

    Article  Google Scholar 

  6. Siegler, R.S.: Migrogenetic studies of self-explanation. In: Granott, N., Parziale, J. (eds.) Microdevelopment: Transition Processes in Development and Learning, pp. 31–58. Cambridge University Press, New York City (2002)

    Chapter  Google Scholar 

  7. Siegler, R.S., Chen, Z.: Differentiation and integration: guiding principles for analyzing cognitive change. Dev. Sci. 11(4), 433–448 (2008)

    Article  Google Scholar 

  8. Rushton, S.J.: Teaching and learning mathematics through error analysis. Fields Math. Educ. J. 3(1), 4 (2018)

    Article  Google Scholar 

  9. Durkin, K., Rittle-Johnson, B.: The effectiveness of using incorrect examples to support learning about decimal magnitude. Learn. Instr. 22(3), 206–214 (2012)

    Article  Google Scholar 

  10. Große, C.S., Renkl, A.: Finding and fixing errors in worked examples: can this foster learning outcomes? Learn. Instr. 17(6), 612–634 (2007)

    Article  Google Scholar 

  11. Bjork, R.A.: Memory and metamemory considerations in the training of human beings. In: Metcalfe, J., Shimamura, A. (eds.) Metacognition: Knowing about Knowing, pp. 185–205. MIT Press, Cambridge (1994)

    Google Scholar 

  12. Soderstrom, N.C., Bjork, R.A.: Learning versus performance: an integrative review. Perspect. Psychol. Sci. 10(2), 176–199 (2015)

    Article  Google Scholar 

  13. Kapur, M.: Productive failure in learning math. Cogn. Sci. 38(5), 1008–1022 (2014)

    Article  Google Scholar 

  14. Kapur, M., Bielaczyc, K.: Designing for productive failure. J. Learn. Sci. 21(1), 45–83 (2012)

    Article  Google Scholar 

  15. D’Mello, S.: A selective meta-analysis on the relative incidence of discrete affective states during learning with technology. J. Educ. Psychol. 105(4), 1082–1099 (2013)

    Article  Google Scholar 

  16. Rodrigo, M.M.T., et al.: Affective and behavioral predictors of novice programmer achievement. In: ACM SIGCSE, vol. 41, pp. 156–160. ACM Press, New York (2009)

    Google Scholar 

  17. Schneider, B., et al.: Investigating optimal learning moments in U.S. and Finnish science classes. J. Res. Sci. Teach. 53(3), 400–421 (2015)

    Article  Google Scholar 

  18. D’Mello, S., Lehman, B., Pekrun, R., Graesser, A.: Confusion can be beneficial for learning. Learn. Instr. 29, 153–170 (2014)

    Article  Google Scholar 

  19. Lehman, B., et al.: Inducing and tracking confusion with contradictions during complex learning. Int. J. Artif. Intell. Educ. 22(1-2), 85–105 (2013)

    Google Scholar 

  20. VanLehn, K., Siler, S., Murray, C., Yamauchi, T., Baggett, W.B.: Why do only some events cause learning during human tutoring? Cogn. Instr. 21(3), 209–249 (2003)

    Article  Google Scholar 

  21. D’Mello, S., Graesser, A.: Dynamics of affective states during complex learning. Learn. Instr. 22(2), 145–157 (2012)

    Article  Google Scholar 

  22. Liu, Z., Pataranutaporn, V., Ocumpaugh, J., Baker, R.S.J.D.: Sequences of frustration and confusion, and learning. In: EDM, pp. 114–120 (2013)

    Google Scholar 

  23. Kostyuk, V., Almeda, M.V., Baker, R.S.: Correlating affect and behavior in reasoning mind with state test achievement. In: LAK, p. 26 (2018)

    Google Scholar 

  24. Pardos, Z.A., Baker, R.S., San Pedro, M., Gowda, S.M., Gowda, S.M.: Affective states and state tests: investigating how affect and engagement during the school year predict end-of-year learning outcomes. J. Learn. Anal. 1(1), 107–128 (2014)

    Article  Google Scholar 

  25. Ocumpaugh, J., Baker, R.S., Rodrigo, M.M.T.: Baker rodrigo ocumpaugh monitoring protocol (BROMP) 2.0 Technical and Training Manual. Technical Report. Teachers College, Columbia University, New York, NY. Ateneo Laboratory for the Learning Sciences, Manila, Philippines (2015)

    Google Scholar 

  26. Baker, R.S.J.D., Corbett, A.T., Wagner, A.Z.: Human classification of low-fidelity replays of student actions. In: EDM-ITS, pp. 29–36 (2006)

    Google Scholar 

  27. Lee, D.M.C., Rodrigo, M.M.T., Baker, R.S.J.D., Sugay, J.O., Coronel, A.: Exploring the relationship between novice programmer confusion and achievement. In: D’Mello, S., Graesser, A., Schuller, B., Martin, J.-C. (eds.) ACII 2011. LNCS, vol. 6974, pp. 175–184. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-24600-5_21

    Chapter  Google Scholar 

  28. Sao Pedro, M.A., de Baker, R.S., Gobert, J.D., Montalvo, O., Nakama, A.: Leveraging machine-learned detectors of systematic inquiry behavior to estimate and predict transfer of inquiry skill. User Model. User-Adap. Inter. 23(1), 1–39 (2013)

    Article  Google Scholar 

  29. Resnick, L.B., Nesher, P., Leonard, F., Magone, M., Omanson, S., Peled, I.: Conceptual bases of arithmetic errors: the case of decimal fractions. J. Res. Math. Educ. 20, 8–27 (1989)

    Article  Google Scholar 

  30. Sackur-Grisvard, C., Léonard, F.: Intermediate cognitive organizations in the process of learning a mathematical concept: the order of positive decimal numbers. Cogn. Instr. 2, 157–174 (1985)

    Article  Google Scholar 

  31. Stacey, K.: Travelling the road to expertise: a longitudinal study of learning. PME 1, 19–36 (2005)

    Google Scholar 

  32. Authors (under review)

    Google Scholar 

  33. Chi, M.T.H., de Leeuw, N., Chiu, M., LaVancher, C.: Eliciting self-explanations improves understanding. Cogn. Sci. 18, 439–477 (1994)

    Google Scholar 

  34. Rittle-Johnson, B., Loehr, A.M., Durkin, K.: Promoting self-explanation to improve mathematics learning: a meta-analysis and instructional design principles. ZDM 49(4), 599–611 (2017)

    Article  Google Scholar 

  35. Johnson, C.I., Mayer, R.E.: Adding the self-explanation principle to multimedia learning in a computer-based game-like environment. Comput. Hum. Behav. 26, 1246–1252 (2010)

    Article  Google Scholar 

  36. Mayer, R.E., Johnson, C.I.: Adding instructional features that promote learning in a game-like environment. J. Educ. Comput. Res. 42, 241–265 (2010)

    Article  Google Scholar 

  37. Aleven, V., McLaren, B.M., Sewall, J.: Scaling up programming by demonstration for intelligent tutoring systems development: an open-access website for middle school mathematics learning. IEEE Trans. Learn. Technol. 2(2), 64–78 (2009)

    Article  Google Scholar 

  38. Kalyuga, S., Chandler, P., Tuovinen, J., Sweller, J.: When problem solving is superior to studying worked examples. J. Educ. Psychol. 93, 579–588 (2001)

    Article  Google Scholar 

  39. Chen, T., Guestrin, C.: XGBoost: a scalable tree boosting system. In: ACM-SIGKKD, pp. 785–794 (2016)

    Google Scholar 

  40. Hayes, A.F.: Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-Based Approach. Guilford Press, New York (2013)

    Google Scholar 

  41. Hausmann, R.G., Vanlehn, K.: Explaining self-explaining: a contrast between content and generation. Front. Artif. Intell. Appl. 158, 417–424 (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to J. Elizabeth Richey .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Richey, J.E. et al. (2019). Confrustion in Learning from Erroneous Examples: Does Type of Prompted Self-explanation Make a Difference?. In: Isotani, S., Millán, E., Ogan, A., Hastings, P., McLaren, B., Luckin, R. (eds) Artificial Intelligence in Education. AIED 2019. Lecture Notes in Computer Science(), vol 11625. Springer, Cham. https://doi.org/10.1007/978-3-030-23204-7_37

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-23204-7_37

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-23203-0

  • Online ISBN: 978-3-030-23204-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics