Skip to main content
SpringerLink
Log in

Discovering Error Classes from Discrepancies in Novice Behaviors Via Multistrategy Conceptual Clustering

  • Published:
User Modeling and User-Adapted Interaction Aims and scope Submit manuscript

Abstract

The automatic discovery of classes of errors that represent misconceptions and other knowledge errors underlying discrepancies in novice behavior is not a trivial task. A novel approach to this problem is described, in which relationships among behavioral discrepancies are analyzed and inductively generalized via an unsupervised, incremental, relational multistrategy conceptual clustering method that takes into account similarities as well as causalities in the data. Performance results on the classification of discrepancy sets and discovery of error classes from discrepancies of buggy PROLOG programs demonstrate the potential of the approach.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Anderson, J.: 1983, The Architecture of Cognition. Cambridge, MA: Harvard University Press.

    Google Scholar 

  • Anderson, J.: 1993, Rules of the Mind. Hillsdale, NJ: Erlbaum.

    Google Scholar 

  • Anderson, J., Boyle, C., Corbett, A. and Lewis, M.: 1990, Cognitive modeling and intelligent tutoring. Artificial Intelligence 42, 7-49.

    Google Scholar 

  • Baffes, P. and Mooney, R.: 1996, Refinement-based student modeling and automated bug library construction. Journal of Artificial Intelligence in Education 7(1), 75-116.

    Google Scholar 

  • Bransford, J., Vye, N., Adams, L. and Perfetto, G.: 1989, Learning skills and the acquisition of knowledge. In: A. Lesgold and R. Glaser (eds.) Foundations for a Psychology of Education. Hillsdale, New Jersey: Lawrence Erlbaum.

    Google Scholar 

  • Bratko, I.: 1990, PROLOG Programming for Artificial Intelligence. Menlo Park, CA: Addison-Wesley.

    Google Scholar 

  • Brown, J. and VanLehn, K.: 1980, Repair theory: A generative theory of bugs in procedural skills. Cognitive Science 4, 379-426.

    Google Scholar 

  • Corder, S.: 1967, The significance of learners errors. International Review of Applied Linguistics 5, 161-170.

    Google Scholar 

  • Fisher, D.: 1987, Knowledge acquisition via incremental conceptual clustering. Machine Learning 2, 139-172.

    Google Scholar 

  • Gegg-Harrison, T.: 1994, Exploiting program schemata in an automated program Debugger. Journal of Artificial Intelligence in Education 5(2), 255-278.

    Google Scholar 

  • Gluck, M. and Corter, J.: 1985, Information, uncertainty, and the utility of categories. In: Proceedings of the Seventh Annual Conference of the Cognitive Science Society, pp. 283-287.

  • Hume, G., Michael, J., Rovick, A. and Evans, M.: 1993, The use of hints as a tutorial tactic. In: Proceedings of the Fifteenth Annual Conference of the Cognitive Science Society, pp. 563-568.

  • Johnson, W.: 1990, Understanding and debugging novice programs. Artificial Intelligence 42, 51-97.

    Google Scholar 

  • Kono, Y., Ikeda, M. and Mizoguchi, R.: 1994, THEMIS: A nonmonotonic inductive student modeling system. Journal of Artificial Intelligence in Education 5(3), 371-413.

    Google Scholar 

  • Langley, P. and Ohlsson, S.: 1984, Automated cognitive modeling. In: Proceedings of the Second National Conference on Artificial Intelligence, pp. 193-197.

  • Lebowitz, M.: 1986, Integrated learning: Controlling explanation. Cognitive Science 10, 219-240.

    Google Scholar 

  • Lebowitz, M.: 1987, Experiments with incremental concept formation: UNIMEM. Machine Learning 2, 103-138.

    Google Scholar 

  • Looi, C.: 1991, Automatic debugging of PROLOG programs in a PROLOG intelligent tutoring system. Instructional Science 20, 215-263.

    Google Scholar 

  • Markman, A. and Gentner, D.: 1993, All differences are not created equal: A structural alignment view of similarity. In: Proceedings of the Fifteenth Annual Conference of the Cognitive Science Society. pp. 682-686.

  • Muggleton, S. and Feng, C.: 1990, Efficient induction of logic programs. In: Proceedings of the Conference on Algorithmic Learning Theory. Ohmsha.

  • Murray, W.: 1987, Automatic program debugging for intelligent tutoring systems. Computational Intelligence 3, 1-16.

    Google Scholar 

  • Newell, A.: 1989, Unified Theories of Cognition. Hillsdale, NJ: Harvard University Press.

    Google Scholar 

  • Pazzani, M.: 1993, Learning causal patterns: Making a transition from data-driven to theory-driven learning. Machine Learning 11(2/3), 173-194.

    Google Scholar 

  • Plotkin, G.: 1970, A note on inductive generalization. Machine Intelligence 5, 153-63.

    Google Scholar 

  • Shuell, T.: 1986, Cognitive conceptions of learning. Review of Educational Research 56, 411-436.

    Google Scholar 

  • Sison, R., Numao, M. and Shimura, M.: 1997a, On using theory and data in misconception discovery. In: Proceedings of the Nineteenth Annual Conference of the Cognitive Science Society, pp. 692-696.

  • Sison, R., Numao, M. and Shimura, M.: 1997b, Using data and theory in multistrategy (mis)concept(ion) discovery. In: Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence, pp. 274-279.

  • Sleeman, D.: 1987, PIXIE: A shell for developing intelligent tutoring systems. In: R. Lawler and M. Yazdani (eds.): Artificial Intelligence in Education. New Jersey: Ablex.

    Google Scholar 

  • Sleeman, D., Hirsh, H., Ellery, I. and Kim, I.: 1990, Extending domain theories: two case studies in student modeling. Machine Learning 5, 11-37.

    Google Scholar 

  • Sterling, L. and Shapiro, E.: 1986, The Art of Prolog. Cambridge, MA: MIT Press.

    Google Scholar 

  • Thompson, K. and Langley, P.: 1991, Concept formation in structured domains. In: D. Fisher, M. Pazzani, and P. Langley (eds.): Concept Formation: Knowledge and Experience in Unsupervised Learning. San Mateo, CA: Morgan Kaufmann.

    Google Scholar 

  • Tversky, A.: 1977, Features of similarity. Psychological Review 84(4), 327-352.

    Google Scholar 

  • VanLehn, K.: 1983, Human procedural skill acquisition: Theory, model and psychological validation. In: Proceedings of the National Conference on Artificial Intelligence, pp. 420-423.

  • VanLehn, K.: 1987, Learning one procedure per lesson. Machine Learning 31(1), 1-40.

    Google Scholar 

  • Webb, G. and Kuzmycz, M.: 1996, Feature based modelling: A methodology for producing coherent, consistent, dynamically changing models of agents competencies. User Modeling and User-Adapted Interaction 5(2), 117-150.

    Google Scholar 

  • Weber, G.: 1996, Episodic learner modeling. Cognitive Science 20, 195-236.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Tokyo Institute of Technology, Japan

    Raymund Sison & Masayuki Numao

  2. Department of Industrial Administration, Science University of Tokyo, Japan

    Masamichi Shimura

Authors
  1. Raymund Sison
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Masayuki Numao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Masamichi Shimura
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sison, R., Numao, M. & Shimura, M. Discovering Error Classes from Discrepancies in Novice Behaviors Via Multistrategy Conceptual Clustering. User Modeling and User-Adapted Interaction 8, 103–129 (1998). https://doi.org/10.1023/A:1008225015395

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1008225015395

Search

Navigation