Skip to main content

The TASTE Approach: General Implicit Solutions in Multiple Choice Questions (MCQs), Open Books Exams and Interactive Testing

  • Conference paper
Item Banking: Interactive Testing and Self-Assessment

Part of the book series: NATO ASI Series ((NATO ASI F,volume 112))

Abstract

The efficiency of school to efficiently train in higher order cognitive skills is sometimes questioned. Principles and techniques (such as open books exams, implicit questioning, self assessment) have been developed to enhance cognitive vigilance, data processing skills and metacognition. The details of those techniques are provided as well as some results about question characteristics and Student opinions. Further developments are considered and perspectivized with ambitious training and assessment goals.

TASTE is an anonym that means “Towards an Adult System of Training and Evaluation”. Its rationale and components will be described hereafter.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Barras, H.(1992), QCM sur Minitel en EAD: vers l’automatisation, in Weber & Dumont “Les questionnaires automatisables”,Marne-la-Vallée: Colloque de l’ESIEE

    Google Scholar 

  • Boxus, E. (1988a), Les QCM àsolutions générales auservice de l’évaluationà livre ouvert,in Actes du Colloque International “Formation, Evaluation, SélectionparQuestionnairesFermés”, Marne-la-Vallée: ESIEE,vol. 1, 318–331

    Google Scholar 

  • Boxus, E. (1988b), Vers desexamens à livre(s)ouvert(s)? In Le défi pédagogiquedel’enseignementsupérieur, Actesdu Congrés de l’Association Internationale de PédagogieUniversitaire, Montréal: AIPU, 533–537

    Google Scholar 

  • Boxus, E. (1992), Check: unebanque de questions interactives, in Weber & Dumont: questionnementsautomatisables, Colloque International ESIEE: Marne-la-Vallee, 29–49

    Google Scholar 

  • Boxus, E., Leclercq, D.Osterrieth, S., Wuidar, H. (1991), Principes communs pour évaluerles réultatscognitifs de la formation, Bruxelles: Commission des Communauteseuropéennes,EUROTECNET

    Google Scholar 

  • Bruno, J. & Baxter, J. (1989),An application of information reference testing. Proceedingsof the Sixth International Conference on Technology and Education, Orlando,vol. 2, 191–192

    Google Scholar 

  • Bruno, J.E. (1987), Using MCW-APMtest scoring to evaluate economics curricula. Journalof Computer Boxed Instruction

    Google Scholar 

  • Bruno J.E.(1990), Confidence contour tests item analysis with information referenced testing. Paper presented at the Seventh InternationalConference on Technology and Education, Brussels

    Google Scholar 

  • Bruno, J.E., Baker, J.B. (1989),Computer assisted learning through technology based classroomformative evaluation: an application of information referenced testing. Proceedingsof the Sixth International Conference on Technology and Education, vol. 2,Orlando, Florida

    Google Scholar 

  • Bruno, J.E. (1993), Using testingto provide feedback to support Instruction: a reexaminationof the role of assessment in educational organizations. In Leclercq & Bruno(eds.), Item banking: interactive testing and self-assessment. NATO ASI Series F,Vol. 112. Berlin: Springer-Verlag (this volume)

    Google Scholar 

  • Choppin, B. (1970), An IEA studyof guessing. A proposal. Stockholm, International Associationfor the Evaluation of Educational Achievement. Unpublished memorandum,IEA/TR/9

    Google Scholar 

  • De Finetti, B. (1965), Methods fordiscriminating levels of partial knowledge concerninga test item. Brit. J. of Mathem. and Stat. Psych. 18, 87–123

    Article  Google Scholar 

  • De Landsheere, G. (1984), Evaluationcontinue et examens, Précis de Docimologie, Bruxelles:Labor

    Google Scholar 

  • Depover, C. (1987), L’ordinateurmédiad’enseignement, Bruxelles: De Boeck

    Google Scholar 

  • Descartes, R. (1628), Regles pour la conduite de lesprit

    Google Scholar 

  • Dressel, P. & Schmid, J. (1953), Some modifications of the multiple-choiceitems.Educational and Psychological Measurement 13, 574–595

    Article  Google Scholar 

  • Dudley, H.A.F. (1973),Multiple-choice tests. Lancet 2, 195

    Article  Google Scholar 

  • Dudycha, A.L. & Carpenter, J.B. (1973), Effects ofitem format on item discrimination and difficulty. J. ApplicationPsychology 58, 11–121

    Google Scholar 

  • Dumont,B., Lazerges, J.M. (1992), Des QCM té1ématiques en mathématiquespourpréparer un concours d’entrée dans une école d’ingénieur, in Weber & Dumont, “Les questionnaires Automatisables”, Marne-la-Vallée : Colloque de l’ESIEE

    Google Scholar 

  • Fahre,J.M. (1975), Docimologie expérimentale et évaluationpar questionnaires : éitude du jugementmultiple et de l’autopondération, Thèse dedoctorat de troisème cycle enpsychologie, Université deProvence, ronéotypé

    Google Scholar 

  • Fabre,J.M. et Noizet, G. (1977a), Confiance attachée aux réponses à desquestions à choixmultiple, Journal de Psychologie Normale et Pathologique, 74, 335–362

    Google Scholar 

  • Halleux-Hendrick,J. (1969b), Construction des questions à choix multiple: une seule Solutioncorrecte?, in Revue Beige de Psychologie et de Pédagogie, Tome XXXI, n°127,113–125, Bruxelles

    Google Scholar 

  • Hughes,H. & Trimble, E. (1965), The use of complex alternatives in multiple-choice items.Education and Psychology Measurement 25, 1

    Google Scholar 

  • Hunt,D.P. (1993), Human self-assessment — theory and application to learning and testing.In Leclercq & Bruno (eds.). Item Banking: Interactive Testing and Self-Assessment.NATO ASI Series F, Vol. 112. Berlin: Springer-Verlag (this volume)

    Google Scholar 

  • Kagan,J., Impulsive and reflective children: significance of conceptual tempo. In J. Krumboltz(ed.), Learning and the Educational Process. Chicago: Rand McNally, 133-161

    Google Scholar 

  • Karraker,R.J. (1967), Knowledge of results and incorrect recall of plausible multiplechoicealternatives. J. Education Psychology 58, 11–14

    Article  Google Scholar 

  • Keller,F. & Sherman, G. (1974), The Keller Plan Handbook. Menlo Park, CA: W.H. Benjamin

    Google Scholar 

  • Keller,F. (1968), Goodbye teacher. J. Applied Behaviour Analysis 1, 78–89

    Google Scholar 

  • Lambert, F. (1992), Evaluation interactiveinformatisée et auto-évaluation, graduation Dissertation,Faculty of Psychology and Education, University of Liege

    Google Scholar 

  • Leclercq, D. (1980), Computerised tailored testing:structured and calibrated item banks forsummative and formation evaluation. European Journal of Education 15(3), 521–260

    Article  MathSciNet  Google Scholar 

  • Leclercq,D. (1983), Confidence marking, its use in testing. In B. Choppin and N. Postlethwaite(eds.), Evaluation Education, an International Review Series, 6(2), 161–287n

    Google Scholar 

  • Leclercq, D. (1986), Laconception des Questions à Choix Multiple, Bruxelles:Labor.

    Google Scholar 

  • Leclercq, D. (1987), Qualité des questions etsignification des scores, Bruxelles: Labor

    Google Scholar 

  • Leclercq, D. (mars 1988), Mesurer laconnaissance partielle et le réalisme par les degré decertitude, in Actes du Colloque International “Formation, Evaluation, Sé1ection parQuestionnaires Fermés”,Marne-la-Vallée, vol.1, 306–316

    Google Scholar 

  • Leclercq, D. & DeBrogniez, P. (1990), A fresh look on confidence marking. In Estes, Heene andLeclercq (eds.), New pathways to learning through educational technology.Proceedings of the Seventh International Conference on Technology andEducation (ICTE), Brussels, March 1990, vol. 1, 646–649

    Google Scholar 

  • Lindley, D. (1971), MakingDecisions. London: Wiley

    Google Scholar 

  • Luce,R. Raiffa, H. (1966), Games andDecision. New York: Wiley

    Google Scholar 

  • Luce, R. (1959), Individual Choice Behavior. New York: Wiley

    MATH  Google Scholar 

  • Massengill, H. & Shufford, E. (1967), What pupils and teachers should knowabout guessing. Technical Report SMC R-7, Lexington, MA

    Google Scholar 

  • Noizet, G. & Caverni, J.P. (1978), Psychologie de l’évaluationscolaire, Paris:PUF

    Google Scholar 

  • Noizet, G. & Fabre, J.M. (1975), Etude docimologique des questionnaires à choix multiple(QCM) : Perspectives de recherche, Scientia Peadagogica Experimentalis, vol. 12,38–62

    Google Scholar 

  • Pitz, G.F. (1974), Subjectiveprobability distribution for imperfectly known quantities. In L. W. Gregg (ed.), Knowledge andCognition. New York: Wiley

    Google Scholar 

  • Pyrczak, F. (1972), Objectiveevaluation of the quality of multiple-choice test items designed to measure comprehension of reading passages.Read. Res. Quart. 8, 62–71

    Article  Google Scholar 

  • Pyrczak, F. (1974),Passage-dependance of items designed to measure the ability to identifythe main ideas of paragraphs: Implications for validity. Educational and PsychologicalMeasurement 34, 343–348

    Google Scholar 

  • Savage, J. (1971), Elicitation ofpersonal probabilities and expectations. J. American StatisticalAssociation 66, 336, 783–801

    Article  MathSciNet  MATH  Google Scholar 

  • Shuford, E., Albert &Massengill, N.E. (1966), Admissible probability measurement procedures.Psychometrika. 31, 125–145

    Article  MATH  Google Scholar 

  • Shuford, E. (1993), In pursuit ofthe fallacy: resurrecting the penalty. In Leclercq & Bruno(eds.), Item Banking: Interactive Testing and Self-Assessment. NATO ASI Series F,Vol. 112. Berlin: Springer-Verlag (this volume)

    Google Scholar 

  • Slakter, M., Koehler, R. &Hampton, S. (1970), Learning test-wiseness by programmedtexts. J. Educational Measurement 7, 247–254

    Article  Google Scholar 

  • Smith, R. (1970), An empiricalinvestigation of complexity and process in multiplechoice items. J. EducationalMeasurement 7, 33–41

    Google Scholar 

  • Strang, H.R. & Rust, J.O. (1973), The effects of immediate knowledge ofresults andtaskdefinition on multiple-choice answering. J. Experimental Education 42, 77–80

    Google Scholar 

  • Strang, H.R. (1977), The effect oftechnical and unfamiliar options on guessing on multiple-choicetest items. J. Educational Measurement 14, 253–259

    Article  Google Scholar 

  • Tversky, A. & Kahneman, D.(1974), Judgment under uncertainty: Heuristics and biases.Science 185, 1124–1131

    Article  Google Scholar 

  • Von Neumann, J. & Morgenstern,O. (1974), Theory of games and economic behaviour.Princeton University Press

    Google Scholar 

  • Wahlstrom, M. & Boersma, F.(1968), The influence of test-wiseness upon achievementEducational and Psychological Measurement 28, 413–420

    Article  Google Scholar 

  • Williamson, M.L. & Hopkins,K.D. (1967), The use of “none of these” vs homogeneousalternatives on multiple-choice tests: Experimental reliability and vahditycomparisons. J. Educational Measurement 4, 53–58

    Article  Google Scholar 

  • Wood, R. (1974), Guessing onobjective type test items. School Science 56, 179–180

    Google Scholar 

  • Wood, R. (1976), Inhibiting blind guessing: the effect of instructions. J.EducationalMeasurement13, 297–307

    Google Scholar 

  • Wood, R. (1977), Multiple-choice:A State of the art report. In Choppin & Postlethwaite(eds.), Evaluation in Education International Progress. Oxford: Pergamon

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1993 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Leclercq, D., Boxus, E., de Brogniez, P., Wuidar, H., Lambert, F. (1993). The TASTE Approach: General Implicit Solutions in Multiple Choice Questions (MCQs), Open Books Exams and Interactive Testing. In: Leclercq, D.A., Bruno, J.E. (eds) Item Banking: Interactive Testing and Self-Assessment. NATO ASI Series, vol 112. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-58033-8_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-58033-8_17

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-63444-4

  • Online ISBN: 978-3-642-58033-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics