Skip to main content

It’s What You Ask and How You Ask It: An Itemmetric Analysis of Personality Questionnaires

  • Chapter
Personality Assessment via Questionnaires

Abstract

Items from personality questionnaires have long been the butt of humorists and jaded graduate students. What makes these satirical items so funny is that they are instantaneously recognizable as having the correct form and yet their content is patently absurd. The fact that these items succeed as jokes suggests that at least for those familiar with personality scales there are some standard forms for items. This chapter describes three sets of formal item characteristics and demonstrates that the psychometric quality of personality items depends not only on content but also on form.

“The sight of blood no longer excites me.”

“When I was a child, I was an imaginary playmate.”

“I become homicidal when people try to reason with me.”

“It’s hard to concentrate in a room full of mice.”

Order of authorship is alphabetical; this chapter represents a fully collaborative effort by the three authors, based in pari on a paper delivered at the Bielefeld Symposium on Personality Questionnaires, which was held at the Center for Interdisciplinary Research, University of Bielefeld, June 17–20, 1982. Some of the analyses presented in this chapter are based on Franz-Josef Lohr’s PhD dissertation (in preparation), a complete report of which may appear elsewhere.

We are grateful to Peter Borkenau, David Buss, William F. Chaplin, Donald Fiske, Sarah Hampson, Willem Hofstee, and Wolf Nowack for their comments on earlier drafts, and especially to Lewis R. Goldberg, the master wordsmith, whose untiring efforts helped improve the readability of this chapter considerably. Our research was supported by the Deutsche Forschungsgemeinschaft (DFG) An 105/1-3. Funds for the support of the second author during the writing of this report were provided in part by Grant MH-39077 from the National Institute of Mental Health (U.S. Public Health Service).

With the exception of the fourth statement, these “items” were written by Art Buchwald, the noted American humorist (as cited in Goldberg. 1974).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 16.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Allport, F.H. (1937). Teleonomic description in the study of personality. Character and Personality, 6, 202–214.

    Google Scholar 

  • Allport, G.W., & Odbert, H.S. (1936). Trait-names: A psycholexical study. Psychological Monographs, 47 (1, Whole No. 211).

    Google Scholar 

  • Amelang, M., Sommer, E., & Bartussek, D. (1971). Persönlichkeitsstruktur und Studienrichtung. Psychologische Beiträge, 13, 7–15.

    Google Scholar 

  • Angleitner, A. (1976). Methodische und theoretische Probleme bei Persönlichkeitsfragebogen unter besonderer Berücksichtigung neuerer deutsch-sprachiger Fragenbogen. Bonn: Habilitationsschrift, Psychologisches Institut der Universität Bonn.

    Google Scholar 

  • Angleitner, A. (1981 a). Teststatistische Kennwerte der Items aus 10 deutschsprachigen Persönlichkeitsfragebogen. Bielefeld: Arbeitsberichte aus dem Projekt Persönlichkeitsfragebogen (No. 2), Universität Bielefeld.

    Google Scholar 

  • Angleitner, A. (1981 b). Teststatistische Kennwerte der Items aus 8 deutschsprachigen Persön-lichkeitsfragenbogenfûr Kinder und Jugendliche. Bielefeld: Arbeitsberichte aus dem Projekt Persönlichkeitsfragebogen (No. 3), Universität Bielefeld.

    Google Scholar 

  • Angleitner, A., & Löhr, F.J. (1980). Itemüberlappung zwischen Persönlichkeitsfragebogen als Problem für Validitätsschätzungen. Zeitschrift für Differentielle und Diagnostische Psychologie, 1, 127–136.

    Google Scholar 

  • Ashton, S.G., & Goldberg, L.R. (1973). In response to Jackson’s challenge: The comparative validity of personaüty scales constructed by the external (empirical) strategy and scales developed intuitively by experts, novices, and laymen. Journal of Research in Personality, 7, 1–20.

    Google Scholar 

  • Bartussek, D., Weise, G., & Heinze, B. (1972). Reliabilität und faktonelle Vahditat des deutschen 16 PF-Tests von Cattell. Arbeiten aus dem psychologischen Institut der Universität Hamburg, 19.

    Google Scholar 

  • Beckmann, D., & Richter, H.E. (1972). Giessen-Test (GT). Ein Test für Individual-und Gruppendiagnostik. Handbuch. Bern: Huber.

    Google Scholar 

  • Bellezza, F.S. (1984). Reliability of retrieval from semantic memory: Noun meanings. Bulletin of the Psychonomic Society, 22, 377–380.

    Google Scholar 

  • Buss, D.M., & Craik, K.H. (1980). The frequency concept of disposition: Dominance and prototypically dominant acts. Journal of Personality, 48, 379–392.

    Google Scholar 

  • Buss, D.M., & Craik, K.H. (1983). The act frequency approach to personality. Psychological Review, 90, 105–126.

    Google Scholar 

  • Cantor, N. (1981). Perceptions of situations: Situations prototypes and person-situation prototypes. In Magnusson, D. (Ed.), Toward a psychology of situations: An interactional perspective. Hillsdale: Erlbaum.

    Google Scholar 

  • Cantor, N., Mischel, W., & Schwartz, J.C. (1981). Social knowledge: Structure, content, use and abuse. In Hastorf, A., & Isen, A. (Eds.), Cognitive social psychology. New York: Elsevier/North Holland.

    Google Scholar 

  • Cantor, N., Mischel, W., & Schwartz, J.C. (1982). A prototype analysis of psychological situations. Cognitive Psychology, 14, 45–77.

    Google Scholar 

  • Cattell, R.B. (1943). The description of personality: 2. Basic traits resolved into clusters. Journal of Abnormal and Social Psychology, 38, 476–507.

    Google Scholar 

  • Cattell, R.B. (1946). Description and measurement of personality. New York: World Book.

    Google Scholar 

  • Cattell, R.B. (1957). Personality andmotivation structure and measurement. New York: World Book.

    Google Scholar 

  • Cattell, R.B. (1973). Personality and mood by questionnaire. San Francisco: Jossey-Bass.

    Google Scholar 

  • Cattell, R.B., & Eber, H.W. (1962). Specimen set for the Sixteen Personality Factor Questionnaire “16 PF”, experimental edition der deutschen Form A und B. Champaign: Institute for Personality and Ability Testing.

    Google Scholar 

  • Cattell, R.B., & Eber, H.W. (1964). The Sixteen Personality Factor Questionnaire. Champaign: Institute for Personality and Ability Testing.

    Google Scholar 

  • Chomsky, N. (1965). Aspects of the theory of syntax. Cambridge, Mass.: M.I.T. Press.

    Google Scholar 

  • Cliff, N., Bradley, P., & Girard, R. (1973). The investigation of cognitive models for inventory response. Multivariate Behavioral Research, 8, 407–425.

    Google Scholar 

  • Cronbach, L.J. (1970). Essentials of psychological testing. New York: Harper & Row.

    Google Scholar 

  • Dubois, B., & Burnes, J.A. (1975). An analysis of the meaning of the question mark response-category in attitude scales. Educational and Psychological Measurement, 35, 869–884.

    Google Scholar 

  • Edwards, A.L. (1957). The social desirability variable in personality assessment and research. New York: Dryden.

    Google Scholar 

  • Eggert, D. (1974). Eysenck-Persönlichkeits-Inventar (EPI). Handanweisung für die Durchführung und Auswertung. Göttingen: Hogrefe.

    Google Scholar 

  • Eysenck, H.J. (1947). Dimensions of personality. London: Routledge & Kegan Paul.

    Google Scholar 

  • Eysenck, H.J. (1953). Fragebogen als Meßmittel der Persönlichkeit: Eine experimentelle Untersuchung. Zeitschrift für experimentelle und angewandte Psychologie, 1, 191–335.

    Google Scholar 

  • Eysenck, H.J. (1959a). Das “Maudsley Personality Inventory” (MPI). Göttingen: Hogrefe.

    Google Scholar 

  • Eysenck, H.J. (1959 b). Der Maudsley Personality Inventory als Bestimmer der neurotischen Tendenz und Extraversion. Zeitschrift für experimentelle und angewandte Psychologie, 6, 167–190.

    Google Scholar 

  • Eysenck, H.J. (1962). The Maudsley Personality Inventory. (Manual prepared by R.R. Knapp). San Diego: Educational and Industrial Testing Service.

    Google Scholar 

  • Eysenck, H.J. (1964). MMQ. Göttingen: Hogrefe.

    Google Scholar 

  • Eysenck, H.J., & Eysenck, S. (1964). Manual of the Eysenck Personality Inventory. London: University of London Press.

    Google Scholar 

  • Fahrenberg, J., & Selg, H. (1970). Das Freiburger Persönlichkeitsinventar (FPI) -Handanweisung. Göttingen: Hogrefe.

    Google Scholar 

  • Fillmore, C J. (1977). The case for case reopened. In Cole, P., & Sadock, J. (Eds.), Grammatical relations (pp. 59–81). New York: Academic.

    Google Scholar 

  • Fiske, D.W. (1971). Measuring the concepts of personality. Chicago: Aldine.

    Google Scholar 

  • Fiske, D.W. (1981). New directions for methodology of social and behavioral science: Problems with language imprecision. San Francisco: Jossey-Bass.

    Google Scholar 

  • Forgas, J.P. (1982). Episode cognition: Internal representations of interaction routines. In Berkowitz, L. (Ed.), Advances in experimental social psychology (Vol. 15). New York: Academic.

    Google Scholar 

  • Foss, D.J., Hakes, D.J., & Hakes, D.T. (1978). Psycholinguistics. Englewood Cliffs: Prentice Hall.

    Google Scholar 

  • Givon, T. (1979). Syntax and semantics 12: Discourse and syntax. New York: Academic.

    Google Scholar 

  • Goldberg, L.R. (1963). A model of item ambiguity in personality assessment. Educational and Psychological Measurement, 23, 467–492.

    Google Scholar 

  • Goldberg, L.R. (1968). The interrelationships among item characteristics in an adjective checklist: The convergence of different indices of item ambiguity. Educational and Psychological Measurement, 28, 273–296.

    Google Scholar 

  • Goldberg, L.R. (1971). A historical survey of personality scales and inventories. In McRey-nolds, P. (Ed.), Advances in psychological assessment (Vol. 2, pp. 293–336). Palo Alto: Science and Behavior.

    Google Scholar 

  • Goldberg, L.R. (1972). Some recent trends in personality assessment. Journal of Personality Assessment, 36, 547–560.

    PubMed  Google Scholar 

  • Goldberg, L.R. (1974). Objective diagnostic tests and measures. Annual Review of Psychology, 25, 343–366.

    PubMed  Google Scholar 

  • Goldberg, L.R. (1978). Differential attribution of trait-descriptive terms to oneself as compared to well-liked, neutral, and disliked others: A psychometric analysis. Journal of Personality and Social Psychology, 36, 1012–1028.

    Google Scholar 

  • Goldberg, L.R. (1980, May). Some ruminations about the structure of individual differences: Developing a common lexicon for the major characteristics of human personahty. Meetings of the Western Psychological Association, Honolulu, Hawaii.

    Google Scholar 

  • Goldberg, L.R. (1981 a). Language and individual differences: The search for universals in personahty lexicons. Review of Personality and Social Psychology, 41(2), 141–165.

    Google Scholar 

  • Goldberg, L.R. (1981b). Unconfounding situational attributions from uncertain, neutral, and ambiguous ones: A psychometric analysis of descriptions of oneself and various types of others. Journal of Personality and Social Psychology, 41(3), 517–552.

    Google Scholar 

  • Goldberg, L.R. (1982). From Ace to Zombie: Some explorations in the language of personality. In Spielberger, L.D., & Butcher, J.N. (Eds.), Advances in personality assessment (Vol. 1). Hillsdale: Erlbaum.

    Google Scholar 

  • Goldberg, L.R., & Slovic, P. (1967). Importance of test item content: An analysis of a corollary of the deviation hypothesis. Journal of Counseling Psychology, 14, 462–472.

    Google Scholar 

  • Gorsuch, R.G., & Cattell, R.B. (1967). Second stratum personality factors defined in the questionnaire realm by the 16 PF. Multivariate Behavioral Research, 2, 211–224.

    Google Scholar 

  • Gough, H.G. (1957). Manual for the California Psychological Inventory. Palo Alto: Consulting Psychologists.

    Google Scholar 

  • Gough, H.G. (1965). Conceptual analysis of psychological test scores and other diagnostic variables. Journal of Abnormal Psychology, 70, 294–302.

    PubMed  Google Scholar 

  • Green, B.F., Jr. (1978). In defense of measurement. American Psychologist, 33, 664–670.

    Google Scholar 

  • Hampshire, S. (1953). Dispositions. Analysis, 14, 5–11.

    Google Scholar 

  • Hampson, S.E. (1982). Person memory: A semantic category model of personality traits. British Journal of Psychology, 73, 1–11.

    Google Scholar 

  • Hathaway, S.R., & McKinley, J.C. (1943). Manual for the Minnesota Multiphasic Personality Inventory. New York: Psychological Corporation.

    Google Scholar 

  • Hull, J.G., & Levy, A.S. (1979). The organizational functions of the self: An alternative to the Duval and Wicklund model of self-awareness. Journal of Personality and Social Psychology, 37, 756–768.

    Google Scholar 

  • Jackson, D.N. (1967). Personality research form. Manual. Goshen: Research Psychologists.

    Google Scholar 

  • Jackson, D.N. (1970). A sequential system for personality scale development. In Spielberger, CD. (Ed.), Current topis in clinical and community psychology (Vol.2, pp.61–96). New York: Academic.

    Google Scholar 

  • Jackson, D.N. (1971). The dynamics of structured personahty tests: 1971. Psychological Review, 78, 229–248.

    Google Scholar 

  • Jackson, D.N. (1975). The relative validity of scales prepared by naive item writers and those based on empirical methods of personality scale construction. Educational and Psychological Measurement, 35, 361–370.

    Google Scholar 

  • Janke, W. (1973). Das Dilemma von Persönlichkeitsfragebogen. Einleitung des Symposiums über Konstruktion von Fragebogen. In Reinhart, G. (Ed.), Bericht über den 27. Kongreß der Deutschen Gesellschaft für Psychologie in Kiel 1970. Göttingen: Hogrefe.

    Google Scholar 

  • John, O.P., Goldberg, L.R., & Angleitner, A. (1984). Better than the alphabet: Taxonomies of personality-descriptive terms in English, Dutch, and German. In Bonarius, H.M., Van Heck, G., & Smid, N. (Eds.), Personality psychology in Europe: Theoretical and empirical developments. Lisse: Swets & Zeitlinger.

    Google Scholar 

  • Jones, R.R. (1965). The relationships between item properties and scale reliability. Oregon Research Institute Research Monograph, 5 (No. 1).

    Google Scholar 

  • Jones, R.R. (1968, August). Differences in response consistency and subjects’ preferences for three personality inventory formats. Proceedings of the 76 th Annual Convention of the American Psychological Association, San Francisco.

    Google Scholar 

  • Kelley, H.H., & Michela, G.L. (1980). Attribution theory and research. Annual Review of Psychology, 34, 457–504.

    Google Scholar 

  • Keren, A. (1979). Inhaltlich-semantische Analyse der Items aus fünf deutschsprachigen Persönlichkeitsfragebogen. Universität Bonn: Masters Thesis.

    Google Scholar 

  • Knudson, R.M., & Golding, S.L. (1974). Comparative validity of traditional versus S-R format inventories of interpersonal behavior. Journal of Research in Personality, 8, 111–127.

    Google Scholar 

  • Kuncel, R.B. (1973). Response processes and relative location of subject and item. Educational and Psychological Measurement, 33, 545–563.

    Google Scholar 

  • Langer, I., & Schulz von Thun, F. (1974). Messung komplexer Merkmale in Psychologie und Pädagogik -Ratingverfahren. Munich: Reinhardt.

    Google Scholar 

  • Lennertz, E. (1973). Thesen zur Itemsammlung bei Persönlichkeitsfragebogen. In Reinert, G. (Ed.), Bericht über den 27. Kongreß der Deutschen Gesellschaft für Psychologie in Kiel 1973. Göttingen: Hogrefe.

    Google Scholar 

  • Lienert, G.A. (1969). Testaußau und Testanalyse (3 rd ed.). Weinheim: Beltz.

    Google Scholar 

  • Löhr, F.J. (1977). Formale und inhaltliche Merkmale von Fragebogenitems -Zum Einfluß von Itemeigenschaften auf den Beantwortungsprozeß bei deutschen Persönlichkeitsfragebögen. Universität Bonn: Masters Thesis.

    Google Scholar 

  • Löhr, F.J. (1983 a). Häufigkeits-und Intensitätsadverbien in den sItems von Persönlichkeitsfragebogen. Bielefeld: Arbeitsberichte aus dem Projekt Persönlichkeitsfragebogen (No. 5), Universität Bielefeld.

    Google Scholar 

  • Löhr, F.J. (1983 b). Sprachlogische und empirische Beziehungen in Persönlichkeitsfragebogen für Kinder. Eine empirische Untersuchung zur Bezugsebene der Items. Bielefeld: Arbeitsberichte aus dem Projekt Persönlichkeitsfragebogen (No. 6), Universität Bielefeld.

    Google Scholar 

  • Löhr, F.J. (In preparation). Die Bedeutung von Itemeigenschaften für den Prozeß und das Ergebnis der Beantwortung von Persönlichkeitsfragebogen. Bielefeld: Dissertation, Fakultät für Psychologie und Sportwissenschaft der Universität Bielefeld.

    Google Scholar 

  • Löhr, F.J., & Angleitner, A. (1980). Eine Untersuchung zu sprachlichen Formulierungen der Items in deutschen Persönlichkeitsfragebogen. Zeitschrift für Differentielle und Diagnostische Psychologie, 1, 217–235.

    Google Scholar 

  • Loevinger, J. (1957). Objective tests as instruments of psychological theory. Psychological Reports, 3, 635–694.

    Google Scholar 

  • Magnusson, D. (1981). Toward a psychology of situations: An interactional perspective. Hillsdale: Erlbaum.

    Google Scholar 

  • Magnusson, D. (1984). Persons in situations: Some comments on a current issue. In Bonarius, H.M., Van Heck, G., & Smid, N. (Eds.), Personality psychology in Europe: Theoretical and empirical developments. Lisse: Swets & Zeitlinger.

    Google Scholar 

  • Meehl, P.E. (1972). Reactions, reflections, projections. In Butcher, J.N. (Ed.), Objective personality assessment: Changing perspectives (pp. 131–189). New York: Academic.

    Google Scholar 

  • Messick, S. (1967). The psychology of acquiescence. In Berg, I.A. (Ed.), Response set in personality assessment. Chicago: Aldine.

    Google Scholar 

  • Micklin, M., & Durbin, M. (1969). Syntactic dimensions of attitude scaling techniques: Sources of variation and bias. Sociometry, 32, 194–206.

    Google Scholar 

  • Mischel, W. (1972). Direct vs. indirect personality assessment: Evidence and implications. Journal of Consulting and Clinical Psychology, 38, 319–324.

    PubMed  Google Scholar 

  • Mischel, W., & Peake, P.K. (1982). Beyond déjà vu in the search for cross-situational consistency. Psychological Review, 89, 730–755.

    Google Scholar 

  • Mittenecker, E., & Toman, W. (1951). Der P.I.-Test. Beihefte zur Wiener Zeitschrift für Philosophic Psychologie, Pädagogik, 1.

    Google Scholar 

  • Nisbett, R., & Ross, L. (1980). Human inference: Strategies and shortcomings of social judgment. Englewood Cliffs: Prentice-Hall.

    Google Scholar 

  • Nowakowska, M. (1970). A model of answering to a questionnaire item. Acta Psychologica, 34, 420–439.

    Google Scholar 

  • Payne, F.D. (1970). Structured personality inventory items: Test-retest response consistency and item properties. Urbana-Champaign: Ph.D. Thesis, University of Illinois.

    Google Scholar 

  • Pepper, S. (1981). Problems in the quantification of frequency expressions. In Fiske, D. (Ed.), New directions for methodology of social and behavioral science: Problems with language imprecision. (No. 9). San Francisco: Jossey-Bass.

    Google Scholar 

  • Peterson, C.C., & Peterson, J.L. (1976). Linguistic determinants of the difficulty of true-false test items. Educational and Psychological Measurement, 36, 161–169.

    Google Scholar 

  • Rogers, T.B. (1971). The process of responding to personality items: Some issues, a theory and some research. Multivariate Behavioral Research Monographs, 6(2).

    Google Scholar 

  • Rogers, T.B. (1974a). An analysis of the stages underlying the process of responding to personality items. Acta Psychologica, 38, 205–213.

    PubMed  Google Scholar 

  • Rogers, T.B. (1974 b). An analysis of two central stages underlying responding to personality items: The self-referent decision and response selections. Journal of Research in Personality, 8, 128–138.

    Google Scholar 

  • Rogers, T.B. (1977). Self-reference in memory: Recognition of personality items. Journal of Research in Personality, 11, 295–305.

    Google Scholar 

  • Schneider-Dueker, M., & Schneider, F. (1977). Untersuchungen zum Beantwortungsprozeß bei psychodiagnostischen Fragebogen. Zeitschrift für experimentelle und angewandte Psychologie, 24, 282–302.

    Google Scholar 

  • Spreen, O. (1963). MMPI: Saarbrücken. Handbuch zur deutschen Ausgabe des Minnesota Multiphasic Personality Inventory. Bern: Huber.

    Google Scholar 

  • Stumpf, H., Angleitner, A., Wieck, T., Jackson, D.N., & Beloch-Till, H. (1985). Deutsche Personality Research Form (PRF). Göttingen: Hogrefe.

    Google Scholar 

  • Timm, U. (1968). Reliabilität und Faktorenstruktur von Cattells 16PF-Test bei einer deutschen Stichprobe. Zeitschrift für experimentelle und angewandte Psychologie, 15, 354– 373.

    PubMed  Google Scholar 

  • Van Heck, G.L. (1984). The construction of a general taxonomy of situations. In Bonarius, H.M., Van Heck, G., & Smid, N. (Eds.), Personality psychology in Europe: Theoretical and empirical developments. Lisse: Swets & Zeitlinger.

    Google Scholar 

  • Wiggins, J.S. (1973). Personality and prediction: Principles of personality assessment. Reading: Addison-Wesley.

    Google Scholar 

  • Wiggins, J.S. (1979). A psychological taxonomy of trait-descriptive terms: The interpersonal domain. Journal of Personality and Social Psychology, 37, 395–412.

    Google Scholar 

  • Wiggins, J.S., & Goldberg, L.R. (1965). Interrelationship among MMPI item characteristics. Educational and Psychological Measurement, 25, 381–397.

    Google Scholar 

Download references

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1986 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Angleitner, A., John, O.P., Löhr, FJ. (1986). It’s What You Ask and How You Ask It: An Itemmetric Analysis of Personality Questionnaires. In: Angleitner, A., Wiggins, J.S. (eds) Personality Assessment via Questionnaires. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-70751-3_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-70751-3_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-70753-7

  • Online ISBN: 978-3-642-70751-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics