Parent Ratings of the Oppositional Defiant Disorder Symptoms: Item Response Theory Analyses of Cross-National and Cross-Racial Invariance

  • Rapson Gomez
  • G. Leonard Burns
  • James A. Walsh


Item response theory (IRT) based differential item functioning (DIF) was used to examine the construct and normative invariance of the DSM-IV oppositional defiant disorder (ODD) symptoms for ratings across Malaysian and Australian children, and Malaysian Malay and Malaysian Chinese children. To accomplish these goals, parents completed the Disruptive Behavior Rating Scale, which includes the eight DSM-IV ODD symptoms. Although the comparisons involving Malaysian and Australian children indicated DIF for five symptoms, only the symptom for “touchy” showed notable DIF. This was also the only symptom that showed DIF for the comparisons involving Malay and Chinese children. There were also minimal differences in the latent mean scores across Australian and Malaysian children and also Malay and Chinese children. These results indicate good support for the construct and normative invariance of the ODD symptoms for the samples compared.


ODD Culture Malaysian Australian Invariance IRT 


  1. American Psychiatric Association (1994). Diagnostic and statistical manual of mental disorders: DSM-IV (4th ed.). Washington, DC: American Psychiatric Association.Google Scholar
  2. American Psychiatric Association (2000). Diagnostic and statistical manual of mental disorders: DSM-IV-TR (4th ed.). Washington, DC: American Psychiatric Association.Google Scholar
  3. Australian Bureau of Statistics (1996). Estimated residentpPopulation by sex and age (Catalogue no. 3201.2). Canberra, Australia: Australian Bureau of Statistics.Google Scholar
  4. Barkley, R. A., & Murphy, K. R. (1998). Attention-deficit hyperactivity disorder: A clinical workbook (2nd ed.). NY: Guilford.Google Scholar
  5. Bernard, H. R. (1988). Research methods in cultural anthropology. Newbury Park, CA: Sage.Google Scholar
  6. Brislin, R. (1970). Back translation for cross-cultural research. Journal of Cross-Cultural Psychology, 1, 185–216.CrossRefGoogle Scholar
  7. Burns, G. L., Boe, B., Walsh, J. A., Sommers-Flanagan, R., & Teegarden, L. A. (2001). A confirmatory factor analysis on the DSM-IV ADHD and ODD symptoms: What is the best model for the organization of these symptoms? Journal of Abnormal Child Psychology, 29, 339–349.PubMedCrossRefGoogle Scholar
  8. Burns, G. L., Walsh, J. A., Owen, S. M., & Snell, J. (1997a). Internal validity of the ADHD, ODD, and overt CD symptoms in young children: Implications from teacher ratings for a dimensional approach to symptom validity. Journal of Clinical Child Psychology, 26, 266–275.PubMedCrossRefGoogle Scholar
  9. Burns, G. L., Walsh, J. A., Patterson, D. R., Holte, C. S., Sommers-Flanagan, R., & Parker, C. M. (1997b). Internal validity of the disruptive behavior disorder symptoms: Implications from parent ratings for a dimensional approach to symptom validity. Journal of Abnormal Child Psychology, 25, 307–319.PubMedCrossRefGoogle Scholar
  10. Butcher, J. N. (1996). Translation and adaptation of the MMPI-2 for international use. In J. N. Butcher (Ed.), International adaptations of the MMPI-2: Research and clinical applications (pp. 26–43). Minneapolis: University of Minnesota Press.Google Scholar
  11. Byrne, B. M. (1998). Structural equation modelling with LISREL, PRELIS, and SIMPLIS: Basic concepts, applications, and programming. Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
  12. Drasgow, F., Levine, M. V., Tsein, S., Williams, B. A., & Mead, A. D. (1995). Fitting polytomous IRT models to multiplechoice tests. Applied Psychological Measurement, 19, 143–165.CrossRefGoogle Scholar
  13. Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
  14. Gaub, M., & Carlson, C. L. (1997). Behavioral characteristics of DSM-IV ADHD subtypes in a school-based population. Journal of Abnormal Child Psychology, 25, 103–111.PubMedCrossRefGoogle Scholar
  15. Gomez, R., Burns, G. L., Walsh, J. A., & Hafetz, N. (2005). A multitrait-multisource confirmatory factor analytic approach to the construct validity of ADHD and ODD rating scales with Malaysian children. Journal of Abnormal Child Psychology, 33, 241–254.PubMedCrossRefGoogle Scholar
  16. Herrera, R. S., DelCampo, R. L., & Ames, M. H. (1993). A serial approach for translating family science instrumentations. Family Relations, 42, 357–360.CrossRefGoogle Scholar
  17. Joreskög, K. G., Sorböm, D., du Toit, A., & du Toit, M. (1996). LISREL 8: New statistical features. Lincolnwood, IL: Scientific Software International.Google Scholar
  18. Lahey, B. B., Schwarb-Stone, M., Goodman, S. H., Waldman, J. D., Canino, G., Rathouz, P. J., et al. (2000). Age and gender differences in oppositional behavior and conduct problems: A cross-sectional household study of middle childhood and adolescence. Journal of Abnormal Psychology, 109, 486–503.CrossRefGoogle Scholar
  19. Mann, E. B., Ikeda, Y., Mueller, C. H., Takahashi, A., Tao, K. T., Humris, E., et al. (1992). Cross-cultural differences in rating hyperactive-disruptive behaviors in children. American Journal of Psychiatry, 149, 1539–1542.PubMedGoogle Scholar
  20. Maughan, B., Rowe, R., Messier, J., Goodman, R., & Meltzer, H. (2004). Conduct disorder and oppositional defiant disorder in a national sample: Developmental epidemiology. Journal of Child Psychology and Psychiatry, 43, 609–621.CrossRefGoogle Scholar
  21. Mezzich, J. E., Kleinman, A., Fabrega, H., & Parron, D. L (Eds.). (1996). Culture and psychiatric diagnosis. Washington, DC: American Psychiatric Association.Google Scholar
  22. Molina, B. S., Smith, B. H., & Pelham, W. E. (2001). Factor structure and criterion validity of secondary school teacher ratings of ADHD and ODD. Journal of Abnormal Child Psychology, 29, 71–82.PubMedCrossRefGoogle Scholar
  23. Moustaki, I. (2003). A general class of latent variable models for ordinal manifest variables with covariate effects on the manifest and latent variables. British Journal of Mathematical and Statistical Psychology, 56, 337–357.PubMedCrossRefGoogle Scholar
  24. Mueller, C. W., Mann, E. M., Thanapum, S., Humris, E., Ikeda, Y., Takahashi, A., et al. (1995). Teachers’ ratings of disruptive behavior in five countries. Journal of Clinical Child Psychology, 24, 434–442.CrossRefGoogle Scholar
  25. Raju, N. S., Laffitte, L. J., & Byrne, B. M. (2002). Measurement equivalence: A comparison of methods based on confirmatory factor analysis and item response theory. Journal of Applied Psychology, 87, 517–529.PubMedCrossRefGoogle Scholar
  26. Reise, S. P., Widaman, K. F., & Paugh, P. H. (1993). Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Bulletin, 114, 552–566.PubMedCrossRefGoogle Scholar
  27. Reise, S. P., & Yu, J. (1990). Parameter recovery in the graded response model using MULTILOG. Journal of Educational Measurement, 27, 133–144.CrossRefGoogle Scholar
  28. Samejima, F. (1969). Estimation of latent trait ability using a response pattern of graded scores. Psychometrika Monograph Supplement, 34(4), 100–114.Google Scholar
  29. Samual, R. D., Ryan, L. M., & Legler, J. M. (1997). Latent variables models for mixed discrete and continuous outcomes. Journal of the Royal Statistical Society, B, 59, 667–678.CrossRefGoogle Scholar
  30. Sprafkin, J., Gadow, K. D., & Nolan, E. E. (2001). The utility of the DSM-IV-Referenced Screening Instrument for attention deficit/hyperactivity disorder. Journal of Emotional and Behavioral Disorders, 9, 182–191.CrossRefGoogle Scholar
  31. Stansfield, C. W. (2003). Test translation and adaptation in public education in the USA. Language Testing, 20, 189–207.CrossRefGoogle Scholar
  32. Stark, S., Chemyshenko, S., Chua, W. L., & Wadlington, P. (2001). Computing chi-square statistics and fit-plots using the MODFIT program. Retrieved October 6, 2003 from
  33. Thissen, D. (1991). MULTILOG: Multiple category item analysis and test scoring using item response theory. Chicago: Scientific Software International.Google Scholar
  34. Wender, E. (2004). ADHD symptoms and parent-teacher agreement (Commentary). Journal of Developmental & Behavioral Pediatrics, 25, 48–49.CrossRefGoogle Scholar
  35. Wolraich, M. L., Lambert, E. W., Bickman, L., Simmons, T., Doffing, M. A., & Woricy, K. A. (2004). Assessing the impact of parent and teacher agreement on diagnosing attention-deficit hyperactivity disorder. Journal of Developmental and Behavioral Pediatrics, 25, 41–47.PubMedCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2007

Authors and Affiliations

  • Rapson Gomez
    • 1
  • G. Leonard Burns
    • 2
  • James A. Walsh
    • 3
  1. 1.School of PsychologyUniversity of TasmaniaHobartAustralia
  2. 2.Department of PsychologyWashington State UniversityPullmanUSA
  3. 3.Department of PsychologyUniversity of MontanaMissoulaUSA

Personalised recommendations