Advertisement

Collateral Reports and Cross-Informant Agreement about Adult Psychopathology in 14 Societies

  • Leslie A. Rescorla
  • Thomas M. Achenbach
  • Masha Y. Ivanova
  • Lori V. Turner
  • Hervör Árnadóttir
  • Alma Au
  • J. C. Caldas
  • Yi-Chuen Chen
  • Jeroen Decoster
  • Johnny Fontaine
  • Yasuko Funabiki
  • Halldór S. Guðmundsson
  • Patrick Leung
  • Jianghong Liu
  • Jelena Srdanović Maraš
  • Jasminka Marković
  • Kyung Ja Oh
  • Marina M. da Rocha
  • Virginia C. Samaniego
  • Edwiges Silvares
  • Roma Simulioniene
  • Elvisa Sokoli
  • Natalia Vazquez
  • Ewa Zasepa
Article

Abstract

To advance international mental health assessment, instruments that have been internationally validated are needed. To this end, we analyzed ratings from 14 societies on the Adult Behavior Checklist (ABCL), a collateral-report form parallel to the Adult Self-Report (ASR; Achenbach and Rescorla 2003) for ages 18 to 59. Both the ABCL and the ASR assess problems, personal strengths, and adaptive functioning. For a sample of 8322 see note below collaterals, we found strong consistency across societies regarding which ABCL problem items tended to obtain relatively low, medium, or high ratings. Most societal effect sizes (ESs) for problem scale scores were small to medium (< 13.9 %), but the ES for the ABCL Personal Strengths scale was 25 %. For most of the same participants (N = 8,302), we analyzed cross-informant agreement between self-reports on the ASR and collateral reports on the ABCL. Cross-informant correlations for problem scale scores averaged .47, with considerable societal variation. Problem score means were higher on the ASR than the ABCL in every society, but the size of the difference varied across societies. Mean item ratings on the ABCL and ASR were highly correlated within every society (mean r = .92), but within-dyad item rating agreement varied widely in every society (mean r = .39). In all societies, non-corroboration of self-reported deviance and of collateral-reported deviance was common. Overall findings indicated considerable similarity but also some important differences in collateral-reported problems and adaptive functioning across 14 societies.

Keywords

Adult psychopathology ABCL ASR Collateral-reported problems Cross-cultural International cross-informant agreement 

Notes

Compliance with Ethical Standards

Conflict of Interest

The ABCL and the ASR are published by the nonprofit University of Vermont Research Center for Children, Youth, and Families, from which authors Rescorla, Achenbach, Ivanova, and Turner receive remuneration.

Experiment Participants

In each society, conventions for obtaining informed consent required by the investigator’s research institution were followed.

References

  1. Achenbach, T. M. & Rescorla, L. A. (2003). Manual for the ASEBA Adult Forms & Profiles. Burlington: University of Vermont, Research Center for Children, Youth, and Families.Google Scholar
  2. Achenbach, T. M. & Rescorla, L. A. (2015). Multicultural supplement to the ASEBA Adult Forms & Profiles. Burlington: University of Vermont, Research Center for Children, Youth, and Families.Google Scholar
  3. Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101, 213–232. doi: 10.1037//0033-2909.101.2.213.CrossRefPubMedGoogle Scholar
  4. Achenbach, T. M., Krukowski, R. A., Dumenci, L., & Ivanova, M. Y. (2005). Assessment of adult psychopathology: Meta-analyses and implications of cross-informant correlations. Psychological Bulletin, 131, 361–382. doi: 10.1037/0033-2909.131.3.361.CrossRefPubMedGoogle Scholar
  5. American Psychiatric Association (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.Google Scholar
  6. Au, A., & Leung, P. (2012). [Hong Kong ABCL-ASR data]. Unpublished raw data.Google Scholar
  7. Caldas, J. C. (2012). [Portuguese ABCL-ASR data]. Unpublished raw data.Google Scholar
  8. Campbell, D. T. & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81–105.CrossRefPubMedGoogle Scholar
  9. Caspi, A., Houts, R. M., Belsky, D. W., Goldman-Mellor, S. J., Harrington, H., Israel, S., et al. (2014). The p factor one general psychopathology factor in the structure of psychiatric disorders? Clinical Psychological Science, 2(2), 119–137.CrossRefPubMedPubMedCentralGoogle Scholar
  10. Cheung, F. M., Cheung, S. F., Wada, S., & Zhang, J. (2003). Indigenous measures of personality assessment in Asian countries: A review. Psychological Assessment, 15, 280–289. doi: 10.1037/1040-3590.15.3.280.CrossRefPubMedGoogle Scholar
  11. Chen, Y. C. (2012). [Taiwanese ABCL-ASR data]. Unpublished raw data.Google Scholar
  12. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). New York: Academic Press.Google Scholar
  13. Decoster, J., & Fontaine, J. R. J. (2012). [Flemish ABCL-ASR data]. Unpublished raw data.Google Scholar
  14. De Los Reyes, A. (2011). Introduction to the special section: More than measurement error: Discovering meaning behind informant discrepancies in clinical assessments of children and adolescents. Journal of Clinical Child and Adolescent Psychology, 40, 1–9. doi: 10.1080/15374416.2011.533405.CrossRefPubMedGoogle Scholar
  15. De Los Reyes, A. & Kazdin, A. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131, 483–509. doi: 10.1037/0033-2909.131.4.483.CrossRefPubMedGoogle Scholar
  16. De Los Reyes, A., Bunnell, B. E., & Beidel, D. C. (2013a). Informant discrepancies in adult social anxiety disorder assessments: Links with contextual variations in observed behavior. Journal of Abnormal Psychology, 122, 376–386. doi: 10.1037/a0031150.CrossRefPubMedGoogle Scholar
  17. De Los Reyes, A., Thomas, S. A., Goodman, K. L., & Kundey, S. M. (2013b). Principles underlying the use of multiple informants' reports. Annual Review of Clinical Psychology, 9, 123–149. doi: 10.1146/annurev-clinpsy-050212-185617.CrossRefPubMedGoogle Scholar
  18. De Los Reyes, A., Augenstein, T. M., Wang, M., Thomas, S. A., Drabick, D. A. G., Burgers, D., et al. (2015). The validity of the multi-informant approach to assessing child and adolescent mental health. Psychological Bulletin, 141, 858–900. doi: 10.1037/a0038498.CrossRefPubMedPubMedCentralGoogle Scholar
  19. Dirks, M. A., De Los Reyes, A., Briggs-Gowan, M., Cella, D., & Wakschlag, L. S. (2012). Annual Research Review: Embracing not erasing contextual variability in children’s behavior - theory and utility in the selection and use of methods and informants in developmental psychopathology. Journal of Child Psychology and Psychiatry, 53, 558–574. doi: 10.1111/j.1469-7610.2012.02537.x.CrossRefPubMedPubMedCentralGoogle Scholar
  20. Ellis, B. B. & Kimmel, D. D. (1992). Identification of unique cultural response patterns by means of item response theory. Journal of Applied Psychology, 77, 177–184.CrossRefGoogle Scholar
  21. Faul, F., Erdfelder, E., Buchner, A., & Lang, A. G. (2009). Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behavioral Research Methods, 41, 1149–1160. doi: 10.3758/BRM.41.4.1149.CrossRefGoogle Scholar
  22. Funabiki, Y. (2012). [Japanese ABCL-ASR data]. Unpublished raw data.Google Scholar
  23. Guðmundsson, H. S., & Árnadóttir, H. A. (2012). [Icelandic ABCL-ASR data]. Unpublished raw data.Google Scholar
  24. Hofstede, G. (2011). Dimensionalizing Cultures: The Hofstede Model in Context. Online Readings in Psychology and Culture, 2(1), 1–26. doi: 10.9707/2307-0919.1014.CrossRefGoogle Scholar
  25. Ivanova, M. Y., Achenbach, T. M., Rescorla, L. A., Turner, L. V., Árnadóttir, H. A., Au, A., et al. (2015a). Syndromes of collateral-reported psychopathology for ages 18-59 in 18 Societies. International Journal of Clinical and Health Psychology, 15, 18–28. doi: 10.1016/j.ijchp.2014.07.001.CrossRefGoogle Scholar
  26. Ivanova, M. Y., Achenbach, T. M., Rescorla, L. A., Turner, L. V., Au, A., Bellini, M., et al. (2015b). Syndromes of self-reported psychopathology for ages 18-59 in 29 societies. Journal of Psychopathology and Behavioral Assessment, 37, 171–183. doi: 10.1007/s10862-014-9448-8.CrossRefGoogle Scholar
  27. Kirk, R. R. (1995). Experimental design procedures for the behavioral sciences. Pacific Grove: Brookside, Cole.Google Scholar
  28. Liu, J. (2012). [Chinese ABCL-ASR data]. Unpublished raw data.Google Scholar
  29. Markovic, J. (2012). [Serbian ABCL-ASR data]. Unpublished raw data.Google Scholar
  30. Meyer, G.J., Finn, S.E., Eyde, L.D., Kay, G.G., Moreland, K.L., Dies, R.R., …Reed, G.M. (2001). Psychological testing and psychological assessment: A review of evidence and issues. American Psychologist, 56, 128–165.Google Scholar
  31. Oh, K. J. & Kim, Y. A. (2010). Manual for the Korean Version of the ASEBA Adult Forms and Profiles. Seoul: Huno Press.Google Scholar
  32. Pike, K. L. (Ed.) (1967). Language in relation to a unified theory of structure of human behavior (2nd ed.). The Hague: Mouton De Gruyter.Google Scholar
  33. Rescorla, L.A., Ginzburg, S., Achenbach, T.M., Ivanova, M.Y., Almquist, F., Begovac, I., Bilenberg, N.,…. Verhulst, F. C. (2013). Cross- informant agreement between parent-reported and adolescent self-reported problems in 25 societies. Journal of Clinical Child and Adolescent Psychology, 42, 262–273. doi: 10.1080/15374416.2012.717870
  34. Rescorla, L.A., Achenbach, T.M., Ivanova, M.Y., Turner, L.V., Althoff, R.R., Au, A. …. Zasepa M. (2016). Problems and adaptive functioning reported by adults in 17 societies. International Perspectives in Psychology: Research, Practice, Consultation, in press.Google Scholar
  35. Ross, L. (1977). The intuitive psychologist and his shortcomings: Distortions in the attribution process. In Berkowitz, L. Advances in experimental social psychology 10. New York: Academic Press. pp. 173–220. ISBN 0–12-015210-XGoogle Scholar
  36. Samaniego, V. C. & Vázquez, N. (2012). Adult psychopathology: Is there any agreement between self-reports and reports by other informants? Presented at the 30th International Congress of Psychology. South Africa: Cape Town.Google Scholar
  37. Silvares, E., & da Rocha, M. M. (2012). [Brazilian ABCL-ASR data]. Unpublished raw data.Google Scholar
  38. Šimulionienė, R., Brazdeikienė, L., Rugevičius, M., Gedutienė, R., & Žakaitienė, A. (2010). The psychometric properties of the Lithuanian version of ASEBA adult forms. Psichologija, 42, 23–43.Google Scholar
  39. Sokoli, E. (2013). [Albanian ABCL-ASR data]. Unpublished raw data.Google Scholar
  40. Stephenson, W. (1935). Technique of factor analysis. Nature, 136, 297.CrossRefGoogle Scholar
  41. Tomlinson, M., Rudan, I., Saxena, S., Swartz, L., Tsai, A. C., & Patel, V. (2009). Setting priorities for global mental health research. Bulletin of World Health Organization, 87, 438–446. doi: 10.2471/BLT.08.054353.CrossRefGoogle Scholar
  42. World Health Organization World Mental Health Survey Consortium (2004). Prevalence, severity, and unmet need for treatment of mental disorders in the World Health Organization world mental health surveys. Journal of the American Medical Association, 291, 2581–2590. doi: 10.1001/jama.291.21.2581.CrossRefGoogle Scholar
  43. Youngstrom, E. A., Findling, R. L., & Calabrese, J. R. (2003). Who are the comorbid adolescents? Agreement between psychiatric diagnosis, youth, parent, and teacher report. Journal of Abnormal Child Psychology, 31(3), 231–245.CrossRefPubMedGoogle Scholar
  44. Zasepa, E. (2012). [Polish ABCL-ASR data]. Unpublished raw data.Google Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  • Leslie A. Rescorla
    • 1
  • Thomas M. Achenbach
    • 2
  • Masha Y. Ivanova
    • 2
  • Lori V. Turner
    • 2
  • Hervör Árnadóttir
    • 3
  • Alma Au
    • 4
  • J. C. Caldas
    • 5
  • Yi-Chuen Chen
    • 6
  • Jeroen Decoster
    • 7
  • Johnny Fontaine
    • 7
  • Yasuko Funabiki
    • 8
  • Halldór S. Guðmundsson
    • 3
  • Patrick Leung
    • 9
  • Jianghong Liu
    • 10
  • Jelena Srdanović Maraš
    • 11
  • Jasminka Marković
    • 11
  • Kyung Ja Oh
    • 12
  • Marina M. da Rocha
    • 13
  • Virginia C. Samaniego
    • 14
  • Edwiges Silvares
    • 15
  • Roma Simulioniene
    • 16
  • Elvisa Sokoli
    • 17
  • Natalia Vazquez
    • 14
  • Ewa Zasepa
    • 18
  1. 1.Bryn Mawr CollegeBryn MawrUSA
  2. 2.University of VermontBurlingtonUSA
  3. 3.University of IcelandReykjavíkIceland
  4. 4.Hong Kong Polytechnic UniversityHung HomHong Kong
  5. 5.Instituto Superior de Ciencias da Saude-NorteGandraPortugal
  6. 6.National Chung-Cheng UniversityChiayi CountyTaiwan
  7. 7.Ghent UniversityGhentBelgium
  8. 8.Kyoto UniversityKyotoJapan
  9. 9.The Chinese University of Hong KongShatinHong Kong
  10. 10.University of PennsylvaniaPhiladelphiaUSA
  11. 11.Clinic for Psychiatry, Clinical Center of VojvodinaNovi SadSerbia
  12. 12.Yonsei UniversitySeoulSouth Korea
  13. 13.Mackenzie Presbyterian UniversitySão PauloBrazil
  14. 14.Pontifica Universidad Católica ArgentinaBuenos AiresArgentina
  15. 15.University of Sao PauloSão PauloBrazil
  16. 16.Klaipeda UniversityKlaipėdaLithuania
  17. 17.University of TiranaTiranaAlbania
  18. 18.The Maria Grzegorzewska Academy of Special EducationWarsawPoland

Personalised recommendations