Abstract
To examine the inter-rater reliability of Autism Diagnostic Interview-Revised, Japanese Version (ADI-R-JV), the authors recruited 51 individuals aged 3–19 years, interviewed by two independent raters. Subsequently, to assess the discriminant and diagnostic validity of ADI-R-JV, the authors investigated 317 individuals aged 2–19 years, who were divided into three diagnostic groups as follows: autistic disorder (AD), pervasive developmental disorder not otherwise specified, and other psychiatric diagnosis or no diagnosis, according to the consensus clinical diagnosis. As regards inter-rater reliability, intraclass correlation coefficients of greater than 0.80 were obtained for all three domains of ADI-R-JV. As regards discriminant validity, the mean scores of the three domains was significantly higher in individuals with AD than in those of other diagnostic groups. As regards diagnostic validity, sensitivity and specificity for correctly diagnosing AD were 0.92 and 0.89, respectively, but sensitivity was 0.55 for individuals younger than 5 years. Specificity was consistently high regardless of age and intelligence. ADI-R-JV was shown to be a reliable tool, and has sufficient discriminant validity and satisfactory diagnostic validity for correctly diagnosing AD, although the diagnostic validity appeared to be compromised with respect to the diagnosis of younger individuals.
Similar content being viewed by others
References
American Psychiatric Association. (2000). Task force on DSM-IV. Diagnostic and statistical manual of mental disorders: DSM-IV-TR. Washington, DC: American Psychiatric Association.
Baron-Cohen, S., Scott, F. J., Allison, C., Williams, J., Bolton, P., Matthews, F. E., et al. (2009). Prevalence of autism-spectrum conditions: UK school-based population study. British Journal of Psychiatry, 194, 500–509.
Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6, 284–290.
Cicchetti, D. V., Lord, C., Koenig, K., Klin, A., & Volkmar, F. R. (2008). Reliability of the ADI-R: Multiple examiners evaluate a single case. Journal of Autism and Developmental Disorder, 38, 764–770.
Cicchetti, D. V., & Sparrow, S. A. (1981). Developing criteria for establishing interrater reliability of specific items: applications to assessment of adaptive behavior. American Journal of Mental Deficiency, 86, 127–137.
Cicchetti, D. V., Volkmar, F., Klin, A., & Showalter, D. (1995). Diagnosing autism using ICD-10 criteria: a comparison of neural networks and standard multivariate procedures. Child Neuropsychology, 1, 26–37.
Cox, A., Klein, K., Charman, T., Baird, G., Baron-Cohen, S., Swettenham, J., et al. (1999). Autism spectrum disorders at 20 and 42 months of age: stability of clinical and ADI-R diagnosis. Journal of Child Psychology and Psychiatry, 40, 719–732.
de Bildt, A., Sytema, S., Ketelaars, C., Kraijer, D., Mulder, E., Volkmar, F., et al. (2004). Interrelationship between autism diagnostic observation schedule-generic (ADOS-G), autism diagnostic interview-revised (ADI-R), and the diagnostic and statistical manual of mental disorders (DSM-IV-TR) classification in children and adolescents with mental retardation. Journal of Autism and Developmental Disorder, 34, 129–137.
Fleiss, J. L., & Cohen, J. (1973). The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and Psychological Measurements, 33, 613–619.
Fombonne, E. (2009). Epidemiology of pervasive developmental disorders. Pediatric Research, 65, 591–598.
Gilchrist, A., Green, J., Cox, A., Burton, D., Rutter, M., & Le Couteur, A. (2001). Development and current functioning in adolescents with Asperger syndrome: a comparative study. Journal of Child Psychology and Psychiatry, 42, 227–240.
Gray, K. M., Tonge, B. J., & Sweeney, D. J. (2008). Using the autism diagnostic interview-revised and the autism diagnostic observation schedule with young children with developmental delay: Evaluating diagnostic validity. Journal of Autism and Developmental Disorder, 38, 657–667.
Hill, A., Bolte, S., Petrova, G., Beltcheva, D., Tacheva, S., & Poustka, F. (2001). Stability and interpersonal agreement of the interview-based diagnosis of autism. Psychopathology, 34, 187–191.
International Molecular Genetic Study of Autism Consortium. (2001). A genomewide screen for autism: Strong evidence for linkage to chromosomes 2q, 7q, and 16p. American Journal of Human Genetics, 69, 570–581.
Kawamura, Y., Takahashi, O., & Ishii, T. (2008). Reevaluating the incidence of pervasive developmental disorders: impact of elevated rates of detection through implementation of an integrated system of screening in Toyota, Japan. Psychiatry and Clinical Neurosciences, 62, 152–159.
Kim, Y. S., Leventhal, B. L., Koh, Y. J., Fombonne, E., Laska, E., Lim, E. C., et al. (2011). Prevalence of autism spectrum sisorders in a total population ample. American Journal of Psychiatry, 168, 904–912.
Kim, S. H., & Lord, C. (2012). New autism diagnostic interview-revised algorithms for toddlers and young preschoolers from 12 to 47 months of age. Journal of Autism and Developmental Disorder, 42, 82–93.
Kočovská, E., Biskupstø, R., Carina Gillberg, I., Ellefsen, A., Kampmann, H., Stora, T., et al. (2012). The rising prevalence of autism: A prospective longitudinal study in the Faroe Islands. Journal of Autism and Developmental Disorder,. doi:10.1007/s10803-012-1444-9.
Koyama, T., Osada, H., Tsujii, H., & Kurita, H. (2009). Utility of the Kyoto scale of psychological development in cognitive assessment of children with pervasive developmental disorders. Psychiatry and clinical neurosciences, 63, 241–243.
Lampi, K. M., Sourander, A., Gissler, M., Niemela, S., Rehnstrom, K., Pulkkinen, E., et al. (2010). Validity of finnish registry-based diagnoses of autism with the ADI-R. Acta Paediatrica, 99, 1425–1428.
Le Couteur, A., Haden, G., Hammal, D., & McConachie, H. (2008). Diagnosing autism spectrum disorders in pre-school children using two standardised assessment instruments: The ADI-R and the ADOS. Journal of Autism and Developmental Disorder, 38, 362–372.
Lord, C., & Jones, R. M. (2012). Annual research review: Re-thinking the classification of autism spectrum disorders. Journal of Child Psychology and Psychiatry, 53, 490–509.
Lord, C., Risi, S., DiLavore, P. S., Shulman, C., Thurm, A., & Pickles, A. (2006). Autism from 2 to 9 years of age. Archives of General Psychiatry, 63, 694–701.
Lord, C., Risi, S., Lambrecht, L., Cook, E. H., Jr., Leventhal, B. L., DiLavore, P. C., et al. (2000). The autism diagnostic observation schedule-generic: a standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorder, 30, 205–223.
Lord, C., Rutter, M., & Le Couteur, A. (1994). Autism diagnostic interview-revised: A revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. Journal of Autism and Developmental Disorder, 24, 659–685.
Lord, C., Storoschuk, S., Rutter, M., & Pickles, A. (1993). Using the ADI-R to diagnose autism in preschool children. Infant Mental Health Journal, 14, 234–252.
McGovern, C. W., & Sigman, M. (2005). Continuity and change from early childhood to adolescence in autism. Journal of Child Psychology and Psychiatry, 46, 401–408.
Mildenberger, K., Sitter, S., Noterdaeme, M., & Amorosa, H. (2001). The use of the ADI-R as a diagnostic tool in the differential diagnosis of children with infantile autism and children with a receptive language disorder. European Child and Adolescent Psychiatry, 10, 248–255.
Parner, E. T., Schendel, D. E., & Thorsen, P. (2008). Autism prevalence trends over time in Denmark: Changes in prevalence and age at diagnosis. Archives of Pediatrics and Adolescent Medicine, 162, 1150–1156.
Risi, S., Lord, C., Gotham, K., Corsello, C., Chrysler, C., Szatmari, P., et al. (2006). Combining information from multiple sources in the diagnosis of autism spectrum disorders. Journal of the American Academy of Child and Adolescent Psychiatry, 45, 1094–1103.
Rutter, M., Le Couteur, A., & Lord, C. (2003). ADI-R: Autism diagnostic interview revised. WPS edition manual. Los Angeles, CA: Western Psychological Services.
Saemundsen, E., Magnússon, P., Smári, J., & Sigurdardóttir, S. (2003). Autism diagnostic interview-revised and the childhood autism rating scale: Convergence and discrepancy in diagnosing autism. Journal of Autism and Developmental Disorder, 33, 319–328.
Sparrow, S. S., Balla, D., & Cicchetti, D. V. (1984). Vineland adaptive behavior scales (VABS). Circle Pines, MN: American Guidance Service.
Tanaka Institute of Education. (1987). Tanaka-Binet intelligence scale. Tokyo: Taken Publisher.
Tomanik, S. S., Pearson, D. A., Loveland, K. A., Lane, D. M., & Bryant Shaw, J. (2007). Improving the reliability of autism diagnoses: Examining the utility of adaptive behavior. Journal of Autism and Developmental Disorder, 37, 921–928.
Turner, L. M., & Stone, W. L. (2007). Variability in outcome for children with an ASD diagnosis at age 2. Journal of Child Psychology and Psychiatry, 48, 793–802.
Ventola, P. E., Kleinman, J., Pandey, J., Barton, M., Allen, S., Green, J., et al. (2006). Agreement among four diagnostic instruments for autism spectrum disorders in toddlers. Journal of Autism and Developmental Disorder, 36, 839–847.
Waterhouse, L. (2008). Autism overflows: Increasing prevalence and proliferating theories. Neuropsychology Review, 18, 273–286.
Wechsler, D., Golombok, S., & Rust, J. (1992). Wechsler intelligence scale for children—Third edition (WISC-IIIUK). London, UK: The Psychological Corporation.
Williams, J. G., Higgins, J. P., & Brayne, C. E. (2006). Systematic review of prevalence studies of autism spectrum disorders. Archives of Disease in Childhood, 91, 8–15.
Acknowledgments
Declaration of interest: None of the authors have any conflict of interest to declare. The authors thank Dr. Masahiro Oshima, M.D., for recruiting children with ASD. Funding of this study was provided by a Research Grant from the Ministry of Health, Labour and Welfare of Japan (H20-KOKORO-004: K.J. Tsuchiya, Y. Kamio), by a grant for the National Center for Child Health and Development (21S-3: K. J. Tsuchiya), by the Pfizer Health Research Fund (K. Matsumoto), and by Grants-in-Aid for Scientific Research from the Ministry of Education, Culture, Sports, Science and Technology of Japan (A) (No. 20591396: N. Takei). These funding sources had no role in the study design; in the collection, analysis and interpretation of the data; in the writing of the report; or in the decision to submit the paper for publication.
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Tsuchiya, K.J., Matsumoto, K., Yagi, A. et al. Reliability and Validity of Autism Diagnostic Interview-Revised, Japanese Version. J Autism Dev Disord 43, 643–662 (2013). https://doi.org/10.1007/s10803-012-1606-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10803-012-1606-9