Skip to main content
Log in

Reliability and Validity of Autism Diagnostic Interview-Revised, Japanese Version

  • Original Paper
  • Published:
Journal of Autism and Developmental Disorders Aims and scope Submit manuscript

Abstract

To examine the inter-rater reliability of Autism Diagnostic Interview-Revised, Japanese Version (ADI-R-JV), the authors recruited 51 individuals aged 3–19 years, interviewed by two independent raters. Subsequently, to assess the discriminant and diagnostic validity of ADI-R-JV, the authors investigated 317 individuals aged 2–19 years, who were divided into three diagnostic groups as follows: autistic disorder (AD), pervasive developmental disorder not otherwise specified, and other psychiatric diagnosis or no diagnosis, according to the consensus clinical diagnosis. As regards inter-rater reliability, intraclass correlation coefficients of greater than 0.80 were obtained for all three domains of ADI-R-JV. As regards discriminant validity, the mean scores of the three domains was significantly higher in individuals with AD than in those of other diagnostic groups. As regards diagnostic validity, sensitivity and specificity for correctly diagnosing AD were 0.92 and 0.89, respectively, but sensitivity was 0.55 for individuals younger than 5 years. Specificity was consistently high regardless of age and intelligence. ADI-R-JV was shown to be a reliable tool, and has sufficient discriminant validity and satisfactory diagnostic validity for correctly diagnosing AD, although the diagnostic validity appeared to be compromised with respect to the diagnosis of younger individuals.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • American Psychiatric Association. (2000). Task force on DSM-IV. Diagnostic and statistical manual of mental disorders: DSM-IV-TR. Washington, DC: American Psychiatric Association.

    Google Scholar 

  • Baron-Cohen, S., Scott, F. J., Allison, C., Williams, J., Bolton, P., Matthews, F. E., et al. (2009). Prevalence of autism-spectrum conditions: UK school-based population study. British Journal of Psychiatry, 194, 500–509.

    Article  PubMed  Google Scholar 

  • Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6, 284–290.

    Article  Google Scholar 

  • Cicchetti, D. V., Lord, C., Koenig, K., Klin, A., & Volkmar, F. R. (2008). Reliability of the ADI-R: Multiple examiners evaluate a single case. Journal of Autism and Developmental Disorder, 38, 764–770.

    Article  Google Scholar 

  • Cicchetti, D. V., & Sparrow, S. A. (1981). Developing criteria for establishing interrater reliability of specific items: applications to assessment of adaptive behavior. American Journal of Mental Deficiency, 86, 127–137.

    PubMed  Google Scholar 

  • Cicchetti, D. V., Volkmar, F., Klin, A., & Showalter, D. (1995). Diagnosing autism using ICD-10 criteria: a comparison of neural networks and standard multivariate procedures. Child Neuropsychology, 1, 26–37.

    Article  Google Scholar 

  • Cox, A., Klein, K., Charman, T., Baird, G., Baron-Cohen, S., Swettenham, J., et al. (1999). Autism spectrum disorders at 20 and 42 months of age: stability of clinical and ADI-R diagnosis. Journal of Child Psychology and Psychiatry, 40, 719–732.

    Article  PubMed  Google Scholar 

  • de Bildt, A., Sytema, S., Ketelaars, C., Kraijer, D., Mulder, E., Volkmar, F., et al. (2004). Interrelationship between autism diagnostic observation schedule-generic (ADOS-G), autism diagnostic interview-revised (ADI-R), and the diagnostic and statistical manual of mental disorders (DSM-IV-TR) classification in children and adolescents with mental retardation. Journal of Autism and Developmental Disorder, 34, 129–137.

    Article  Google Scholar 

  • Fleiss, J. L., & Cohen, J. (1973). The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and Psychological Measurements, 33, 613–619.

    Article  Google Scholar 

  • Fombonne, E. (2009). Epidemiology of pervasive developmental disorders. Pediatric Research, 65, 591–598.

    Article  PubMed  Google Scholar 

  • Gilchrist, A., Green, J., Cox, A., Burton, D., Rutter, M., & Le Couteur, A. (2001). Development and current functioning in adolescents with Asperger syndrome: a comparative study. Journal of Child Psychology and Psychiatry, 42, 227–240.

    Article  PubMed  Google Scholar 

  • Gray, K. M., Tonge, B. J., & Sweeney, D. J. (2008). Using the autism diagnostic interview-revised and the autism diagnostic observation schedule with young children with developmental delay: Evaluating diagnostic validity. Journal of Autism and Developmental Disorder, 38, 657–667.

    Article  Google Scholar 

  • Hill, A., Bolte, S., Petrova, G., Beltcheva, D., Tacheva, S., & Poustka, F. (2001). Stability and interpersonal agreement of the interview-based diagnosis of autism. Psychopathology, 34, 187–191.

    Article  PubMed  Google Scholar 

  • International Molecular Genetic Study of Autism Consortium. (2001). A genomewide screen for autism: Strong evidence for linkage to chromosomes 2q, 7q, and 16p. American Journal of Human Genetics, 69, 570–581.

    Article  Google Scholar 

  • Kawamura, Y., Takahashi, O., & Ishii, T. (2008). Reevaluating the incidence of pervasive developmental disorders: impact of elevated rates of detection through implementation of an integrated system of screening in Toyota, Japan. Psychiatry and Clinical Neurosciences, 62, 152–159.

    Article  PubMed  Google Scholar 

  • Kim, Y. S., Leventhal, B. L., Koh, Y. J., Fombonne, E., Laska, E., Lim, E. C., et al. (2011). Prevalence of autism spectrum sisorders in a total population ample. American Journal of Psychiatry, 168, 904–912.

    Article  PubMed  Google Scholar 

  • Kim, S. H., & Lord, C. (2012). New autism diagnostic interview-revised algorithms for toddlers and young preschoolers from 12 to 47 months of age. Journal of Autism and Developmental Disorder, 42, 82–93.

    Article  Google Scholar 

  • Kočovská, E., Biskupstø, R., Carina Gillberg, I., Ellefsen, A., Kampmann, H., Stora, T., et al. (2012). The rising prevalence of autism: A prospective longitudinal study in the Faroe Islands. Journal of Autism and Developmental Disorder,. doi:10.1007/s10803-012-1444-9.

    Google Scholar 

  • Koyama, T., Osada, H., Tsujii, H., & Kurita, H. (2009). Utility of the Kyoto scale of psychological development in cognitive assessment of children with pervasive developmental disorders. Psychiatry and clinical neurosciences, 63, 241–243.

    Article  PubMed  Google Scholar 

  • Lampi, K. M., Sourander, A., Gissler, M., Niemela, S., Rehnstrom, K., Pulkkinen, E., et al. (2010). Validity of finnish registry-based diagnoses of autism with the ADI-R. Acta Paediatrica, 99, 1425–1428.

    Article  PubMed  Google Scholar 

  • Le Couteur, A., Haden, G., Hammal, D., & McConachie, H. (2008). Diagnosing autism spectrum disorders in pre-school children using two standardised assessment instruments: The ADI-R and the ADOS. Journal of Autism and Developmental Disorder, 38, 362–372.

    Article  Google Scholar 

  • Lord, C., & Jones, R. M. (2012). Annual research review: Re-thinking the classification of autism spectrum disorders. Journal of Child Psychology and Psychiatry, 53, 490–509.

    Article  PubMed  Google Scholar 

  • Lord, C., Risi, S., DiLavore, P. S., Shulman, C., Thurm, A., & Pickles, A. (2006). Autism from 2 to 9 years of age. Archives of General Psychiatry, 63, 694–701.

    Article  PubMed  Google Scholar 

  • Lord, C., Risi, S., Lambrecht, L., Cook, E. H., Jr., Leventhal, B. L., DiLavore, P. C., et al. (2000). The autism diagnostic observation schedule-generic: a standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorder, 30, 205–223.

    Article  Google Scholar 

  • Lord, C., Rutter, M., & Le Couteur, A. (1994). Autism diagnostic interview-revised: A revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. Journal of Autism and Developmental Disorder, 24, 659–685.

    Article  Google Scholar 

  • Lord, C., Storoschuk, S., Rutter, M., & Pickles, A. (1993). Using the ADI-R to diagnose autism in preschool children. Infant Mental Health Journal, 14, 234–252.

    Article  Google Scholar 

  • McGovern, C. W., & Sigman, M. (2005). Continuity and change from early childhood to adolescence in autism. Journal of Child Psychology and Psychiatry, 46, 401–408.

    Article  PubMed  Google Scholar 

  • Mildenberger, K., Sitter, S., Noterdaeme, M., & Amorosa, H. (2001). The use of the ADI-R as a diagnostic tool in the differential diagnosis of children with infantile autism and children with a receptive language disorder. European Child and Adolescent Psychiatry, 10, 248–255.

    Article  PubMed  Google Scholar 

  • Parner, E. T., Schendel, D. E., & Thorsen, P. (2008). Autism prevalence trends over time in Denmark: Changes in prevalence and age at diagnosis. Archives of Pediatrics and Adolescent Medicine, 162, 1150–1156.

    Article  PubMed  Google Scholar 

  • Risi, S., Lord, C., Gotham, K., Corsello, C., Chrysler, C., Szatmari, P., et al. (2006). Combining information from multiple sources in the diagnosis of autism spectrum disorders. Journal of the American Academy of Child and Adolescent Psychiatry, 45, 1094–1103.

    Article  PubMed  Google Scholar 

  • Rutter, M., Le Couteur, A., & Lord, C. (2003). ADI-R: Autism diagnostic interview revised. WPS edition manual. Los Angeles, CA: Western Psychological Services.

    Google Scholar 

  • Saemundsen, E., Magnússon, P., Smári, J., & Sigurdardóttir, S. (2003). Autism diagnostic interview-revised and the childhood autism rating scale: Convergence and discrepancy in diagnosing autism. Journal of Autism and Developmental Disorder, 33, 319–328.

    Article  Google Scholar 

  • Sparrow, S. S., Balla, D., & Cicchetti, D. V. (1984). Vineland adaptive behavior scales (VABS). Circle Pines, MN: American Guidance Service.

    Google Scholar 

  • Tanaka Institute of Education. (1987). Tanaka-Binet intelligence scale. Tokyo: Taken Publisher.

    Google Scholar 

  • Tomanik, S. S., Pearson, D. A., Loveland, K. A., Lane, D. M., & Bryant Shaw, J. (2007). Improving the reliability of autism diagnoses: Examining the utility of adaptive behavior. Journal of Autism and Developmental Disorder, 37, 921–928.

    Article  Google Scholar 

  • Turner, L. M., & Stone, W. L. (2007). Variability in outcome for children with an ASD diagnosis at age 2. Journal of Child Psychology and Psychiatry, 48, 793–802.

    Article  PubMed  Google Scholar 

  • Ventola, P. E., Kleinman, J., Pandey, J., Barton, M., Allen, S., Green, J., et al. (2006). Agreement among four diagnostic instruments for autism spectrum disorders in toddlers. Journal of Autism and Developmental Disorder, 36, 839–847.

    Article  Google Scholar 

  • Waterhouse, L. (2008). Autism overflows: Increasing prevalence and proliferating theories. Neuropsychology Review, 18, 273–286.

    Article  PubMed  Google Scholar 

  • Wechsler, D., Golombok, S., & Rust, J. (1992). Wechsler intelligence scale for children—Third edition (WISC-IIIUK). London, UK: The Psychological Corporation.

    Google Scholar 

  • Williams, J. G., Higgins, J. P., & Brayne, C. E. (2006). Systematic review of prevalence studies of autism spectrum disorders. Archives of Disease in Childhood, 91, 8–15.

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

Declaration of interest: None of the authors have any conflict of interest to declare. The authors thank Dr. Masahiro Oshima, M.D., for recruiting children with ASD. Funding of this study was provided by a Research Grant from the Ministry of Health, Labour and Welfare of Japan (H20-KOKORO-004: K.J. Tsuchiya, Y. Kamio), by a grant for the National Center for Child Health and Development (21S-3: K. J. Tsuchiya), by the Pfizer Health Research Fund (K. Matsumoto), and by Grants-in-Aid for Scientific Research from the Ministry of Education, Culture, Sports, Science and Technology of Japan (A) (No. 20591396: N. Takei). These funding sources had no role in the study design; in the collection, analysis and interpretation of the data; in the writing of the report; or in the decision to submit the paper for publication.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kenji J. Tsuchiya.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (DOC 152 kb)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Tsuchiya, K.J., Matsumoto, K., Yagi, A. et al. Reliability and Validity of Autism Diagnostic Interview-Revised, Japanese Version. J Autism Dev Disord 43, 643–662 (2013). https://doi.org/10.1007/s10803-012-1606-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10803-012-1606-9

Keywords

Navigation