Psychometric Evaluation of the Brief Infant-Toddler Social and Emotional Assessment (BITSEA) in a Predominately Hispanic, Low-Income Sample

  • Gabriela M. Hungerford
  • Dainelys Garcia
  • Daniel M. Bagner


The goal of the present study was to evaluate the psychometric properties of the Brief Infant-Toddler Social and Emotional Assessment (BITSEA) with 12- to 15-month-old infants from predominately Hispanic, low-income families. Mothers of 144 infants were screened at a pediatric clinic as part of a larger study examining a brief home-based intervention for infants at-risk for behavior problems. Reliability was good for the BITSEA problem scale in all analyses and acceptable for the BITSEA competence scale in most analyses. Discriminative validity was supported by scores on the BITSEA competence scale significantly predicting delayed status on all ASQ-3 subscales. BITSEA problem scale scores significantly predicted scores on the total problems scale of the Child Behavior Checklist, supporting predictive validity. Analyses revealed a main effect of group on BITSEA problem scale scores, providing preliminary support for sensitivity to change for the BITSEA problem scale. Results support the BITSEA as an effective screening tool for use with young infants, Hispanic and Spanish-speaking populations, and low-income families.


Infant behavior Assessment Psychometrics Screening 


Author Note

This study was funded by a career development award from the National Institute of Mental Health to the third author (K23 MH085659).

Conflict of Interest

Gabriela M. Hungerford, Dainelys Garcia, and Daniel M. Bagner declared that they have no conflict of interest.

Experiment Participants

All experimental protocols were approved by the appropriate institutional review boards and meet the guidelines of the responsible government agency. Informed consent was obtained from all adult participants.


  1. Achenbach, T. M. (1992). Manual for the child behavior checklist/2-3 and 1992 profile. Burlington: University of Vermont, Department of Psychiatry.Google Scholar
  2. Achenbach, T. M., & Rescorla, L. A. (2000). Manual for the ASEBA preschool forms & profiles. Burlington, VT: University of Vermont, Research Center for Children, Youth, & Families.Google Scholar
  3. Allison, P. D. (2003). Missing data techniques for structural equation modeling. Journal of Abnormal Psychology, 112(4), 545.PubMedCrossRefGoogle Scholar
  4. American Academy of Pediatrics, Council on Children With Disabilities, Section on Developmental Behavioral Pediatrics, Bright Futures Steering Committee, Medical Home Initiatives for Children With Special Needs Project Advisory Committee. (2006). Identifying infants and young children with developmental disorders in the medical home: An algorithm for developmental surveillance and screening. Pediatrics, 118(1), 405.CrossRefGoogle Scholar
  5. Bagner, D., Harwood, M., & Eyberg, S. (2006). Psychometric considerations in child behavioral assessment. Handbook of child behavioral assessment, pp. 63–79.Google Scholar
  6. Bagner, D. M., Rodríguez, G. M., Blake, C. A., Linares, D., & Carter, A. S. (2012). Assessment of behavioral and emotional problems in infancy: A systematic Review. Clinical Child and Family Psychology Review, 15(2), 113–128.PubMedCentralPubMedCrossRefGoogle Scholar
  7. Bayley, N. (2006). Bayley scales of infant and toddler development: Bayley-III. Harcourt Assessment, Psych. Corporation.Google Scholar
  8. Briggs-Gowan, M. J., & Carter, A. S. (2002). Brief Infant-Toddler Social and Emotional Assessment (BITSEA) manual, version 2.0. New Haven, CT: Yale University.Google Scholar
  9. Briggs-Gowan, M., Carter, A. S., Irwin, J. R., Wachtel, K., & Cicchetti, D. V. (2004). The brief infant-toddler social and emotional assessment: screening for social-emotional problems and delays in competence. Journal of Pediatric Psychology, 29(2), 143–155.PubMedCrossRefGoogle Scholar
  10. Briggs-Gowan, M. J., Carter, A. S., Bosson-Heenan, J., Guyer, A. E., & Horwitz, S. M. (2006). Are infant-toddler social-emotional and behavioral problems transient? Journal of the American Academy of Child and Adolescent Psychiatry, 45(7), 849–858.PubMedCrossRefGoogle Scholar
  11. Butler, A. M., Brestan, E. V., & Eyberg, S. M. (2008). Examination of the Eyberg Child Behavior Inventory discrepancy hypothesis. Child and Family Behavior Therapy, 30(3), 257–262.CrossRefGoogle Scholar
  12. Campbell, S. B., Shaw, D. S., & Gilliom, M. (2000). Early externalizing behavior problems: toddlers and preschoolers at risk for later maladjustment. Development and Psychopathology, 12(03), 467–488.PubMedCrossRefGoogle Scholar
  13. Carter, A. S., & Briggs-Gowan, M. J. (2006a). Infant-toddler social and emotional assessment. San Antonio, TX: Harcourt.Google Scholar
  14. Carter, A. S., & Briggs-Gowan, M. J. (2006b). ITSEA/BITSEA: Infant toddler and brief infant toddler social and emotional assessment Examiner’s manual. San Antonio, TX: Harcourt Assessment.Google Scholar
  15. Carter, A. S., Briggs-Gowan, M. J., & Davis, N. O. (2004). Assessment of young children’s social‐emotional development and psychopathology: recent advances and recommendations for practice. Journal of Child Psychology and Psychiatry, 45(1), 109–134.PubMedCrossRefGoogle Scholar
  16. DeNavas-Walt, C., Proctor, B. D., & Smith, J. C. (2013). Current population reports, P60–245, income, poverty, and health insurance coverage in the United States: 2012. Washington, DC: U.S. Census Bureau.Google Scholar
  17. Eyberg, S., Boggs, S., & Jaccard, J. (2014). Does maintenance treatment matter? Journal of Abnormal Child Psychology, 42(3), 355–366.PubMedCrossRefGoogle Scholar
  18. Feldman, M. A., Hancock, C. L., Rielly, N., Minnes, P., & Cairns, C. (2000). Behavior problems in young children with or at risk for developmental delay. Journal of Child and Family Studies, 9(2), 247–261.CrossRefGoogle Scholar
  19. Foster, S. L., & Cone, J. D. (1995). Validity issues in clinical assessment. Psychological Assessment, 7(3), 248.CrossRefGoogle Scholar
  20. Geisinger, K. F. (1994). Cross-cultural normative assessment: translation and adaptation issues influencing the normative interpretation of assessment instruments. Psychological Assessment, 6(4), 304.CrossRefGoogle Scholar
  21. Gross, D., Sambrook, A., & Fogg, L. (1999). Behavior problems among young children in low-income urban day care centers. Research in Nursing & Health, 22(1), 15–25. doi: 10.1002/(sici)1098-240x(199902)22:1<15::aid-nur3>;2-2.CrossRefGoogle Scholar
  22. Guralnick, M. J., Neville, B., Hammond, M. A., & Connor, R. T. (2007). The friendships of young children with developmental delays: a longitudinal analysis. Journal of Applied Developmental Psychology, 28(1), 64–79.PubMedCentralPubMedCrossRefGoogle Scholar
  23. Huston, A. C., McLoyd, V. C., & Coll, C. G. (1994). Children and poverty: issues in contemporary research. Child Development, 65(2), 275–282.PubMedCrossRefGoogle Scholar
  24. Karabekiroglu, K., Rodopman-Arman, A., Ay, P., Ozkesen, M., Akbas, S., Tasdemir, G. N., Boke, O., & Peksen, Y. (2009). The reliability and validity of the Turkish version of the brief infant–toddler social emotional assessment (BITSEA). Infant Behavior and Development, 32(3), 291–297. doi: 10.1016/j.infbeh.2009.03.003.PubMedCrossRefGoogle Scholar
  25. Kruizinga, I., Jansen, W., De Haan, C. L., Van der Ende, J., Carter, A. S., & Raat, H. (2012). Reliability and validity of the dutch version of the brief infant-toddler social and emotional assessment (BITSEA). PLoS One, 7(6), e38762.PubMedCentralPubMedCrossRefGoogle Scholar
  26. Lambert, M. J., & Hawkins, E. J. (2004). Measuring outcome in professional practice: considerations in selecting and using brief outcome instruments. Professional Psychology: Research and Practice, 35(5), 492.CrossRefGoogle Scholar
  27. MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological Methods, 4(1), 84.CrossRefGoogle Scholar
  28. Mathiesen, K. S., & Sanson, A. (2000). Dimensions of early childhood behavior problems: stability and predictors of change from 18 to 30 months. Journal of Abnormal Child Psychology, 28(1), 15–31.PubMedCrossRefGoogle Scholar
  29. McClendon, D. T., Warren, J. S., Green, K. M., Burlingame, G. M., Eggett, D. L., & McClendon, R. J. (2011). Sensitivity to change of youth treatment outcome measures: a comparison of the CBCL, BASC‐2, and Y‐OQ. Journal of Clinical Psychology, 67(1), 111–125.PubMedCrossRefGoogle Scholar
  30. Mondschein, E. R., Adolph, K. E., & Tamis-LeMonda, C. S. (2000). Gender bias in mothers’ expectations about infant crawling. Journal of Experimental Child Psychology, 77(4), 304–316.PubMedCrossRefGoogle Scholar
  31. Olson, S. L., Bates, J. E., Sandy, J. M., & Schilling, E. M. (2002). Early developmental precursors of impulsive and inattentive behavior: from infancy to middle childhood. Journal of Child Psychology and Psychiatry, 43(4), 435–447.PubMedCrossRefGoogle Scholar
  32. Ortman, J. M., & Shin, H. B. (2011). Language projections: 2010 to 2020. Paper presented at the annual meetings of the American Sociological Association, Las Vegas, NV, August.Google Scholar
  33. Peterson, R. A. (1994). A meta-analysis of Cronbach’s coefficient alpha. Journal of Consumer Research, 21(2), 381–391. doi: 10.2307/2489828.CrossRefGoogle Scholar
  34. Phares, V., Fields, S., Kamboukos, D., & Lopez, E. (2005). Still looking for Poppa. American Psychologist, 60(7), 735–736. doi: 10.1037/0003-066x.60.7.735.PubMedCrossRefGoogle Scholar
  35. Pons, J. I., Matías-Carrelo, L., Rodríguez, M., Rodríguez, J. M., Herrans, L. L., Jiménez, M. E., & Jiménez, K. (2008). Estudios de validez de la Escala de Inteligencia Wechsler para Adultos Versión III, Puerto Rico (EIWA-III). Revista Puertorriqueña de Psicología, 19, 75–111.Google Scholar
  36. Preciado, J., & Henry, M. (1997). Linguistic barriers in health education and services.Google Scholar
  37. Qi, C. H., & Kaiser, A. P. (2003). Behavior problems of preschool children from low-income families review of the literature. Topics in Early Childhood Special Education, 23(4), 188–216.CrossRefGoogle Scholar
  38. Sand, N., Silverstein, M., Glascoe, F. P., Gupta, V. B., Tonniges, T. P., & O’Connor, K. G. (2005). Pediatricians’ reported practices regarding developmental screening: do guidelines work? Do they help? Pediatrics, 116(1), 174–179.PubMedCrossRefGoogle Scholar
  39. Shaw, D. S., Gilliom, M., Ingoldsby, E. M., & Nagin, D. S. (2003). Trajectories leading to school-age conduct problems. Developmental Psychology, 39(2), 189–200.PubMedCrossRefGoogle Scholar
  40. Shaw, D. S., Lacourse, E., & Nagin, D. S. (2005). Developmental trajectories of conduct problems and hyperactivity from ages 2 to 10. Journal of Child Psychology and Psychiatry, 46(9), 931–942.PubMedCrossRefGoogle Scholar
  41. Shaw, D. S., Dishion, T. J., Supplee, L., Gardner, F., & Arnds, K. (2006). Randomized trial of a family-centered approach to the prevention of early conduct problems: 2-year effects of the family check-up in early childhood. Journal of Consulting and Clinical Psychology, 74(1), 1.PubMedCrossRefGoogle Scholar
  42. Simpson, G. A., Colpe, L., & Greenspan, S. (2003). Measuring functional developmental delay in infants and young children: prevalence rates from the NHIS‐D. Paediatric and Perinatal Epidemiology, 17(1), 68–80.PubMedCrossRefGoogle Scholar
  43. Sonnander, K., & Claesson, M. (1999). Predictors of developmental delay at 18 months and later school achievement problems. Developmental Medicine and Child Neurology, 41(3), 195–202.PubMedCrossRefGoogle Scholar
  44. Squires, J., & Bricker, D. (2009). Ages & stages questionnaires, Third Edition (ASQ-3): A parent -completed child monitoring system (3rd ed.). Baltimore, MD: Brookes Publishing.Google Scholar
  45. Squires, J., Twombly, E., Bricker, D., & Potter, L. (2009). ASQ-3 user’s guide. Baltimore, MD: Brookes Publishing.Google Scholar
  46. Treutler, C. M., & Epkins, C. C. (2003). Are discrepancies among child, mother, and father reports on children’s behavior related to parents’ psychological symptoms and aspects of parent–child relationships? Journal of Abnormal Child Psychology, 31(1), 13–27.PubMedCrossRefGoogle Scholar
  47. Vaz, S., Parsons, R., Passmore, A. E., Andreou, P., & Falkmer, T. (2013). Internal consistency, test–retest reliability and measurement error of the self-report version of the Social Skills Rating System in a sample of Australian adolescents. PLoS One, 8(9), e73924.PubMedCentralPubMedCrossRefGoogle Scholar
  48. Wechsler, D. (1999). Wechsler abbreviated scale of intelligence. San Antonio, TX: Psychological Corporation.Google Scholar

Copyright information

© Springer Science+Business Media New York 2015

Authors and Affiliations

  • Gabriela M. Hungerford
    • 1
  • Dainelys Garcia
    • 1
  • Daniel M. Bagner
    • 1
  1. 1.Department of PsychologyFlorida International UniversityMiamiUSA

Personalised recommendations