Skip to main content

Advertisement

SpringerLink
Log in

Relations Between Internalizing and Externalizing Problems in Early Childhood

  • Original Paper
  • Published:
Child & Youth Care Forum Aims and scope Submit manuscript

Abstract

Background

Childhood internalizing and externalizing problems are closely related and often co-occur. Directional models have been employed to test how these problems are related, while few studies have tested a third variables model.

Objective

This study investigates whether internalizing and externalizing problems are reciprocally or unidirectionally related, whether these relations can be explained by third variables, and how these relations are associated with onset and stability.

Methods

A community sample of 1,434 children aged 5.08 (SD = 1.25) and their mothers participated in two 1-year interval data waves. Internalizing and externalizing problems were examined with the Strengths and Difficulties Questionnaire.

Results

Using latent cross-lagged modeling, externalizing problems were found not be related to subsequent internalizing problems, or vice versa. These results were also found when controlling for inadequate parenting, parenting stress, maternal health and social preference. When taking problem level into account, externalizing problems were related to stability of clinical level internalizing problems, even when controlling for third variables inadequate parenting, parenting stress, maternal mental health and social preference.

Conclusions

Strong autoregressive paths for internalizing and externalizing problems were found. Internalizing and externalizing problems do not seem to influence each other over time in the community sample. When investigating relations among internalizing and externalizing problems, it seems to be important to take problem level into account.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Notes

  1. We conducted multi-group modeling to check whether child age or sex moderated our results. We found no moderation effects. Details are available upon request at the first author.

References

  • Achenbach, T. M., Howell, C. T., Quay, H. C., & Conners, C. K. (1991). National survey of problems and competencies among four- to sixteen-year-olds: Parents’ reports for normative and clinical samples. Monographs of the Society for Research in Child Development, 56, 1–131.

    Article  PubMed  Google Scholar 

  • Angold, A., Costello, E. J., & Erkanli, A. (1999). Comorbidity. Journal of Child Psychology and Psychiatry, 40, 57–87.

    Article  PubMed  Google Scholar 

  • Arnold, D. S., O’Leary, S. G., Wolff, L. S., & Acker, M. M. (1993). The parenting scale: A measure of dysfunctional parenting in discipline situations. Psychological Assessment, 5, 137–144.

    Article  Google Scholar 

  • Asparouhav, T., & Muthén, B. (2010). Weighted least squares estimation with missing data. http://www.statmodel.com/download/GstrucMissingRevision.pdf

  • Barry, T. D., Dunlap, S. T., Cotten, S. J., Lochman, J. E., & Wells, K. C. (2005). The influence of maternal stress and distress on disruptive behavior problems in boys. Journal of the American Academy of Child and Adolescent Psychiatry, 44, 265–273.

    Article  PubMed  Google Scholar 

  • Beardslee, W. R., Versage, E. M., & Gladstone, T. R. G. (1998). Children of affectively ill parents: A review of the past 10 years. Journal of the American Academy of Child and Adolescent Psychiatry, 37, 1134–1141.

    Article  PubMed  Google Scholar 

  • Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238–246.

    Article  PubMed  Google Scholar 

  • Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588–606.

  • Benzies, K. M., Harrison, M. J., & Magill-Evans, J. (2004). Parenting stress, marital quality, and child behavior problems at age 7 years. Public Health Nursing, 21, 111–121.

    Article  PubMed  Google Scholar 

  • Bittner, A., Egger, H. L., Erkanli, A., Costello, J. E., Foley, D. L., & Angold, A. (2007). What do childhood anxiety disorders predict? Journal of Child Psychology and Psychiatry, 48, 1174–1183.

    Article  PubMed  Google Scholar 

  • Bodden, D. H., Bögels, S. M., Nauta, M. H., De Haan, E., Ringrose, J., Appelboom, C., & Appelboom-Geerts, K. C. (2008). Child versus family cognitive-behavioral therapy in clinically anxious youth: An efficacy and partial effectiveness study. Journal of the American Academy of Child and Adolescent Psychiatry, 47(12), 1384–1394.

    Article  PubMed  Google Scholar 

  • Bornstein, M. H., Hahn, C.-S., & Haynes, O. M. (2010). Social competence, externalizing, and internalizing behavioral adjustment from early childhood through early adolescence: Developmental cascades. Development and Psychopathology, 22, 717–735.

    Article  PubMed Central  PubMed  Google Scholar 

  • Boylan, K., Vaillancourt, T., Boyle, M., & Szatmari, P. (2007). Comorbidity of internalizing disorders in children with oppositional defiant disorder. European Child and Adolescent Psychiatry, 16, 484–494.

    Article  PubMed  Google Scholar 

  • Boylan, K., Vaillancourt, T., & Szatmari, P. (2012). Linking oppositional behaviour trajectories to the development of depressive symptoms in childhood. Child Psychiatry and Human Development, 43, 484–497.

    Article  PubMed  Google Scholar 

  • Bronfenbrenner, U., & Evans, G. W. (2000). Developmental science in the 21st century: Emerging theoretical models, research designs, and empirical findings. Social Development, 9, 115–125.

    Article  Google Scholar 

  • Browne, M. W., & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21(2), 230–258.

  • Burke, J. D., Loeber, R., Lahey, B. B., & Rathouz, P. (2005). Developmental transitions among affective and behavioral disorders in adolescent boys. Journal of Child Psychology and Psychiatry, 46, 1200–1210.

    Article  PubMed  Google Scholar 

  • Burt, K. B., & Roisman, G. I. (2010). Competence and psychopathology: Cascade effects in the NICHD Study of Early Child Care and Youth Development. Development and Psychopathology, 22, 557–567.

    Article  PubMed  Google Scholar 

  • Cicchetti, D., & Toth, S. L. (1998). The development of depression in children and adolescents. American Psychologist, 53, 221–241.

    Article  PubMed  Google Scholar 

  • Coie, J. D., Dodge, K. A., & Coppotelli, H. (1982). Dimensions and types of social status: A cross-age perspective. Developmental Psychology, 18, 557–570.

    Article  Google Scholar 

  • Copeland, W. E., Shanahan, L., Costello, E. J., & Angold, A. (2009). Childhood and adolescent psychiatric disorders as predictors of young adult disorders. Archives of General Psychiatry, 66, 764–772.

    Article  PubMed Central  PubMed  Google Scholar 

  • Crnic, K. A., & Greenberg, M. T. (1990). Minor parenting stresses with young children. Child Development, 61, 1628–1637.

    Article  PubMed  Google Scholar 

  • De Los Reyes, A., & Kazdin, A. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131, 483–509.

    Article  PubMed  Google Scholar 

  • De Pauw, S. S. W., & Mervielde, I. (2010). Temperament, personality and developmental psychopathology: A review based on the conceptual dimensions underlying childhood traits. Child Psychiatry and Human Development, 41, 313–329.

    Article  PubMed  Google Scholar 

  • Deater-Deckard, K. (2004). Parenting stress. New Haven, CT: Yale University Press.

    Book  Google Scholar 

  • Dishion, T. J., & Patterson, G. R. (2006). The development and ecology of antisocial behavior in children and adolescents. In D. J. Cohen & D. Cicchetti (Eds.), Developmental psychopathology. Vol. 3: Risk, disorder, and adaptation (pp. 503–541). Hoboken, NJ: Wiley.

    Google Scholar 

  • Fanti, K. A., & Henrich, C. C. (2010). Trajectories of pure and co-occurring internalizing and externalizing problems from age 2 to age 12: Findings from the National Institute of Child Health and Human Development Study of Early Child Care. Developmental Psychology, 46, 1159–1175.

    Article  PubMed  Google Scholar 

  • Fergusson, D. M., Lynskey, M. T., & Horwood, L. J. (1996). Origins of comorbidity between conduct and affective disorders. Journal of the American Academy of Child and Adolescent Psychiatry, 35, 451–460.

    Article  PubMed  Google Scholar 

  • Ford, T., Collishaw, S., Meltzer, H., & Goodman, R. (2007). A prospective study of childhood psychopathology: Independent predictors of change over three years. Social Psychiatry and Psychiatric Epidemiology, 42, 953–961.

    Article  PubMed  Google Scholar 

  • Frick, P. J., Silverthorn, P., & Evans, C. (1994). Assessment of childhood anxiety using structured interviews: Patterns of agreement among informants and association with maternal anxiety. Psychological Assessment, 6, 372–379.

    Article  Google Scholar 

  • Gilliom, M., & Shaw, D. S. (2004). Codevelopment of externalizing and internalizing problems in early childhood. Development and Psychopathology, 16, 313–333.

    Article  PubMed  Google Scholar 

  • Gjone, H., & Stevenson, J. (1997). The association between internalizing and externalizing behavior in childhood and early adolescence: Genetic or environmental common influences? Journal of Abnormal Child Psychology, 25, 277–286.

    Article  PubMed  Google Scholar 

  • Glaser, K. (1967). Masked depression in children and adolescents. American Journal of Psychotherapy, 21, 565–574.

    PubMed  Google Scholar 

  • Goodman, R. (2001). Psychometric properties of the Strengths and Difficulties Questionnaire. Journal of the American Academy of Child and Adolescent Psychiatry, 40, 1337–1345.

    Article  PubMed  Google Scholar 

  • Gooren, E. M. J. C., van Lier, P. A. C., Stegge, H., Terwogt, M. M., & Koot, H. M. (2011). The development of conduct problems and depressive symptoms in early elementary school children: The role of peer rejection. Journal of clinical and adolescent psychology, 40, 245–253.

    Article  Google Scholar 

  • Granic, I. (2012). Don’t worry, be angry: Anxiety, aggression and repair in parent–child relationships. Unpublished inaugural speech, Radboud University Nijmegen, The Netherlands.

  • Gross, H. E., Shaw, D. S., & Moilanen, K. L. (2008). Reciprocal associations between boys’ externalizing problems and mothers’ depressive symptoms. Journal of Abnormal Psychology, 36, 693–709.

    Article  Google Scholar 

  • Hammen, C. (2006). Stress generation in depression: Reflections on origins, research, and future directions. Journal of Clinical Psychology, 62, 1065–1082.

    Article  PubMed  Google Scholar 

  • Hardy, G. E., Shapiro, D. A., Haynes, C. E., & Rick, J. K. (1999). Validation of the General Health Questionnaire using a sample of employees from the Health Care Services. Psychological Assessment, 11, 159–165.

    Article  Google Scholar 

  • Hoglund, W. L., & Leadbeater, B. J. (2004). The effects of family, school, and classroom ecologies on changes in children’s social competence and emotional and behavioral problems in first grade. Developmental Psychology, 40, 533–544.

    Article  PubMed  Google Scholar 

  • Horowitz, J. L., Garber, J., Ciesla, J. A., Young, J. F., & Mufson, L. (2007). Prevention of depressive symptoms in adolescents: A randomized trial of cognitive-behavioral and interpersonal prevention programs. Journal of Consulting and Clinical Psychology, 75(5), 693.

    Article  PubMed  Google Scholar 

  • Ialongo, N., Edelsohn, G., Werthamer-Larsson, L., Crockett, L., & Kellman, S. (1996). The course of aggression in first-grade children with and without comorbid anxious symptoms. Journal of Abnormal Child Psychology, 24, 445–456.

    Article  PubMed  Google Scholar 

  • Jöreskog, K. G. (1971). Statistical analysis of sets of congeneric tests. Psychometrika, 36, 109–133.

    Article  Google Scholar 

  • Keiley, M. K., Bates, J. E., Dodge, K. A., & Pettit, G. S. (2000). A cross-domain growth analysis: Externalizing and internalizing behaviors during 8 years of childhood. Journal of Abnormal Child Psychology, 28, 161–179.

    Article  PubMed Central  PubMed  Google Scholar 

  • Kessler, R. C., Petukhova, M., & Zaslavsky, A. M. (2011). The role of latent internalizing and externalizing predisposition in accounting for the development of comorbidity among common mental disorders. Current Opinion in Psychiatry, 24, 307–312.

    Article  PubMed Central  PubMed  Google Scholar 

  • Koeter, M. W. J., & Ormel, J. (1991). General Health Questionnaire, Dutch version manual. Swets and Zeitlinger, Lisse

  • Krueger, R. F., & Markon, K. E. (2006). Reinterpreting comorbidity: A model-based approach to understanding and classifying psychopathology. Annual Review of Clinical Psychology, 2, 111–133.

    Article  PubMed Central  PubMed  Google Scholar 

  • Lahey, B. B., Loeber, R., Burke, J., Rathouz, P. J., & McBurnett, K. (2002). Waxing and waning in concert: Dynamic comorbidity of conduct disorder with other disruptive and emotional problems over 7 years among clinic-referred boys. Journal of Abnormal Psychology, 111, 556–567.

    Article  PubMed  Google Scholar 

  • Laird, R. D., Jordan, K., Dodge, K. A., Pettit, G. S., & Bates, J. E. (2001). Peer rejection in childhood, involvement with antisocial peers in early adolescence, and the development of externalizing problems. Development and Psychopathology, 13, 337–354.

    Article  PubMed Central  PubMed  Google Scholar 

  • Last, C. G., Perrin, S., Hersen, M., & Kazdin, A. E. (1996). A prospective study of childhood anxiety disorders. Journal of the American Academy of Child and Adolescent Psychiatry, 35, 1502–1510.

    Article  PubMed  Google Scholar 

  • Laursen, B. P., & Hoff, E. (2006). Person-centered and variable-centered approaches to longitudinal data. Merrill-Palmer Quarterly, 52, 377–389.

    Article  Google Scholar 

  • Lee, E. J., & Bukowski, W. M. (2012). Co-development of internalizing and externalizing problems behaviors: Causal direction and common vulnerability. Journal of Adolescence. doi:10.1016/j.adolescence.2011.10.008.

    Google Scholar 

  • Lilienfeld, S. O. (2003). Comorbidity between and within childhood externalizing and internalizing disorders: Reflections and directions. Journal of Abnormal Child Psychology, 31, 285–291.

    Article  PubMed  Google Scholar 

  • Loeber, R., & Keenan, K. (1994). Interaction between conduct disorder and its comorbid conditions: Effects of age and gender. Clinical Psychology Review, 14, 497–523.

    Article  Google Scholar 

  • Manassis, K., Tannock, R., & Monga, S. (2009). Anxious by maternal- versus self-report: Are they the same children? Journal of Canadian Academy of Child and Adolescent Psychiatry, 18, 103–109.

    Google Scholar 

  • Mathiesen, K. S., Sanson, A., Stoolmiller, M., & Karevold, E. (2009). The nature and predictors of undercontrolled and internalizing problem trajectories across early childhood. Journal of Abnormal Child Psychology, 37, 209–222.

    Article  PubMed  Google Scholar 

  • McDonald, R. P. (1978). Generalizability in factorable domains: “Domain validity and generalizability”. Educational and Psychological Measurement, 38, 75–79.

    Article  Google Scholar 

  • McDonald, R. P. (1999). Test theory: A unified treatment. Mahwah, NJ: Lawrence Erlbaum.

    Google Scholar 

  • Mesman, J., Bongers, I. L., & Koot, H. M. (2001). Preschool developmental pathways to preadolescent internalizing and externalizing problems. Journal of Child Psychology and Psychiatry, 42, 679–690.

    Article  PubMed  Google Scholar 

  • Muthén, L. K., & Muthén, B. O. (1998–2007). Mplus user’s guide (5th ed.). Los Angeles, CA: Muthén and Muthén.

  • Nagin, D. (1999). Analyzing developmental trajectories: A semi-parametric, group-based approach. Psychological Methods, 4, 139–157.

    Article  Google Scholar 

  • Nauta, M. H., Scholing, A., Emmelkamp, P. M., & Minderaa, R. B. (2003). Cognitive-behavioral therapy for children with anxiety disorders in a clinical setting: No additional effect of a cognitive parent training. Journal of the American Academy of Child and Adolescent Psychiatry, 42(11), 1270–1278.

    Article  PubMed  Google Scholar 

  • O’Connor, T. C., McGuire, S., Reiss, D., Hetherington, E. M., & Plomin, R. (1998). Co-occurrence of depressive symptoms and antisocial behavior in adolescence: A common genetic liability. Journal of Abnormal Psychology, 107, 27–38.

    Article  PubMed  Google Scholar 

  • Oland, A. J., & Shaw, D. S. (2005). Pure versus co-occurring externalizing and internalizing symptoms in children: The potential role of socio-developmental milestones. Clinical Child and Family Psychology Review, 8, 247–270.

    Article  PubMed  Google Scholar 

  • Otten, R., Wanner, B., Vitaro, F., & Engels, R. C. (2009). Disruptiveness, peer experiences and adolescent smoking: A long-term longitudinal approach. Addiction, 104, 641–650.

    Article  PubMed  Google Scholar 

  • Panak, W. F., & Garber, J. (1992). Role of aggression, rejection, and attributions in the prediction of depression in children. Development and Psychopathology, 4, 145–165.

    Article  Google Scholar 

  • Patterson, G. R., & Capaldi, D. M. (1990). A mediational model for boys’ depressed mood. In J. E. Rolf & A. S. Masten (Eds.), Risk and protective factors in the development of psychopathology (pp. 141–163). New York: Cambridge University Press.

    Chapter  Google Scholar 

  • Pinderhughes, E. E., Dodge, K. A., Bates, J. A., Pettit, G. S., & Zelli, A. (2000). Discipline responses: Influence of parents’ socioeconomic status, ethnicity, beliefs about parenting, stress, and cognitive–emotional processes. Journal of Family Psychology, 14, 380–400.

    Article  PubMed Central  PubMed  Google Scholar 

  • Prinzie, P., Onghena, P., Hellinckx, W., Grietens, H., Ghesquiere, P., & Colpin, H. (2003). The additive and interactive effects of parenting and children’s personality on externalizing behaviour. European Journal of Personality, 17, 95–117.

    Article  Google Scholar 

  • Rathert, J., Fite, P. J., & Gaertner, A. E. (2011). Associations between effortful control, psychological control and proactive and reactive aggression. Child Psychiatry and Human Development, 42, 609–621.

    Article  PubMed  Google Scholar 

  • Renk, K., Roberts, R., Roddenberry, A., Luick, M., Hillhouse, S., Meehan, C., et al. (2003). Mothers, fathers, gender role, and time parents spend with their children. Sex Roles, 48, 305–315.

    Article  Google Scholar 

  • Revelle, W., & Zinbarg, R. E. (2009). Coefficients alpha, beta, omega, and the GLB: Comments on Sijtsma. Psychometrika, 74, 145–154.

    Article  Google Scholar 

  • Rispens, J., Hermanns, J. M. A., & Meeus, W. H. J. (1996). Opvoeden in Nederland. Assen: van Gorcum.

    Google Scholar 

  • Ritakallio, M., Koivisto, A., von der Pahlen, B., Pelkonen, M., Marttunen, M., & Kaltiala-Heino, R. (2008). Continuity, comorbidity and longitudinal associations between depression and antisocial behavior in middle adolescence: a 2-year prospective follow-up study. Journal of Adolescence, 31, 355–370.

    Article  PubMed  Google Scholar 

  • Rodriguez, C. (2011). Association between independent reports of maternal parenting stress and children’s internalizing symptomatology. Journal of Child and Family Studies, 20, 631–639.

    Article  Google Scholar 

  • Rubin, K. H., & Mills, R. S. L. (1991). Conceptualizing developmental pathways to internalizing disorders in childhood. Canadian Journal of Behavioural Science, 23, 300–317.

    Article  Google Scholar 

  • Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003). Evaluating the fit of structural equation models: Test of significance and descriptive goodness-of-fit measures. Methods of Psychological Research, 8, 23–74.

    Google Scholar 

  • Speltz, M., McClellan, J., DeKleyn, M., & Jones, K. (1999). Preschool boys with oppositional defiant disorder: Clinical presentation and diagnostic change. Journal of the American Academy of Child and Adolescent Psychiatry, 38, 838–845.

    Article  PubMed  Google Scholar 

  • Stice, E., Shaw, H., Bohon, C., Marti, C. N., & Rohde, P. (2009). A meta-analytic review of depression prevention programs for children and adolescents: Factors that predict magnitude of intervention effects. Journal of Consulting and Clinical Psychology, 77, 486.

    Article  PubMed Central  PubMed  Google Scholar 

  • Stone, L. L., Otten, R., Engels, R. C. M. E., Vermulst, A. A., & Janssens, J. M. A. M. (2010). Psychometric properties of the parent and teacher versions of the Strengths and Difficulties Questionnaire for 4-to 12-year-olds: A review. Clinical Child and Family Psychology Review, 13, 254–274.

    Article  PubMed Central  PubMed  Google Scholar 

  • Stone, L. L., Otten, R., Ringlever, L., Hiemstra, M., Engels, R. C. M. E., Vermulst, A. A., & Janssens, J. M. A. M. (2013a). The parent version of the Strengths and Difficulties Questionnaire: Omega as an alternative to alpha and a test for measurement invariance. European Journal of Psychological Assessment, 29, 44–50.

    Article  Google Scholar 

  • Stone, L. L., Otten, R., Soenens, B., Kuntsche, E., & Engels, R. C. M. E. (2013b). Does parental psychological control relate to internalizing problems in early childhood? An examination using the Berkeley puppet interview. International Journal of Behavioral Development, 37, 309–318.

    Article  Google Scholar 

  • Van Lier, P., & Koot, H. M. (2010). Developmental cascades of peer relations and symptoms of externalizing and internalizing problems from kindergarten to fourth-grade elementary school. Development and Psychopathology, 22, 569–582.

    Article  PubMed  Google Scholar 

  • van Widenfelt, B. M., Goedhart, A. W., Treffers, P. D. A., & Goodman, R. (2003). Dutch version of the Strengths and Difficulties Questionnaire (SDQ). European Child and Adolescent Psychiatry, 12, 281–289.

    Article  PubMed  Google Scholar 

  • Vitaro, F., Brendgen, M., & Tremblay, R. (2000). Influence of deviant friends on delinquency: Searching for moderator variables. Journal of Abnormal Child Psychology, 28, 313–325.

    Article  PubMed  Google Scholar 

  • Weiss, B., Süsser, K., & Catron, T. (1998). Common and specific features of childhood psychopathology. Journal of Abnormal Psychology, 107, 118–127.

    Article  PubMed  Google Scholar 

  • Willett, J. B., & Sayer, A. G. (1994). Using covariance structure analysis to detect correlates and predictors of individual change over time. Psychological Bulletin, 116, 363–381.

    Article  Google Scholar 

Download references

Acknowledgments

This research was granted by the Dutch Organization for Health Research and Care Innovation (ZonMW: 80-82435-98-8026).

Author information

Authors and Affiliations

  1. Behavioural Science Institute, Radboud University Nijmegen, P.O. Box 9104, 6500 HE, Nijmegen, The Netherlands

    Lisanne L. Stone, Roy Otten, Rutger C. M. E. Engels, Rowella C. W. M. Kuijpers & Jan M. A. M. Janssens

Authors
  1. Lisanne L. Stone
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Roy Otten
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rutger C. M. E. Engels
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Rowella C. W. M. Kuijpers
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jan M. A. M. Janssens
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lisanne L. Stone.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Stone, L.L., Otten, R., Engels, R.C.M.E. et al. Relations Between Internalizing and Externalizing Problems in Early Childhood. Child Youth Care Forum 44, 635–653 (2015). https://doi.org/10.1007/s10566-014-9296-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10566-014-9296-4

Keywords

Search

Navigation