Advertisement

Towards Scalable, Integrative Assessment of Children’s Self-Regulatory Capabilities: New Applications of Digital Technology

  • Jamin DayEmail author
  • Kate Freiberg
  • Alan Hayes
  • Ross Homel
Article

Abstract

The assessment of self-regulation in children is of significant interest to researchers within education, clinical and developmental psychology, and clinical neuroscience, given its importance to adaptive functioning across a wide range of social, educational, interpersonal, educational and health domains. Because self-regulation is a complex, multidimensional construct, a range of assessment approaches have been developed to assess its various components including behavioural, cognitive and emotional domains. In recent years, digital technology has been increasingly used to enhance or supplement existing measurement approaches; however, developments have predominantly focused on translating traditional testing paradigms into digital formats. There is a need for more innovation in digital psychological assessments that harness modern mechanisms such as game-based design and interactivity. Such approaches have potential for the development of scalable, adaptable universal approaches to screening and assessment of children’s self-regulatory capabilities, to facilitate early identification of difficulties in individuals and also guide planning and decision-making at a population level. We highlight a novel, innovative digital assessment tool for children called Rumble’s Quest, a new measure of children’s socio-emotional functioning that shows promise as an integrative assessment of well-being and self-regulation, and which incorporates both self-report and direct assessment of cognitive self-regulation. This tool is scalable, can be integrated into normal classroom activities, and forms part of a comprehensive prevention support system that can be used to guide stakeholders’ decision-making regarding early intervention and support at the individual, classroom, school and community level. We finish by discussing other innovative possibilities for psychological assessment with children, using new and emerging technologies and assessment approaches.

Keywords

Self-regulation Psychological assessment Digital technology Children 

Notes

Compliance with Ethical Standards

Conflict of interest

Authors Jamin Day and Alan Hayes have no conflicts of interest to declare. Authors Kate Freiberg and Ross Homel are co-developers of the Rumble’s Quest tool and associated digital support platforms (e.g. https://www.realwell.org.au). These authors receive no direct funding compensation or royalties. Ongoing development, validation and evaluation studies for Rumble’s Quest have been supported through Australian Research Council grants. No funding was received towards the preparation of this manuscript.

Ethical Approval

This article does not contain any studies with human participants or animals performed by any of the authors.

References

  1. Anderson, P. (2002). Assessment and development of executive function (EF) during childhood. Child Neuropsychology, 8(2), 71–82.  https://doi.org/10.1076/chin.8.2.71.8724.CrossRefPubMedGoogle Scholar
  2. Andersson, G., Bergström, J., Buhrman, M., Carlbring, P., Holländare, F., Kaldo, V., … Waara, J. (2008). Development of a new approach to guided self-help via the internet: The Swedish experience. Journal of Technology in Human Services, 26(2–4), 161–181.  https://doi.org/10.1080/15228830802094627.CrossRefGoogle Scholar
  3. Andersson, G., & Titov, N. (2014). Advantages and limitations of Internet-based interventions for common mental disorders. World Psychiatry: Official Journal of the World Psychiatric Association (WPA), 13(1), 4–11.  https://doi.org/10.1002/wps.20083.CrossRefGoogle Scholar
  4. Asselbergs, J., Ruwaard, J., Ejdys, M., Schrader, N., Sijbrandij, M., & Riper, H. (2016). Mobile phone-based unobtrusive ecological momentary assessment of day-to-day mood: An explorative study. Journal of Medical Internet Research, 18(3), e72.  https://doi.org/10.2196/jmir.5505.CrossRefPubMedPubMedCentralGoogle Scholar
  5. Baggett, K. M., Davis, B., Feil, E. G., Sheeber, L. B., Landry, S. H., Carta, J. J., & Leve, C. (2010). Technologies for expanding the reach of evidence-based interventions: Preliminary results for promoting social-emotional development in early childhood. Topics in Early Childhood Special Education, 29(4), 226–238.  https://doi.org/10.1177/0271121409354782.CrossRefPubMedPubMedCentralGoogle Scholar
  6. Bandura, A. (1989). Regulation of cognitive processes through perceived self-efficacy. Developmental Psychology, 25(5), 729–735.  https://doi.org/10.1037/0012-1649.25.5.729.CrossRefGoogle Scholar
  7. Bauer, M., Wylie, C., Jackson, T., Mislevy, B., Hoffman-John, E., John, M., & Corrigan, S. (2017). Why video games can be a good fit for formative assessment. Journal of Applied Testing Technology, 18(S1), 19–31Google Scholar
  8. Baumeister, R., Schmeichel, B., & Vohs, K. (2008). Self-regulation and the executive function: The self as controlling agent. In A. W. Kruglanski & E. T. Higgins (Eds.), Social psychology: Handbook of basic principles (2nd edn., p. 516). New York: The Guilford Press.Google Scholar
  9. Beaumont, R., Rotolone, C., & Sofronoff, K. (2015). The secret agent society social skills program for children with high-functioning autism spectrum disorders: A comparison of two school variants. Psychology in the Schools, 52(4), 390–402.  https://doi.org/10.1002/pits.21831.CrossRefGoogle Scholar
  10. Bessell, T. L., McDonald, S., Silagy, C. A., Anderson, J. N., Hiller, J. E., & Sansom, L. N. (2002). Do Internet interventions for consumers cause more harm than good? A systematic review. Health Expectations, 5(1), 28–37.  https://doi.org/10.1046/j.1369-6513.2002.00156.x.CrossRefPubMedPubMedCentralGoogle Scholar
  11. Bezdjian, S., Baker, L. A., Lozano, D. I., & Raine, A. (2009). Assessing inattention and impulsivity in children during the Go/NoGo task. British Journal of Developmental Psychology, 27(2), 365–383.  https://doi.org/10.1348/026151008X314919.CrossRefPubMedGoogle Scholar
  12. Boonstra, T. W., Nicholas, J., Wong, Q. J., Shaw, F., Townsend, S., & Christensen, H. (2018). Using mobile phone sensor technology for mental health research: Integrated analysis to identify hidden challenges and potential solutions. Journal of Medical Internet Research, 20(7), e10131.  https://doi.org/10.2196/10131.CrossRefPubMedPubMedCentralGoogle Scholar
  13. Bronfenbrenner, U. (1986). Ecology of the family as a context for human development: Research perspectives. Developmental Psychology, 22(6), 723.CrossRefGoogle Scholar
  14. Burns, J. M., Davenport, T. A., & Christensen, H. (2013). Game on: Exploring the impact of technologies on young men’s mental health and wellbeing. Findings from the first Young and Well National Survey. Retrieved from http://scholar.google.com/scholar?hl=en%5C&btnG=Search%5C&q=intitle:Game+On:+Exploring+the+Impact+of+Technologies+on+Young+Men’s+Mental+Health+and+Wellbeing%5C#0.Google Scholar
  15. Campbell, S. B., Denham, S. A., Howarth, G. Z., Jones, S. M., Whittaker, J. V., Williford, A. P., … Darling-Churchill, K. (2016). Commentary on the review of measures of early childhood social and emotional development: Conceptualization, critique, and recommendations. Journal of Applied Developmental Psychology, 45, 19–41.  https://doi.org/10.1016/j.appdev.2016.01.008.CrossRefGoogle Scholar
  16. Carlson, S. M. (2005). Developmentally sensitive measures of executive function in preschool children. Developmental Neuropsychology, 28(2), 595–616.  https://doi.org/10.1207/s15326942dn2802_3.CrossRefPubMedGoogle Scholar
  17. Carlson, S. M., & Moses, L. J. (2001). Individual differences in inhibitory control and children’s theory of mind. Child Development, 72(4), 1032–1053.  https://doi.org/10.1111/1467-8624.00333.CrossRefPubMedGoogle Scholar
  18. Carlson, S. M., & Zelazo, P. D. (2014). Minnesota executive function scale: test manual. Reflection Sciences, LLC: St. Paul, MN.Google Scholar
  19. Casey, L. M., Oei, T. P. S., Raylu, N., Horrigan, K., Day, J., Ireland, M., & Clough, B. A. (2017). Internet-based delivery of cognitive behaviour therapy compared to monitoring, feedback and support for problem gambling: A randomised controlled trial. Journal of Gambling Studies.  https://doi.org/10.1007/s10899-016-9666-y.CrossRefPubMedGoogle Scholar
  20. Charova, E., Dorstyn, D., Tully, P., & Mittag, O. (2015). Web-based interventions for comorbid depression and chronic illness: A systematic review. Journal of Telemedicine and Telecare.  https://doi.org/10.1177/1357633x15571997.CrossRefPubMedGoogle Scholar
  21. Cheng, M.-T., Rosenheck, L., Lin, C.-Y., & Klopfer, E. (2017). Analyzing gameplay data to inform feedback loops in The Radix Endeavor. Computers & Education, 111, 60–73.  https://doi.org/10.1016/j.compedu.2017.03.015.CrossRefGoogle Scholar
  22. Cheng, Q., Li, T. M., Kwok, C.-L., Zhu, T., & Yip, P. S. (2017). Assessing suicide risk and emotional distress in chinese social media: A text mining and machine learning study. Journal of Medical Internet Research, 19(7), e243.  https://doi.org/10.2196/jmir.7276.CrossRefPubMedPubMedCentralGoogle Scholar
  23. Clark, K. E., & Ladd, G. W. (2000). Connectedness and autonomy support in parent–child relationships: Links to children’s socioemotional orientation and peer relationships. Developmental Psychology, 36(4), 485–498.  https://doi.org/10.1037/0012-1649.36.4.485.CrossRefPubMedGoogle Scholar
  24. Clarke, J., Proudfoot, J., Birch, M.-R., Whitton, A. E., Parker, G., Manicavasagar, V., … Hadzi-Pavlovic, D. (2014). Effects of mental health self-efficacy on outcomes of a mobile phone and web intervention for mild-to-moderate depression, anxiety and stress: Secondary analysis of a randomised controlled trial. BMC Psychiatry, 14(1), 272.  https://doi.org/10.1186/s12888-014-0272-1.CrossRefPubMedPubMedCentralGoogle Scholar
  25. Cugelman, B. (2013). Gamification: What it is and why it matters to digital health behavior change developers. JMIR Serious Games, 1(1), e3.  https://doi.org/10.2196/games.3139.CrossRefPubMedPubMedCentralGoogle Scholar
  26. Cummins, R. A., & Lau, A. L. D. (2005). Personal Wellbeing Index–School Children.Google Scholar
  27. Dalum, P., Brandt, C. L., Skov-Ettrup, L., Tolstrup, J., & Kok, G. (2016). The systematic development of an internet-based smoking Cessation intervention for adults. Health Promotion Practice, 17(4), 490–500.  https://doi.org/10.1177/1524839916631536.CrossRefPubMedGoogle Scholar
  28. Darling-Churchill, K. E., & Lippman, L. (2016). Early childhood social and emotional development: Advancing the field of measurement. Journal of Applied Developmental Psychology, 45, 1–7.  https://doi.org/10.1016/j.appdev.2016.02.002.CrossRefGoogle Scholar
  29. Davidson, M. C., Amso, D., Anderson, L. C., & Diamond, A. (2006). Development of cognitive control and executive functions from 4 to 13 years: Evidence from manipulations of memory, inhibition, and task switching. Neuropsychologia, 44(11), 2037–2078.  https://doi.org/10.1016/j.neuropsychologia.2006.02.006.CrossRefPubMedPubMedCentralGoogle Scholar
  30. Day, J. J., & Sanders, M. R. (2018). Do parents benefit from help when completing a self-guided parenting program online? A randomized controlled trial comparing triple p online with and without telephone support. Behavior Therapy.  https://doi.org/10.1016/j.beth.2018.03.002.CrossRefPubMedGoogle Scholar
  31. Diamond, A. (2013). Executive functions. Annual Review of Psychology, 64(1), 135–168.  https://doi.org/10.1146/annurev-psych-113011-143750.CrossRefGoogle Scholar
  32. DiCerbo, K. E., Shute, V., & Kim, Y. J. (2017). The future of assessment in technology-rich environments: Psychometric considerations. In J. M. Spector, B. Lockee, & M. Childress (Eds.), Learning, design, and technology: An international compendium of theory, research, practice, and policy (pp. 1–21). New York: Springer.Google Scholar
  33. DiCerbo, K. E., Xu, Y., Levy, R., Lai, E., & Holland, L. (2017). Modeling student cognition in digital and nondigital assessment environments. Educational Assessment, 22(4), 275–297.  https://doi.org/10.1080/10627197.2017.1382343.CrossRefGoogle Scholar
  34. Doherty, G., Coyle, D., & Sharry, J. (2012). Engagement with online mental health interventions: An Exploratory Clinical Study of a Treatment for Depression. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI’12 (p. 1421). New York: ACM Press.  https://doi.org/10.1145/2207676.2208602.
  35. Dowdy, E., Ritchey, K., & Kamphaus, R. W. (2010). School-based screening: A population-based approach to inform and monitor children’s mental health needs. School Mental Health, 2(4), 166–176.  https://doi.org/10.1007/s12310-010-9036-3.CrossRefPubMedPubMedCentralGoogle Scholar
  36. Dunton, G. F., Dzubur, E., & Intille, S. (2016). Feasibility and performance test of a real-time sensor-informed context-sensitive ecological momentary assessment to capture physical activity. Journal of Medical Internet Research, 18(6), e106.  https://doi.org/10.2196/jmir.5398.CrossRefPubMedPubMedCentralGoogle Scholar
  37. Elliott, S. N., Davies, M. D., Frey, J. R., Gresham, F., & Cooper, G. (2018). Development and initial validation of a social emotional learning assessment for universal screening. Journal of Applied Developmental Psychology, 55, 39–51.  https://doi.org/10.1016/j.appdev.2017.06.002.CrossRefGoogle Scholar
  38. Eyberg, S. M., & Pincus, D. (1999). Eyberg child behavior inventory and Sutter–Eyberg student behavior inventory—Revised: Professional manual. Odessa: Psychological Assessment Resources.Google Scholar
  39. Eysenbach, G. (2001). What is e-health? Journal of Medical Internet Research, 3(2), E20.  https://doi.org/10.2196/jmir.3.2.e20.CrossRefPubMedPubMedCentralGoogle Scholar
  40. Freeman, D., Reeve, S., Robinson, A., Ehlers, A., Clark, D., Spanlang, B., & Slater, M. (2017). Virtual reality in the assessment, understanding, and treatment of mental health disorders. Psychological Medicine, 47(14), 2393–2400.  https://doi.org/10.1017/S003329171700040X.CrossRefPubMedPubMedCentralGoogle Scholar
  41. Freiberg, K., & Homel, R. (2016). Rumble’s quest: A valid and reliable measure of social and emotional wellbeing for middle childhood. Retrieved December 13, 2018, from http://www.realwell.org.au/wp-content/uploads/2016/07/RQ-Psychometrics-Summary.pdf.
  42. Freiberg, K., Homel, R., Batchelor, S., Carr, A., Hay, I., Elias, G., … Lamb, C. (2005). Creating pathways to participation: a community-based developmental prevention project in Australia. Children & Society, 19(2), 144–157.  https://doi.org/10.1002/chi.867.CrossRefGoogle Scholar
  43. Freiberg, K., Homel, R., & Lamb, C. (2007). The pervasive impact of poverty on children: Tackling family adversity and promoting child development through the pathways to prevention project. In A. France & R. Homel (Eds.), Pathways and crime prevention: Theory, policy and practice (Vol 226, pp. 226–246). Cullumpton: Willan Publishing.Google Scholar
  44. Garon, N., Bryson, S. E., & Smith, I. M. (2008). Executive function in preschoolers: A review using an integrative framework. Psychological Bulletin, 134(1), 31–60.  https://doi.org/10.1037/0033-2909.134.1.31.CrossRefPubMedGoogle Scholar
  45. Gerstadt, C. L., Hong, Y. J., & Diamond, A. (1994). The relationship between cognition and action: performance of children 3 1/2–7 years old on a stroop-like day-night test. Cognition, 53(2), 129–153.  https://doi.org/10.1016/0010-0277(94)90068-X.CrossRefPubMedGoogle Scholar
  46. Gioia, G. A., Isquith, P. K., Guy, S. C., & Kenworthy, L. (2015). BRIEF-2: Behavior rating inventory of executive function. Lutz, FL: Psychological Assessment Resources.Google Scholar
  47. Goodenow, C. (1993). The psychological sense of school membership among adolescents: Scale development and educational correlates. Psychology in the Schools, 30(1), 79–90.  https://doi.org/10.1002/1520-6807(199301)30:1%3C79::AID-PITS2310300113>3.0.CO;2-XCrossRefGoogle Scholar
  48. Graziano, P. A., Slavec, J., Ros, R., Garb, L., Hart, K., & Garcia, A. (2015). Self-regulation assessment among preschoolers with externalizing behavior problems. Psychological Assessment, 27(4), 1337–1348.  https://doi.org/10.1037/pas0000113.CrossRefPubMedGoogle Scholar
  49. Halle, T. G., & Darling-Churchill, K. E. (2016). Review of measures of social and emotional development. Journal of Applied Developmental Psychology, 45, 8–18.  https://doi.org/10.1016/j.appdev.2016.02.003.CrossRefGoogle Scholar
  50. Harter, S. (1985). Manual for the self-perception profile for children. Denver: University of Denver.Google Scholar
  51. Heaton, R. K., Chelune, G. J., Talley, J. L., Kay, G. G., & Curtiss, G. (1993). Wisconsin Card Sorting Test (WCST): Manual: Revised and Expanded. Odessa, FL: Psychological Assessment Resources (PAR).Google Scholar
  52. Homer, B. D., Ober, T. M., & Plass, J. L. (2018). Digital games as tools for embedded assessment. In The Cambridge handbook of instructional feedback (pp. 357–375). Cambridge: Cambridge University Press.  https://doi.org/10.1017/9781316832134.018.CrossRefGoogle Scholar
  53. Hughes, C., Ensor, R., Wilson, A., & Graham, A. (2009). Tracking executive function across the transition to school: A latent variable approach. Developmental Neuropsychology, 35(1), 20–36.  https://doi.org/10.1080/87565640903325691.CrossRefGoogle Scholar
  54. Institute of Medicine. (2000). From Neurons to Neighborhoods. Washington, D.C.: National Academies Press.  https://doi.org/10.17226/9824.CrossRefGoogle Scholar
  55. Jones, S. M., Bailey, R., Barnes, S. P., & Partee, A. (2016). Executive Function Mapping Project: Untangling the Terms and Skills Related to Executive Function and Self-Regulation in Early Childhood. OPRE Report #2016-88. Washington, DC. Retrieved from https://www.acf.hhs.gov/sites/default/files/opre/efmapping_report_101416_final_508.pdf.
  56. Kabali, H. K., Irigoyen, M. M., Nunez-Davis, R., Budacki, J. G., Mohanty, S. H., Leister, K. P., & Bonner, R. L. (2015). Exposure and use of mobile media devices by young children. Pediatrics, 136(6), 1044–1050.  https://doi.org/10.1542/peds.2015-2151.CrossRefPubMedGoogle Scholar
  57. Kagan, J. (1964). Matching familiar figures test. Cambridge: Harvard University.Google Scholar
  58. Karoly, P. (1993). Mechanisms of self-regulation: A systems view. Annual Review of Psychology, 44(1), 23–52.  https://doi.org/10.1146/annurev.psych.44.1.23.CrossRefGoogle Scholar
  59. Kelders, S. M., Sommers-Spijkerman, M., & Goldberg, J. (2018). Investigating the direct impact of a gamified versus nongamified well-being intervention: an exploratory experiment. Journal of Medical Internet Research, 20(7), e247.  https://doi.org/10.2196/jmir.9923.CrossRefPubMedPubMedCentralGoogle Scholar
  60. Kenny, R., Dooley, B., & Fitzgerald, A. (2016). Ecological momentary assessment of adolescent problems, coping efficacy, and mood states using a mobile phone app: An exploratory study. JMIR Mental Health, 3(4), e51.  https://doi.org/10.2196/mental.6361.CrossRefPubMedPubMedCentralGoogle Scholar
  61. Kim, Y. J., & Shute, V. J. (2015). The interplay of game elements with psychometric qualities, learning, and enjoyment in game-based assessment. Computers & Education, 87, 340–356.  https://doi.org/10.1016/j.compedu.2015.07.009.CrossRefGoogle Scholar
  62. Kochanska, G., Coy, K. C., & Murray, K. T. (2001). The development of self-regulation in the first four years of life. Child Development, 72(4), 1091–1111.  https://doi.org/10.1111/1467-8624.00336.CrossRefPubMedGoogle Scholar
  63. Kochanska, G., Murray, K., Jacques, T. Y., Koenig, A. L., & Vandegeest, K. A. (1996). Inhibitory control in young children and Its role in emerging internalization. Child Development, 67(2), 490–507.  https://doi.org/10.1111/j.1467-8624.1996.tb01747.x.CrossRefPubMedGoogle Scholar
  64. Kramer, J., Velden, M. T., Kafkes, A., Basu, S., Federico, J., & Kielhofner, G. (2014). Child occupational self assessment. Chicago: Model of Human Occupation Clearinghouse.Google Scholar
  65. Leighton, J. P., & Chu, M.-W. (2016). First among equals: Hybridization of cognitive diagnostic assessment and evidence-centered game design. International Journal of Testing, 16(2), 164–180.  https://doi.org/10.1080/15305058.2015.1107075.CrossRefGoogle Scholar
  66. Leventhal, H., Leventhal, E. A., & Contrada, R. J. (1998). Self-regulation, health, and behavior: A perceptual-cognitive approach. Psychology & Health, 13(4), 717–733.  https://doi.org/10.1080/08870449808407425.CrossRefGoogle Scholar
  67. Levitt, J. M., Saka, N., Romanelli, H., L., & Hoagwood, K. (2007). Early identification of mental health problems in schools: The status of instrumentation. Journal of School Psychology, 45(2), 163–191.  https://doi.org/10.1016/j.jsp.2006.11.005.CrossRefGoogle Scholar
  68. Liu, S., Zhu, M., Yu, D. J., Rasin, A., & Young, S. D. (2017). Using real-time social media technologies to monitor levels of perceived stress and emotional state in college students: a web-based questionnaire study. JMIR Mental Health, 4(1), e2.  https://doi.org/10.2196/mental.5626.CrossRefPubMedPubMedCentralGoogle Scholar
  69. Luciana, M., & Nelson, C. A. (2002). Assessment of neuropsychological function through use of the cambridge neuropsychological testing automated battery: Performance in 4- to 12-year-old children. Developmental Neuropsychology, 22(3), 595–624.  https://doi.org/10.1207/S15326942DN2203_3.CrossRefPubMedGoogle Scholar
  70. Manly, T., Robertson, I. H., Anderson, V., & Nimmo-Smith, I. (1999). TEA-Ch: The test of everyday attention for children manual. Bury St. Edmunds: Thames Valley Test Company Limited.Google Scholar
  71. March, S., Day, J., Zieschank, K., & Ireland, M. (2018). The interactive child distress screener: Development and preliminary feasibility testing. JMIR MHealth and UHealth, 6(4), e90.  https://doi.org/10.2196/mhealth.9456.CrossRefPubMedPubMedCentralGoogle Scholar
  72. McClelland, M. M., & Cameron, C. E. (2012). Self-regulation in early childhood: Improving conceptual clarity and developing ecologically valid measures. Child Development Perspectives, 6(2), 136–142.  https://doi.org/10.1111/j.1750-8606.2011.00191.x.CrossRefGoogle Scholar
  73. Merry, S. N., Stasiak, K., Shepherd, M., Frampton, C., Fleming, T., & Lucassen, M. F. G. (2012). The effectiveness of SPARX, a computerised self help intervention for adolescents seeking help for depression: Randomised controlled non-inferiority trial. BMJ, 344, e2598–e2598.  https://doi.org/10.1136/bmj.e2598.CrossRefPubMedPubMedCentralGoogle Scholar
  74. Mislevy, R. J., Oranje, A., Bauer, M. I., von Davier, A., Hao, J., Corrigan, S., … John, M. (2014). Psychometric considerations in game-based assessment. GlassLab Report. Retrieved from https://web.archive.org/web/20160320151604/http://www.instituteofplay.org/wp-content/uploads/2014/02/GlassLab_GBA1_WhitePaperFull.pdf.
  75. Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex “Frontal Lobe” Tasks: A latent variable analysis. Cognitive Psychology, 41(1), 49–100.  https://doi.org/10.1006/cogp.1999.0734.CrossRefPubMedGoogle Scholar
  76. Moffitt, T. E., Arseneault, L., Belsky, D., Dickson, N., Hancox, R. J., Harrington, H., … Caspi, A. (2011). A gradient of childhood self-control predicts health, wealth, and public safety. Proceedings of the National Academy of Sciences of the United States of America, 108(7), 2693–2698.  https://doi.org/10.1073/pnas.1010076108.CrossRefPubMedPubMedCentralGoogle Scholar
  77. Morales, J., Calvo, A., & Bialystok, E. (2013). Working memory development in monolingual and bilingual children. Journal of Experimental Child Psychology, 114(2), 187–202.  https://doi.org/10.1016/j.jecp.2012.09.002.CrossRefPubMedGoogle Scholar
  78. Mueller, S. T. (2018). The Psychology Experiment Building Language. Retrieved from http://pebl.sourceforge.net/.
  79. Mueller, S. T., & Piper, B. J. (2014). The psychology experiment building language (PEBL) and PEBL test battery. Journal of Neuroscience Methods, 222, 250–259.  https://doi.org/10.1016/j.jneumeth.2013.10.024.CrossRefPubMedGoogle Scholar
  80. Neubauer, K., von Auer, M., Murray, E., Petermann, F., Helbig-Lang, S., & Gerlach, A. L. (2013). Internet-delivered attention modification training as a treatment for social phobia: A randomized controlled trial. Behaviour Research and Therapy, 51(2), 87–97.  https://doi.org/10.1016/j.brat.2012.10.006.CrossRefPubMedPubMedCentralGoogle Scholar
  81. Newby, J. M., Mackenzie, A., Williams, A. D., McIntyre, K., Watts, S., Wong, N., & Andrews, G. (2013). Internet cognitive behavioural therapy for mixed anxiety and depression: a randomized controlled trial and evidence of effectiveness in primary care. Psychological Medicine, 43(12), 2635–2648.  https://doi.org/10.1017/S0033291713000111.CrossRefPubMedGoogle Scholar
  82. Nigg, J. T. (2017). Annual Research Review: On the relations among self-regulation, self-control, executive functioning, effortful control, cognitive control, impulsivity, risk-taking, and inhibition for developmental psychopathology. Journal of Child Psychology and Psychiatry, 58(4), 361–383.  https://doi.org/10.1111/jcpp.12675.CrossRefPubMedGoogle Scholar
  83. Nordness, P. D., Epstein, M. H., Cullinan, D., & Pierce, C. D. (2014). Emotional and behavioral screener: Test-retest reliability, inter-rater reliability, and convergent validity. Remedial and Special Education, 35(4), 211–217.  https://doi.org/10.1177/0741932513497596.CrossRefGoogle Scholar
  84. Obradović, J., Sulik, M. J., Finch, J. E., & Tirado-Strayer, N. (2018). Assessing students’ executive functions in the classroom: Validating a scalable group-based procedure. Journal of Applied Developmental Psychology, 55, 4–13.  https://doi.org/10.1016/j.appdev.2017.03.003.CrossRefGoogle Scholar
  85. Parshall, C. G., Spray, J. A., Kalohn, J., & Davey, T. (2002). Practical considerations in computer-based testing. Berlin: Springer.CrossRefGoogle Scholar
  86. Parsons, T. D., Riva, G., Parsons, S., Mantovani, F., Newbutt, N., Lin, L., … Hall, T. (2017). Virtual reality in pediatric psychology. Pediatrics, 140(Suppl 2), S86–S91.  https://doi.org/10.1542/peds.2016-1758I.CrossRefPubMedGoogle Scholar
  87. Parsons, T. D., & Rizzo, A. A. (2008). Initial Validation of a virtual environment for assessment of memory functioning: Virtual reality cognitive performance assessment test. CyberPsychology & Behavior, 11(1), 17–25.  https://doi.org/10.1089/cpb.2007.9934.CrossRefGoogle Scholar
  88. Patrick, K., Hekler, E. B., Estrin, D., Mohr, D. C., Riper, H., Crane, D., … Riley, W. T. (2016). The pace of technologic change: Implications for digital health behavior intervention research. American Journal of Preventive Medicine, 51(5), 816–824.  https://doi.org/10.1016/j.amepre.2016.05.001.CrossRefPubMedGoogle Scholar
  89. Pennant, M. E., Loucas, C. E., Whittington, C., Creswell, C., Fonagy, P., Fuggle, P., … Kendall, T. (2015). Computerised therapies for anxiety and depression in children and young people: A systematic review and meta-analysis. Behaviour Research and Therapy, 67, 1–18.  https://doi.org/10.1016/j.brat.2015.01.009.CrossRefPubMedGoogle Scholar
  90. Picard, L., Abram, M., Orriols, E., & Piolino, P. (2017). Virtual reality as an ecologically valid tool for assessing multifaceted episodic memory in children and adolescents. International Journal of Behavioral Development, 41(2), 211–219.  https://doi.org/10.1177/0165025415616198.CrossRefGoogle Scholar
  91. Pollard, E. L., & Lee, P. D. (2003). Child well-being: A systematic review of the literature. Social Indicators Research, 61(1), 59–78.  https://doi.org/10.1023/A:1021284215801.CrossRefGoogle Scholar
  92. Ponitz, C. E. C., McClelland, M. M., Jewkes, A. M., Connor, C. M., Farris, C. L., & Morrison, F. J. (2008). Touch your toes! developing a direct measure of behavioral regulation in early childhood. Early Childhood Research Quarterly, 23(2), 141–158.  https://doi.org/10.1016/j.ecresq.2007.01.004.CrossRefGoogle Scholar
  93. Ponitz, C. E. C., McClelland, M. M., Matthews, J. S., & Morrison, F. J. (2009). A structured observation of behavioral self-regulation and its contribution to kindergarten outcomes. Developmental Psychology, 45(3), 605–619.  https://doi.org/10.1037/a0015365.CrossRefPubMedGoogle Scholar
  94. Pramana, G., Parmanto, B., Kendall, P. C., & Silk, J. S. (2014). The SmartCAT: An m-Health platform for ecological momentary intervention in child anxiety treatment. Telemedicine and E-Health, 20(5), 419–427.  https://doi.org/10.1089/tmj.2013.0214.CrossRefPubMedGoogle Scholar
  95. Prencipe, A., & Zelazo, P. D. (2005). Development of affective decision making for self and other: Evidence for the integration of first- and third-person perspectives. Psychological Science, 16(7), 501–505.  https://doi.org/10.1111/j.0956-7976.2005.01564.x.CrossRefPubMedGoogle Scholar
  96. Quiroz, J. C., Geangu, E., & Yong, M. H. (2018). Emotion-recognition using smart watch sensor data: Mixed-design study (Preprint). JMIR Mental Health.  https://doi.org/10.2196/10153.
  97. Raines, T. C., Dever, B. V., Kamphaus, R. W., & Roach, A. T. (2012). Universal screening for behavioral and emotional risk: A promising method for reducing disproportionate placement in special education. The Journal of Negro Education, 81(3), 283–296.  https://doi.org/10.7709/jnegroeducation.81.3.0283.CrossRefGoogle Scholar
  98. Riva, G. (1997). Virtual reality in neuro-psycho-physiology: Cognitive, clinical and methodological issues in assessment and rehabilitation. Amsterdam: IOS Press.Google Scholar
  99. Riva, G. (1998). Virtual reality in psychological assessment: The body image virtual reality scale. CyberPsychology & Behavior, 1(1), 37–44.  https://doi.org/10.1089/cpb.1998.1.37.CrossRefGoogle Scholar
  100. Rothbart, M. K., Ahadi, S. A., Hershey, K. L., & Fisher, P. (2001). Investigations of temperament at three to seven years: The children’s behavior questionnaire. Child Development, 72(5), 1394–1408.  https://doi.org/10.1111/1467-8624.00355.CrossRefPubMedGoogle Scholar
  101. Sandercock, G. R. H., Alibrahim, M., & Bellamy, M. (2016). Media device ownership and media use: Associations with sedentary time, physical activity and fitness in English youth. Preventive Medicine Reports, 4, 162–168.  https://doi.org/10.1016/j.pmedr.2016.05.013.CrossRefPubMedPubMedCentralGoogle Scholar
  102. Sanders, M. R., & Mazzucchelli, T. G. (2013). The promotion of self-regulation through parenting interventions. Clinical Child and Family Psychology Review, 16(1), 1–17.  https://doi.org/10.1007/s10567-013-0129-z.CrossRefPubMedGoogle Scholar
  103. Schlegl, S., Bürger, C., Schmidt, L., Herbst, N., & Voderholzer, U. (2015). The potential of technology-based psychological interventions for anorexia and bulimia nervosa: A systematic review and recommendations for future research. Journal of Medical Internet Research, 17(3), e85.  https://doi.org/10.2196/jmir.3554.CrossRefPubMedPubMedCentralGoogle Scholar
  104. Shallice, T. (1982). Specific impairments of planning. Philosophical Transactions of the Royal Society B, 298(1089), 199–209.  https://doi.org/10.1098/rstb.1982.0082.CrossRefGoogle Scholar
  105. Shapiro, E. S. (2000). School psychology from an instructional perspective: Solving big, not little problems. School Psychology Review, 29(4), 560.Google Scholar
  106. Shute, V. J., Ke, F., & Wang, L. (2017). Assessment and Adaptation in Games. In P. Wouters & H. van Oostendorp (Eds.), Instructional techniques to facilitate learning and motivation of serious games (pp. 59–78). Cham: Springer International Publishing.  https://doi.org/10.1007/978-3-319-39298-1_4.CrossRefGoogle Scholar
  107. Shute, V. J., Leighton, J. P., Jang, E. E., & Chu, M.-W. (2016). Advances in the science of assessment. Educational Assessment, 21(1), 34–59.  https://doi.org/10.1080/10627197.2015.1127752.CrossRefGoogle Scholar
  108. Somech, L. Y., & Elizur, Y. (2012). Promoting self-regulation and cooperation in pre-kindergarten children with conduct problems: A randomized controlled trial. Journal of the American Academy of Child and Adolescent Psychiatry, 51(4), 412–422.  https://doi.org/10.1016/j.jaac.2012.01.019.CrossRefPubMedGoogle Scholar
  109. Spence, S. H., Donovan, C. L., March, S., Gamble, A., Anderson, R., Prosser, S., … Kenardy, J. (2008). Online CBT in the treatment of child and adolescent anxiety disorders: Issues in the development of BRAVE–ONLINE and two case illustrations. Behavioural and Cognitive Psychotherapy, 36(04), 411–430.  https://doi.org/10.1017/S135246580800444X.CrossRefGoogle Scholar
  110. Spence, S. H., Donovan, C. L., March, S., Gamble, A., Anderson, R. E., Prosser, S., & Kenardy, J. (2011). A randomized controlled trial of online versus clinic-based CBT for adolescent anxiety. Journal of Consulting and Clinical Psychology, 79(5), 629–642.  https://doi.org/10.1037/a0024512.CrossRefPubMedGoogle Scholar
  111. Spiegel, J. A., & Lonigan, C. J. (2018). A head-to-toes approach to computerized testing of executive functioning in young children. Early Childhood Research Quarterly, 44, 15–23.  https://doi.org/10.1016/j.ecresq.2018.01.008.CrossRefGoogle Scholar
  112. Stanger, C., & Lewis, M. (2010). Agreement among parents, teachers, and children on internalizing and externalizing behavior problems. Journal of Clinical Child Psychology, 22(1), 107–116.  https://doi.org/10.1207/s15374424jccp2201_11.CrossRefGoogle Scholar
  113. Stewart, P., Reihman, J., Gump, B., Lonky, E., Darvill, T., & Pagano, J. (2005). Response inhibition at 8 and 9 1/2 years of age in children prenatally exposed to PCBs. Neurotoxicology and Teratology, 27(6), 771–780.  https://doi.org/10.1016/j.ntt.2005.07.003.CrossRefPubMedGoogle Scholar
  114. Strecher, V. J. (2007). Internet methods for delivering behavioral and health-related interventions (eHealth). Annual Review of Clinical Psychology, 3(1), 53–76.  https://doi.org/10.1146/annurev.clinpsy.3.022806.091428.CrossRefPubMedGoogle Scholar
  115. Tangney, J. P., Baumeister, R. F., & Boone, A. L. (2004). High self-control predicts good adjustment, less pathology, better grades, and interpersonal success. Journal of Personality, 72(2), 271–324.  https://doi.org/10.1111/j.0022-3506.2004.00263.x.CrossRefGoogle Scholar
  116. Toplak, M. E., West, R. F., & Stanovich, K. E. (2013). Practitioner Review: Do performance-based measures and ratings of executive function assess the same construct? Journal of Child Psychology and Psychiatry, 54(2), 131–143.  https://doi.org/10.1111/jcpp.12001.CrossRefPubMedGoogle Scholar
  117. Tsukayama, E., Toomey, S. L., Faith, M. S., & Duckworth, A. L. (2010). Self-control as a protective factor against overweight status in the transition from childhood to adolescence. Archives of Pediatrics & Adolescent Medicine, 164(7).  https://doi.org/10.1001/archpediatrics.2010.97.
  118. Turner, K. M. T., Baker, S., & Day, J. J. (2018). Technology-assisted delivery of parenting programs. In T. G. Mazzucchelli & M. R. Sanders (Eds.), The power of positive parenting: Transforming the lives of children, parents and communities using the Triple P system (1st ed.). Oxford: Oxford University Press.Google Scholar
  119. van Ede, F., & Maris, E. (2016). Physiological plausibility can increase reproducibility in cognitive neuroscience. Trends in Cognitive Sciences, 20(8), 567–569.  https://doi.org/10.1016/j.tics.2016.05.006.CrossRefPubMedGoogle Scholar
  120. Ventura, M., & Shute, V. (2013). The validity of a game-based assessment of persistence. Computers in Human Behavior, 29(6), 2568–2572.  https://doi.org/10.1016/j.chb.2013.06.033.CrossRefGoogle Scholar
  121. Wagner, B., Fitzpatrick, J. P., Mazzucchelli, T. G., Symons, M., Carmichael Olson, H., Jirikowic, T., … Latimer, J. (2018). Study protocol for a self-controlled cluster randomised trial of the Alert Program to improve self-regulation and executive function in Australian Aboriginal children with fetal alcohol spectrum disorder. BMJ Open, 8(3), e021462.CrossRefPubMedPubMedCentralGoogle Scholar
  122. Weintraub, S., Bauer, P. J., Zelazo, P. D., Wallner-Allen, K., Dikmen, S. S., Heaton, R. K., … Gershon, R. C. (2013). I. NIH Toolbox cognition battery (CB): Introduction and pediatric data. Monographs of the Society for Research in Child Development, 78(4), 1–15.  https://doi.org/10.1111/mono.12031.CrossRefPubMedPubMedCentralGoogle Scholar
  123. Wiebe, S. A., Espy, K. A., & Charak, D. (2008). Using confirmatory factor analysis to understand executive control in preschool children: I. latent structure. Developmental Psychology, 44(2), 575.CrossRefPubMedGoogle Scholar
  124. Yamamoto, N., & Imai-Matsumura, K. (2017). Gender differences in executive function and behavioural self-regulation in 5 years old kindergarteners from East Japan. Early Child Development and Care, 1–12.  https://doi.org/10.1080/03004430.2017.1299148.
  125. Yardley, L., Spring, B. J., Riper, H., Morrison, L. G., Crane, D. H., Curtis, K., … Blandford, A. (2016). Understanding and promoting effective engagement with digital behavior change interventions. American Journal of Preventive Medicine, 51(5), 833–842.  https://doi.org/10.1016/j.amepre.2016.06.015.CrossRefPubMedGoogle Scholar
  126. Yarosh, S., & Schueller, S. M. (2017). “Happiness inventors”: informing positive computing technologies through participatory design with children. Journal of Medical Internet Research, 19(1), e14.  https://doi.org/10.2196/jmir.6822.CrossRefPubMedPubMedCentralGoogle Scholar
  127. Zapata-Rivera, D., & Bauer, M. (2012). Exploring the role of games in educational assessment. Technology-based assessments for twenty-first-century skills: Theoretical and practical implications from modern Research, 147–169.Google Scholar
  128. Zhou, Q., Chen, S. H., & Main, A. (2012). Commonalities and differences in the research on children’s effortful control and executive function: A call for an integrated model of self-regulation. Child Development Perspectives, 6(2), 112–121.  https://doi.org/10.1111/j.1750-8606.2011.00176.x.CrossRefGoogle Scholar
  129. Ziv, Y., Benita, M., & Sofri, I. (2017). Self-regulation in childhood: A developmental perspective. In J. L. Matson (Ed.), Handbook of social behavior and skills in children (pp. 149–173). Cham: Springer.  https://doi.org/10.1007/978-3-319-64592-6_10.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Family Action Centre, Faculty of Health and MedicineUniversity of NewcastleCallaghanAustralia
  2. 2.Griffith Criminology InstituteGriffith UniversityMount GravattAustralia

Personalised recommendations