Online delivery of mental health resources and interventions has many benefits, including scalability. This may be particularly relevant when in-person services are limited and researchers need to transition their work to online platforms. This report aims to describe the challenges experienced in a pilot study of an online program (Teen Wellness [TW]) for adolescents and outline first step considerations for conducting online research with adolescents. A total of 16 participants (Mage = 13.125; 43.8% female) in an after-school program engaged with TW. The usefulness was rated 7.62 out of 10 and 68.8% of participants completed all modules. Significant changes in the adolescents’ satisfaction with “self” (p = 0.035) and “friendships” (p = 0.035) were observed. The pilot study informs researchers doing their first steps in online research with adolescents. Basic considerations are related to determining the desired level of human support and setting, the consent-assent process, designing or utilizing an existing online resource, utilizing agile design, and including adolescent feedback.
This is a preview of subscription content, access via your institution.
Buy single article
Instant access to the full article PDF.
Tax calculation will be finalised during checkout.
Subscribe to journal
Immediate online access to all issues from 2019. Subscription will auto renew annually.
Tax calculation will be finalised during checkout.
Andersson, G., & Cuijpers, P. (2009). Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cognitive Behaviour Therapy, 38(4), 196–205.
Brothers, K. B., Clayton, E. W., & Goldenberg, A. J. (2020). Online pediatric research: Addressing consent, assent, and parental permission. The Journal of Law, Medicine & Ethics, 48(1_suppl), 129–137. https://doi.org/10.1177/1073110520917038.
Bunge, E. L., Beard, C. L., Stephens, T. N., Leykin, Y., & Muñoz, R. F. (2017). Mood management effects of a brief behavioral activation internet intervention. Journal of Technology in Behavioral Science, 2, 163–170.
Bunge, E., Jones, M., Dickter, B., Perales, R., & Spear, A. (2016). Information systems and technology. In S. Patel & D. Reicherter (Eds.), Psychotherapy for Immigrant Youth (pp. 127–145). Zurich, Switzerland: Springer International Publishing.
Bunge, E., Williamson, R. E., Cano, M., Leykin, Y., & Muñoz, R. F. (2016). Mood management effects of brief unsupported internet interventions. Internet Interventions, 5(2016), 36–43. https://doi.org/10.1016/j.invent.2016.06.001.
Carver, L. B. (2016). Teacher perception of barriers and benefits in K-12 technology use. The Turkish Online Journal of Educational Technology (TOJET), 15(1), 110–116.
Cavazos-Rehg, P., Min, C., Fitzsimmons-Craft, E. E., Savoy, B., Kaiser, N., Riordan, R., et al. (2020). Parental consent: a potential barrier for underage teens’ participation in an mHealth mental health intervention. Internet Interventions, 21, 1–7. https://doi.org/10.1016/j.invent.2020.100328.
Eysenbach, G. (2005). The law of attrition. Journal of Medical Internet Research, 7(1), e11. https://doi.org/10.2196/jmir.7.1.e11.
Gladstone, T. G., Marko-Holguin, M., Rothberg, P., Nidetz, J., Diehl, A., DeFrino, D. T., et al. (2015). An internet-based adolescent depression prevention intervention: study protocol for a randomized control trial. Trials, 16(203), 1–17. https://doi.org/10.1186/s13063-015-0705-2.
Goodman, R., Meltzer, H., & Bailey, V. (1998). The strengths and difficulties questionnaire: pilot study on the validity of the self-report version. European Child & Adolescent Psychiatry, 7(3), 125–130. https://doi.org/10.1080/0954026021000046137.
Hetrick, S. E., Robinson, J., Burge, E., Blandon, R., Mobilio, B., Rice, S. M., et al. (2018). Youth codesign of a mobile phone app to facilitate self-monitoring and management of mood symptoms in young people with major depression, suicidal ideation, and self-harm. Journal of Medical Internet Research Mental Health, 5(1), e9. https://doi.org/10.2196/mental.9041.
Higinbotham, M. K., Emmert-Aronson, B., & Bunge, E. L. (2020). A meta-analysis of the effectiveness of behavioral intervention technologies and face-to-face cognitive behavioral therapy for youth with depression. Journal of Technology in Behavioral Science, 1–12. https://doi.org/10.1007/s41347-020-00139-6.
Institute of Education Sciences [IES]. (2010). Fast Facts: Educational Technology. National Center for Education Statistics. Retrieved from http://nces.ed.gov/fastfacts/display.asp?id=46.
Jones, M. K., Dickter, B., Beard, C., Perales, R., & Bunge, E. L. (2016). Meta-analysis on cognitive behavioral treatment and behavioral intervention technologies for anxious youth: More than a BIT effective. Contemporary Behavioral Health Care, 2(1), 1–9. https://doi.org/10.15761/CBHC.1000115.
Kautz, K. (2011). Investigating the design process: participatory design in agile software development. Information Technology & People, 24(3), 217–235. https://doi.org/10.1108/09593841111158356.
Muñoz, R. F., Leykin, Y., Barrera, A. Z., Brown, C. H., & Bunge, E. L. (2017). The impact of phone calls on follow-up rates in an online depression prevention study. Internet Interventions, 8, 10–14.
Muñoz, R. F., Chavira, D. A., Himle, J. A., Koerner, K., Muroff, J., Reynolds, J., Rose, R. D., Ruzek, J. I., Teachman, B. A., & Schueller, S. M. (2018). Digital apothecaries: a vision for making health care interventions accessible worldwide. mHealth, 4(18), 1–13. https://doi.org/10.21037/mhealth.2018.05.04.
Seligson, J. L., Huebner, E. S., & Valois, R. F. (2003). Preliminary validation of the brief multidimensional students’ life satisfaction scale (BMSLSS). Social Indicators Research, 61(2), 121–145.
Sy, D. (2007). Adapting usability investigations for agile user-centered design. Journal of Usability Studies, 2(3), 112–132.
Tonge, B., King, N., Klimkeit, E., Melvin, G., Heyne, D., & Gordon, M. (2005). The self-efficacy questionnaire for depression in adolescents (SEQ-DA). Development and psychometric evaluation. European Child & Adolescent Psychiatry, 14(7), 357–363. https://doi.org/10.1007/s00787-005-0462-y.
Van Voorhees, B. W., Fogel, J., Reinecke, M. A., Gladstone, T., Stuart, S., Gollan, J., & Bell, C. (2009). Randomized clinical trial of an internet-based depression prevention program for adolescents (project CATCH-IT) in primary care: 12 week outcomes. Journal of Developmental and Behavioral Pediatrics, 30(1), 23–37. https://doi.org/10.1097/DBP.0b013e3181966c2a.
Whittaker, R., Maddison, R., McRobbie, H., Bullen, C., Denny, S., Dorey, E., et al. (2008). A multimedia mobile phone-based youth smoking cessation intervention: findings from content development and piloting studies. Journal of Medical Internet Research, 10(5), e49. https://doi.org/10.2196/jmir.1007.
Mevident Inc., The YMCA Silicon Valley, Lee Pfab, Daniel Saavedra, and Tina Bernal
Conflict of Interest
The authors declare that they have no conflict of interest.
This manuscript has not been published and is not under consideration for publication elsewhere.
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. For this type of study, formal consent was obtained in accordance with the Palo Alto University Institutional Review Board (#FWA00010885). This article does not contain any studies with animals performed by any of the authors.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Stephens, T.N., Tilden, C. & Bunge, E.L. First Steps for Conducting Online Research with Adolescents: Basic Considerations for Implementation Success. J. technol. behav. sci. (2021). https://doi.org/10.1007/s41347-021-00194-7
- Online research
- Implementation science