First Steps for Conducting Online Research with Adolescents: Basic Considerations for Implementation Success

Abstract

Online delivery of mental health resources and interventions has many benefits, including scalability. This may be particularly relevant when in-person services are limited and researchers need to transition their work to online platforms. This report aims to describe the challenges experienced in a pilot study of an online program (Teen Wellness [TW]) for adolescents and outline first step considerations for conducting online research with adolescents. A total of 16 participants (Mage = 13.125; 43.8% female) in an after-school program engaged with TW. The usefulness was rated 7.62 out of 10 and 68.8% of participants completed all modules. Significant changes in the adolescents’ satisfaction with “self” (p = 0.035) and “friendships” (p = 0.035) were observed. The pilot study informs researchers doing their first steps in online research with adolescents. Basic considerations are related to determining the desired level of human support and setting, the consent-assent process, designing or utilizing an existing online resource, utilizing agile design, and including adolescent feedback.

This is a preview of subscription content, access via your institution.

References

  1. Andersson, G., & Cuijpers, P. (2009). Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cognitive Behaviour Therapy, 38(4), 196–205.

    Article  Google Scholar 

  2. Brothers, K. B., Clayton, E. W., & Goldenberg, A. J. (2020). Online pediatric research: Addressing consent, assent, and parental permission. The Journal of Law, Medicine & Ethics, 48(1_suppl), 129–137. https://doi.org/10.1177/1073110520917038.

  3. Bunge, E. L., Beard, C. L., Stephens, T. N., Leykin, Y., & Muñoz, R. F. (2017). Mood management effects of a brief behavioral activation internet intervention. Journal of Technology in Behavioral Science, 2, 163–170.

    Article  Google Scholar 

  4. Bunge, E., Jones, M., Dickter, B., Perales, R., & Spear, A. (2016). Information systems and technology. In S. Patel & D. Reicherter (Eds.), Psychotherapy for Immigrant Youth (pp. 127–145). Zurich, Switzerland: Springer International Publishing.

    Google Scholar 

  5. Bunge, E., Williamson, R. E., Cano, M., Leykin, Y., & Muñoz, R. F. (2016). Mood management effects of brief unsupported internet interventions. Internet Interventions, 5(2016), 36–43. https://doi.org/10.1016/j.invent.2016.06.001.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Carver, L. B. (2016). Teacher perception of barriers and benefits in K-12 technology use. The Turkish Online Journal of Educational Technology (TOJET), 15(1), 110–116.

    Google Scholar 

  7. Cavazos-Rehg, P., Min, C., Fitzsimmons-Craft, E. E., Savoy, B., Kaiser, N., Riordan, R., et al. (2020). Parental consent: a potential barrier for underage teens’ participation in an mHealth mental health intervention. Internet Interventions, 21, 1–7. https://doi.org/10.1016/j.invent.2020.100328.

    Article  Google Scholar 

  8. Eysenbach, G. (2005). The law of attrition. Journal of Medical Internet Research, 7(1), e11. https://doi.org/10.2196/jmir.7.1.e11.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Gladstone, T. G., Marko-Holguin, M., Rothberg, P., Nidetz, J., Diehl, A., DeFrino, D. T., et al. (2015). An internet-based adolescent depression prevention intervention: study protocol for a randomized control trial. Trials, 16(203), 1–17. https://doi.org/10.1186/s13063-015-0705-2.

    Article  Google Scholar 

  10. Goodman, R., Meltzer, H., & Bailey, V. (1998). The strengths and difficulties questionnaire: pilot study on the validity of the self-report version. European Child & Adolescent Psychiatry, 7(3), 125–130. https://doi.org/10.1080/0954026021000046137.

    Article  Google Scholar 

  11. Hetrick, S. E., Robinson, J., Burge, E., Blandon, R., Mobilio, B., Rice, S. M., et al. (2018). Youth codesign of a mobile phone app to facilitate self-monitoring and management of mood symptoms in young people with major depression, suicidal ideation, and self-harm. Journal of Medical Internet Research Mental Health, 5(1), e9. https://doi.org/10.2196/mental.9041.

    Article  Google Scholar 

  12. Higinbotham, M. K., Emmert-Aronson, B., & Bunge, E. L. (2020). A meta-analysis of the effectiveness of behavioral intervention technologies and face-to-face cognitive behavioral therapy for youth with depression. Journal of Technology in Behavioral Science, 1–12. https://doi.org/10.1007/s41347-020-00139-6.

  13. Institute of Education Sciences [IES]. (2010). Fast Facts: Educational Technology. National Center for Education Statistics. Retrieved from http://nces.ed.gov/fastfacts/display.asp?id=46.

  14. Jones, M. K., Dickter, B., Beard, C., Perales, R., & Bunge, E. L. (2016). Meta-analysis on cognitive behavioral treatment and behavioral intervention technologies for anxious youth: More than a BIT effective. Contemporary Behavioral Health Care, 2(1), 1–9. https://doi.org/10.15761/CBHC.1000115.

    Article  Google Scholar 

  15. Kautz, K. (2011). Investigating the design process: participatory design in agile software development. Information Technology & People, 24(3), 217–235. https://doi.org/10.1108/09593841111158356.

    Article  Google Scholar 

  16. Muñoz, R. F., Leykin, Y., Barrera, A. Z., Brown, C. H., & Bunge, E. L. (2017). The impact of phone calls on follow-up rates in an online depression prevention study. Internet Interventions, 8, 10–14.

    Article  Google Scholar 

  17. Muñoz, R. F., Chavira, D. A., Himle, J. A., Koerner, K., Muroff, J., Reynolds, J., Rose, R. D., Ruzek, J. I., Teachman, B. A., & Schueller, S. M. (2018). Digital apothecaries: a vision for making health care interventions accessible worldwide. mHealth, 4(18), 1–13. https://doi.org/10.21037/mhealth.2018.05.04.

  18. Seligson, J. L., Huebner, E. S., & Valois, R. F. (2003). Preliminary validation of the brief multidimensional students’ life satisfaction scale (BMSLSS). Social Indicators Research, 61(2), 121–145.

    Article  Google Scholar 

  19. Sy, D. (2007). Adapting usability investigations for agile user-centered design. Journal of Usability Studies, 2(3), 112–132.

    Google Scholar 

  20. Tonge, B., King, N., Klimkeit, E., Melvin, G., Heyne, D., & Gordon, M. (2005). The self-efficacy questionnaire for depression in adolescents (SEQ-DA). Development and psychometric evaluation. European Child & Adolescent Psychiatry, 14(7), 357–363. https://doi.org/10.1007/s00787-005-0462-y.

    Article  Google Scholar 

  21. Van Voorhees, B. W., Fogel, J., Reinecke, M. A., Gladstone, T., Stuart, S., Gollan, J., & Bell, C. (2009). Randomized clinical trial of an internet-based depression prevention program for adolescents (project CATCH-IT) in primary care: 12 week outcomes. Journal of Developmental and Behavioral Pediatrics, 30(1), 23–37. https://doi.org/10.1097/DBP.0b013e3181966c2a.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Whittaker, R., Maddison, R., McRobbie, H., Bullen, C., Denny, S., Dorey, E., et al. (2008). A multimedia mobile phone-based youth smoking cessation intervention: findings from content development and piloting studies. Journal of Medical Internet Research, 10(5), e49. https://doi.org/10.2196/jmir.1007.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgments

Mevident Inc., The YMCA Silicon Valley, Lee Pfab, Daniel Saavedra, and Tina Bernal

Author information

Affiliations

Authors

Corresponding author

Correspondence to Eduardo L. Bunge.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Ethical Approval

This manuscript has not been published and is not under consideration for publication elsewhere.

Informed Consent

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. For this type of study, formal consent was obtained in accordance with the Palo Alto University Institutional Review Board (#FWA00010885). This article does not contain any studies with animals performed by any of the authors.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Stephens, T.N., Tilden, C. & Bunge, E.L. First Steps for Conducting Online Research with Adolescents: Basic Considerations for Implementation Success. J. technol. behav. sci. (2021). https://doi.org/10.1007/s41347-021-00194-7

Download citation

Keywords

  • Adolescents
  • Internet
  • Wellness
  • Online research
  • Implementation science