Springer Nature is making SARS-CoV-2 and COVID-19 research free. View research | View latest news | Sign up for updates

Assessing the Social Validity of a Telepractice Training and Coaching Intervention

  • 18 Accesses

Abstract

Developing communication skills is critical for all young children, especially for those receiving early intervention (EI) services. Thus, many researchers have investigated evidence-based practices for teaching social communication skills. In an attempt to minimize the gap between research and practice, research investigating training caregivers to use communication teaching strategies has been conducted and replicated. In many studies, interventions have been delivered by researchers rather than natural change agents. The purpose of this study was to assess the social validity of a caregiver-implemented communication strategies intervention program in which the caregiver was trained and coached by a natural change agent, the family’s EI service provider, via telepractice. We analyzed multiple sources of data to investigate the social validity of the intervention program. We found that some aspects of the program had high levels of social validity (e.g., goals and outcomes). Other aspects of the program had lower levels of social validity (e.g., procedures and technology use). The findings, limitations, and implications for practice and research are discussed.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2

References

  1. Baer, D. M., Wolf, M. M., & Risley, T. R. (1987). Some still-current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis,20(4), 313–327. https://doi.org/10.1901/jaba.1987.20-313.

  2. Barton, E. E., & Fettig, A. (2013). Parent-implemented interventions for young children with disabilities: A review of fidelity procedures. Journal of Early Intervention,35, 194–219. https://doi.org/10.1177/1053815113504625.

  3. Barton, E. E., Meadan, H., & Ledford, J. R. (2018). Independent variables, fidelity, and social validity. In J. R. Ledford & D. L. Gast (Eds.), Single case research in behavioral sciences (3rd ed., pp. 133–156). New York: Routledge.

  4. Biggs, E. E., & Meadan, H. (2018). Early communication interventions for young children with intellectual and developmental disabilities: The roles of natural communication partners. International Review of Research in Developmental Disabilities,55, 1–37.

  5. Callahan, K., Hughes, H. L., Mehta, S., Toussaint, K. A., Nichols, S. M., Ma, P. S., et al. (2017). Social validity of evidence-based practices and emerging interventions in autism. Focus on Autism and Other Developmental Disabilities,32, 188–197. https://doi.org/10.1177/1088357616632446.

  6. Carr, E. G., Dunlap, G., Horner, R. H., Koegel, R. L., Turnbull, A. P., Sailor, W., et al. (2002). Positive behavior support: Evolution of an applied science. Journal of Positive Behavior Interventions,4(1), 4–16. https://doi.org/10.1177/109830070200400102.

  7. Chung, M. Y., Snodgrass, M. R., Meadan, H., Akamoglu, Y. A., & Halle, J. W. (2016). Understanding communication intervention for young children with autism and their parents: Exploring measurement decisions and confirmation bias. Journal of Developmental and Physical Disabilities. https://doi.org/10.1007/s10882-015-9468-7.

  8. Cook, B. G., & Odom, S. L. (2013). Evidence-based practices and implementation science in special education. Exceptional Children,79, 135–144. https://doi.org/10.1177/001440291307900201.

  9. Drew, A., Baird, G., Baron-Cohen, S., Cox, A., Slonims, V., Wheelwright, S., et al. (2002). A pilot randomised control trial of a parent training intervention for pre-school children with autism—Preliminary findings and methodological challenges. European Child and Adolescent Psychiatry,11, 266–272. https://doi.org/10.1007/s00787-002-0299-6.

  10. Fenson, L., Marchman, V. A., Thal, D. J., Dale, P. S., Reznick, S., & Bates, E. (2007). MacArthur-Bates communicative development inventories (2nd ed.). Baltimore, MD: Brookes.

  11. Ferguson, J., Craig, E. A., & Dounavi, K. (2019). Telehealth as a model for providing behavior analytic interventions to individuals with autism spectrum disorder: A systematic review. Journal of Autism and Developmental Disorders,49(2), 582–616. https://doi.org/10.1007/s10803-018-3724-5.

  12. Finn, C. A., & Sladeczek, I. E. (2001). Assessing the social validity of behavioral interventions: A review of treatment acceptability measures. School Psychology Quarterly,16, 176–206. https://doi.org/10.1521/scpq.16.2.176.18703.

  13. Green, J., Charman, T., McConachie, H., Aldred, C., Slonims, V., Howlin, P., et al. (2010). Parent-mediated communication-focused treatment in children with autism (PACT): A randomised controlled trial. Lancet,375, 2152–2160. https://doi.org/10.1016/S0140-6736(10)60587-9.

  14. Hallam, R. A., Rous, B., Grove, J., & LoBianco, T. (2009). Level and intensity of early intervention Services for infants and toddlers with disabilities: The impact of child, family, system, and community-level factors on service provision. Journal of Early Intervention,31(2), 179–196. https://doi.org/10.1177/1053815109331914.

  15. Hanley, G. P. (2010). Toward effective and preferred programming: A case for the objective measurement of social validity with recipients of behavior-change programs. Behavior Analysis in Practice,3, 13–21. https://doi.org/10.10007/BF03391754.

  16. Harrison, J. R., State, T. M., Evans, S. W., & Schamberg, T. (2016). Construct and predictive validity of social acceptability: Scores from high school teacher rating on the school intervention rating form. Journal of Positive Behavior Interventions,18, 111–123. https://doi.org/10.1177/1098300715596135.

  17. Heitzman-Powell, L. S., Buzhardt, J., Rusinko, L. C., & Miller, T. M. (2014). Formative evaluation of an ABA outreach training program for parents of children with autism in remote areas. Focus on Autism and Other Developmental Disabilities,29(1), 23–38. https://doi.org/10.1177/1088357613504992.

  18. Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2005). The use of single-subject research to identify evidence-based practice in special education. Exceptional Children,71, 165–179. https://doi.org/10.1177/001440290507100203.

  19. Individuals with Disabilities Education Act. (2004). Pub. L. No. 108-446, §632, 118 Stat. 2744.

  20. Justice, L. M., Skibbe, L. E., McGinty, A. S., Piasta, S. B., & Petrill, S. (2011). Feasibility, efficacy, and social validity of home-based storybook reading intervention for children with language impairment. Journal of Speech, Language, and Hearing Research,54, 523–538. https://doi.org/10.1044/1092-4388.

  21. Kaiser, A. P., Hancock, T. B., & Nietfeld, J. P. (2000). The effects of parent-implemented enhanced milieu teaching on the social communication of children who have autism. Early Education and Development,11, 423–446.

  22. Kaiser, A. P., & Roberts, M. Y. (2013). Parent-implemented enhanced milieu teaching with preschool children with intellectual disabilities. Journal of Speech, Language, and Hearing Research,56, 295–309. https://doi.org/10.1044/1092-4388.

  23. Kazdin, A. E. (1977). Assessing the clinical or applied importance of behavior change through social validation. Behavior Modification,1, 427–452. https://doi.org/10.1177/014544557714001.

  24. Kazdin, A. E. (2011). Single-case research designs: Methods for clinical and applied settings (2nd ed.). New York, NY: Academic Press.

  25. Kennedy, C. H. (2002). The maintenance of behavior change as an indicator of social validity. Behavior Modification,26(5), 594–604. https://doi.org/10.1177/014544502236652.

  26. Kramer, J. M. (2011). Using mixed methods to establish the social validity of a self-report assessment: An illustration using the Child Occupational Self-Assessment (COSA). Journal of Mixed Methods Research,5(1), 52–76. https://doi.org/10.1177/1558689810386376.

  27. Ledford, J. R., Hall, E., Conder, E., & Lane, J. D. (2016). Research for young children with autism spectrum disorders: Evidence of social and ecological validity. Topics in Early Childhood Special Education,35, 223–233. https://doi.org/10.1177/0271121415585956.

  28. Little, L. M., Pope, E., Wallisch, A., & Dunn, W. (2018). Occupation-based coaching by means of telehealth for families of young children with autism spectrum disorder. The American Journal of Occupational Therapy,72(2), 7202205020. https://doi.org/10.5014/ajot.2018.024786.

  29. Machalicek, W., Lequia, J., Pinkelman, S., Knowles, C., Raulston, T., Davis, T., et al. (2016). Behavioral telehealth consultation with families of children with Autism Spectrum Disorder. Behavioral Interventions,31, 223–250. https://doi.org/10.1002/bin.1450.

  30. McDuffie, A., Machalicek, W., Oakes, A., Haebig, E., Weismer, S. E., & Abbeduto, L. J. (2013). Distance video-teleconferencing in early intervention: Pilot study of a naturalistic parent-implemented language intervention. Psychiatry and Behavioral Sciences,33, 172–185. https://doi.org/10.1177/0271121413476348.

  31. Meadan, H., Angell, M. E., Stoner, J. B., & Daczewitz, M. E. (2014). Parent-implemented social-pragmatic communication intervention: A pilot study. Focus on Autism and Other Developmental Disabilities,29, 95–110. https://doi.org/10.1177/1088357613517504.

  32. Meadan, H., Chung, M. Y., Sands, M. M., & Snodgrass, M. R. (2019, in press). The cascading coaching model: Researcher, service provider, caregiver, and child. Journal of Special Education.

  33. Meadan, H., Snodgrass, M. R., Meyer, L. E., Fisher, K. W., Chung, M. Y., & Halle, J. W. (2016). Internet-based parent-implemented intervention for young children with autism: A pilot study. Journal of Early Intervention,38(1), 3–23. https://doi.org/10.1177/1053815116630327.

  34. Miles, M. B., Huberman, M., & Saldaña, J. (2014). Qualitative data analysis: A methods sourcebook and the coding manual for qualitative researchers. Thousand Oaks, CA: Sage.

  35. Ogilvie, E., & McCrudden, M. T. (2017). Evaluating the social validity of the early start Denver model: A convergent mixed methods study. Journal of Autism and Developmental Disorders,47, 2899–2910.

  36. Olive, M. L., & Liu, Y. (2005). Social validity of parent and teacher implemented assessment-based interventions for challenging behavior. Educational Psychology,25, 305–312. https://doi.org/10.1080/0144341042000301229.

  37. Page, J., & Thelwell, R. (2013). The value of social validation in single-case methods in sport and exercise psychology. Journal of Applied Sport Psychology,25, 61–71. https://doi.org/10.1080/10413200.2012.663859.

  38. Peterson, C. A., Luze, G. J., Eshbaugh, E. M., Jeon, H., & Kantz, K. R. (2007). Enhancing parent–child interactions through home visiting: Promising practice of unfulfilled promise? Journal of Early Intervention,2, 119–140. https://doi.org/10.1177/105381510702900205.

  39. Reichow, B., Volkmar, F. R., & Cicchetti, D. V. (2008). Development of the evaluative method for evaluating and determining evidence-based practices in autism. Journal of Autism and Developmental Disorders,38, 1311–1319. https://doi.org/10.1007/s/10803-007-0517-7.

  40. Reimers, T. M., Wacker, D. P., Cooper, L. J., & de Radd, A. O. (1992). Acceptability of behavioral interventions for children: Analog and naturalistic evaluations by parents. School Psychology Review,21, 628–643.

  41. Rivard, M., Morin, M., Mercier, C., Terroux, A., Mello, C., & Lépine, A. (2017). Social validity of a training and coaching program for parents of children with autism spectrum disorder on a waiting list for early behavioral intervention. Journal of Child and Family Studies,26, 877–887. https://doi.org/10.1007/s10826-016-0604-5.

  42. Schlosser, R. (1999). Social validation of interventions in augmentative and alternative communication. Augmentative and Alternative Communication,15, 234–247. https://doi.org/10.1080/07434619912331278775.

  43. Schwartz, I. S., & Baer, D. M. (1991). Social validity assessments: Is current practice state of the art? Journal of Applied Behavior Analysis,24(2), 189–204. https://doi.org/10.1901/jaba.1991.24-189.

  44. Snodgrass, M. R., Chung, M. Y., Biller, M. F., Appel, K. E., Meadan, H., & Halle, J. W. (2017). Telepractice in speech–language therapy: The use of online technologies for parent training and coaching. Communication Disorders Quarterly,38(4), 242–254. https://doi.org/10.1177/1525740116680424.

  45. Snodgrass, M. R., Chung, M. Y., Meadan-Kaplansky, H., & Halle, J. W. (2018). Social validity in single-case research: A systematic literature review of prevalence and application. Research in Developmental Disabilities,74, 160–173. https://doi.org/10.1016/j.ridd.2018.01.007.

  46. Spear, C. F., Strickland-Cohen, K., Romer, N., & Albin, R. W. (2013). An examination of social validity within single-case research with students with emotional and behavioral disorders. Remedial and Special Education,34, 357–370. https://doi.org/10.1177/0741932513490809.

  47. Squires, J., Bricker, D., Twombly, E., Yockelson, S., Davis, M. S., & Younghee, K. (2002). Ages and stages questionnaire: Social emotional (ASQ:SE). Baltimore, MD: Brookes.

  48. Staerkel, F. J., & Spieker, S. (2006). Unstable housing—A significant challenge for home visiting programs: An early head start case example. Journal of Family Social Work,10, 61–76.

  49. Stoner, J. B., Meadan-Kaplansky, H., Angell, M. E., & Daczewitz, M. (2012). Evaluation of the parent-implemented communication strategies (PiCS) project using the multiattribute utility (MAU) approach. Educational Assessment, Evaluation and Accountability,24, 57–73. https://doi.org/10.1007/s11092-011-9136-0.

  50. Strain, P. S., Barton, E. E., & Dunlap, G. (2012). Lessons learned about the utility of social validity. Education and Treatment of Children,35, 183–200. https://doi.org/10.1353/etc.2012.0007.

  51. Strauss, A., & Corbin, J. (1998). Basics of qualitative research: Techniques and procedures for developing grounded theory. Thousand Oaks, CA: Sage.

  52. Suess, A. N., Romani, P. W., Wacker, D. P., Dyson, S. M., Kuhle, J. L., Lee, J. F., et al. (2014). Evaluating the treatment fidelity of parents who conduct in-home functional communication training with coaching via telehealth. Journal of Behavioral Education,23, 34–59. https://doi.org/10.1007/s10864-013-9183-3.

  53. Toth, K., Munson, J., Meltzoff, A. N., & Dawson, G. (2006). Early predictors of communication development in young children with autism spectrum disorder: Joint attention, imitation, and toy play. Journal of Autism and Developmental Disorders,36, 993–1005. https://doi.org/10.1007/s10803-006-0137-7.

  54. U.S. Department of Commerce. (2019). American broadband initiative: Milestones report. Retrieved from https://broadbandusa.ntia.doc.gov/sites/default/files/resource-files/american_broadband_initiative_milestones_report_feb_2019_0.pdf.

  55. Vismara, L. A., McCormick, C., Young, G. S., Nadhan, A., & Monlux, K. (2013). Preliminary findings of a telehealth approach to parent training in autism. Journal of Autism and Developmental Disorders,43, 2953–2969. https://doi.org/10.1007/s10803-013-1841-8.

  56. Von Brock, M. B., & Elliott, S. (1987). Influence of treatment effectiveness information on the acceptability of classroom interventions. Journal of School Psychology,25, 131–144. https://doi.org/10.1016/0022-4405(87)90022-7.

  57. Wolf, M. M. (1978). Social validity: The case for subjective measurement or how applied behavior analysis is finding its heart. Journal of Applied Behavior Analysis,11, 203–214. https://doi.org/10.1901/aba.1978.11-203.

  58. Wong, C., Odom, S. L., Hume, K., Cox, A. W., Fettig, A., Kucharczyk, S., et al. (2013). Evidence-based practices for children, youth, and young adults with Autism Spectrum Disorder. Chapel Hill, NC: The University of North Carolina, Frank Porter Graham Child Development Institute, Autism Evidence-Based Practice Review Group.

Download references

Author information

Correspondence to Moon Y. Chung.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Chung, M.Y., Meadan, H., Snodgrass, M.R. et al. Assessing the Social Validity of a Telepractice Training and Coaching Intervention. J Behav Educ (2020). https://doi.org/10.1007/s10864-020-09372-8

Download citation

Keywords

  • Social validity
  • Parent-implemented intervention
  • Early intervention
  • Telepractice