Skip to main content

Advertisement

Log in

Tailoring Acceptance and Commitment Therapy Skill Coaching in the Moment Through Smartphones: Results from a Randomized Controlled Trial

  • ORIGINAL PAPER
  • Published:
Mindfulness Aims and scope Submit manuscript

Abstract

There is growing evidence for the efficacy of acceptance and commitment therapy (ACT) interventions delivered through smartphones, but research has not yet focused on how to optimize such interventions. One benefit of mobile interventions is the ability to adapt content based on in-the-moment variables. The current randomized controlled trial evaluated whether an ACT app that tailored skill coaching based on in-the-moment ecological momentary assessments (EMAs) would be more efficacious than the same app where skill coaching was random or an EMA-only condition. A sample of 69 adults interested in using a self-help app were randomized to one of three app conditions and used the app for the following 4 weeks. Results indicated equivalently high user satisfaction with the tailored versus random apps. Participants used the EMA-only app the most and the tailored app the least, but overall adherence was adequate. Participants in the tailored app improved significantly more on psychological distress and positive mental health relative to the random app and EMA-only conditions. However, no differences were found between the random app and EMA-only conditions on outcomes. Between-group differences over time were also found on psychological inflexibility, but this appeared to be primarily due to a lower rate of improvement in the random app condition relative to both tailored and EMA-only. Overall, these results suggest that tailoring ACT skill coaching based on in-the-moment variables leads to greater efficacy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Andersson, G. (2016). Internet-delivered psychological treatments. Annual Review of Clinical Psychology, 12, 157–179.

    Article  PubMed  Google Scholar 

  • Bangor, A., Kortum, P. T., & Miller, J. T. (2008). An empirical evaluation of the System Usability Scale. International Journal of Human Computer Interaction, 24, 574–594.

    Article  Google Scholar 

  • Bond, F. W., Hayes, S. C., Baer, R. A., Carpenter, K., Orcutt, H. K., Waltz, T., & Zettle, R. D. (2011). Preliminary psychometric properties of the Acceptance and Action Questionnaire-II: a revised measure of psychological flexibility and acceptance. Behavior Therapy, 42, 676–688.

    Article  Google Scholar 

  • Bond, D. S., Thomas, J. G., Raynor, H. A., Moon, J., Sieling, J., Trautvetter, J., et al. (2014). B-MOBILE—a smartphone-based intervention to reduce sedentary time in overweight/obese individuals: a within-subjects experimental trial. PLoS One, 9, e100821.

    Article  PubMed  PubMed Central  Google Scholar 

  • Brooke, J. (1996). SUS: a “quick and dirty” usability scale. In P. W. Jordan, B. Thomas, B. A. Weerdmeester, & I. L. McClelland (Eds.), Usability evaluation in industry (pp. 189–194). London: Taylor and Francis.

    Google Scholar 

  • Francis, A. W., Dawson, D. L., & Golijani-Moghaddam, N. (2016). The development and validation of the Comprehensive Assessment of Acceptance and Commitment Therapy Processes (CompACT). Journal of Contextual Behavioral Science, 5, 134–145.

    Article  Google Scholar 

  • Hahn, E. A., DeVellis, R. F., Bode, R. K., Garcia, S. F., Castel, L. D., Eisen, S. V., … PROMIS Cooperative Group. (2010). Measuring social health in the patient-reported outcomes measurement information system (PROMIS): item bank development and testing. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 19(7), 1035–1044.

  • Hahn, E. A., Beaumont, J. L., Pilkonis, P. A., Garcia, S. F., Magasi, S., DeWalt, D. A., & Cella, D. (2016). The PROMIS satisfaction with social participation measures demonstrate responsiveness in diverse clinical populations. Journal of Clinical Epidemiology, 73, 135–141.

    Article  PubMed  PubMed Central  Google Scholar 

  • Hayes, S. C., Strosahl, K. D., & Wilson, K. G. (2011). Acceptance and commitment therapy: the process and practice of mindful change. New York: The Guilford Press.

    Google Scholar 

  • Hayes, S. C., Pistorello, J., & Levin, M. E. (2012). Acceptance and commitment therapy as a unified model of behavior change. The Counseling Psychologist, 40, 976–1002.

    Article  Google Scholar 

  • Henry, J. D., & Crawford, J. R. (2005). The short-form version of the Depression Anxiety Stress Scales (DASS-21): construct validity and normative data in a large non-clinical sample. British Journal of Clinical Psychology, 44, 227–239.

    Article  Google Scholar 

  • Heron, K. E., & Smyth, J. M. (2010). Ecological momentary interventions: incorporating mobile technology into psychosocial and health behavior treatments. British Journal of Health Psychology, 15, 1–39.

    Article  PubMed  Google Scholar 

  • Keyes, C. L. M. (2005). Mental illness and/or mental health? Investigating axioms of the complete state model of health. Journal of Consulting and Clinical Psychology, 73, 539–548.

    Article  PubMed  Google Scholar 

  • Levin, M. E., Hildebrandt, M. J., Lillis, J., & Hayes, S. C. (2012). The impact of treatment components suggested by the psychological flexibility model: a meta-analysis of laboratory-based component studies. Behavior Therapy, 43, 741–756.

    Article  PubMed  Google Scholar 

  • Levin, M. E., Herbert, J. D., & Forman, E. M. (2017). Acceptance and commitment therapy: a critical review to guide clinical decision making. In D. McKay, J. Abramowitz, & E. Storch (Eds.), Treatments for psychological problems and syndromes (pp. 413–432). Wiley-Blackwell.

  • Levin, M. E., Haeger, J., Pierce, B., & Cruz, R. (2017a). Evaluating an adjunctive mobile app to enhance psychological flexibility in acceptance and commitment therapy. Behavior Modification, 41, 846–867.

    Article  PubMed  Google Scholar 

  • Levin, M. E., Haeger, J., Pierce, B., & Twohig, M. P. (2017b). Web-based acceptance and commitment therapy for mental health problems in college students: a randomized controlled trial. Behavior Modification, 41, 141–162.

    Article  PubMed  Google Scholar 

  • Lovibond, S. H., & Lovibond, P. F. (1995). Manual for the Depression Anxiety Stress Scales (2nd ed.). Sydney: Psychology Foundation of Australia.

    Google Scholar 

  • Lustria, M. L. A., Noar, S. M., Cortese, J., Van Stee, S. K., Glueckauf, R. L., & Lee, J. (2013). A meta-analysis of web-delivered tailored health behavior change interventions. Journal of Health Communication, 18, 1039–1069.

    Article  PubMed  Google Scholar 

  • Mattila, E., Lappalainen, R., Välkkynen, P., Sairanen, E., Lappalainen, P., Karhunen, L., et al. (2016). Usage and dose response of a mobile acceptance and commitment therapy app: secondary analysis of the intervention arm of a randomized controlled trial. Journal of Medical Internet Research mHealth and uHealth, 4, e90.

    Article  Google Scholar 

  • Nahum-Shani, I., Smith, S. N., Spring, B. J., Collins, L. M., Witkiewitz, K., Tewari, A., & Murphy, S. A. (2018). Just-in-time adaptive interventions (JITAIs) in mobile health: key components and design principles for ongoing health support. Annals of Behavioral Medicine, 52, 446–462.

    Article  PubMed  PubMed Central  Google Scholar 

  • Pew Research Center. (2017). Mobile fact sheet. Retrieved June 26, 2017, from http://www.pewinternet.org/fact-sheet/mobile/.

  • Smyth, J. M. & Heron, K.E. (2016). Is providing mobile interventions “just-in-time” helpful? An experimental proof of concept study of just-in-time intervention for stress management. Proceedings of the IEEE Wireless Health Conference, 89–95.

  • Strecher, V. J., McClure, J. B., Alexander, G. L., Chakraborty, B., Nair, V. N., Konkel, J. M., et al. (2008). Web-based smoking-cessation programs: results of a randomized trial. American Journal of Preventive Medicine, 34, 373–381.

    Article  PubMed  PubMed Central  Google Scholar 

  • Torous, J. B., Levin, M. E., Ahern, D., & Oser, M. (2017). Cognitive behavioral mobile applications: research literature, marketplace data, and evaluation guidelines. Cognitive and Behavioral Practice, 24, 215–225.

    Article  Google Scholar 

  • Verbeke, G., & Molenberghs, G. (2000). Linear mixed models for longitudinal data. New York: Springer-Verlag.

    Google Scholar 

  • Wackerly, D. D., Mendenhall, W., & Scheaffer, R. L. (2008). Mathematical statistics with applications. Belmont: Thomson Brooks/Cole.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Contributions

MEL was the principal investigator including designing and overseeing the conduct of the study, conducting data analyses, and writing the manuscript. JH assisted with the design of the study, was the primary research coordinator for day-to-day operation of the study, and assisted in preparing the manuscript. RAC was a co-investigator who assisted in designing the study, conducting data analyses, and preparing the manuscript.

Corresponding author

Correspondence to Michael E. Levin.

Ethics declarations

Conflict of Interest

Dr. Levin is a research associate with Contextual Change LLC, a company that focuses on developing commercial online programs to address college student mental health. Mr. Jack Haeger and Dr. Rick Cruz declare that they have no conflicts of interest.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. The study was approved by the Utah State University Institutional Review Board.

Informed Consent

Informed consent was obtained from all individual participants included in the study.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Levin, M.E., Haeger, J. & Cruz, R.A. Tailoring Acceptance and Commitment Therapy Skill Coaching in the Moment Through Smartphones: Results from a Randomized Controlled Trial. Mindfulness 10, 689–699 (2019). https://doi.org/10.1007/s12671-018-1004-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12671-018-1004-2

Keywords

Navigation