Abstract
This chapter presents an overview of psychotherapy research. It starts by setting out a set of principles supported by scientific evidence and clinical experience. These principles work as synthesis of the main aspects the chapter aims to highlight about psychotherapy research. The differences between the medical and the contextual model are then presented. The chapter falls into three main parts: (a) summary of different aspects emphasized by research, such as the general efficacy of different therapeutic models ; the therapeutic alliance and the repair of therapeutic ruptures ; the common factors and the specific techniques ; expectations , goals and level of collaboration between the client and the therapist ; (b) feedback systems in psychotherapy; and (c) therapist factors .
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ackerman, S. J., & Hilsenroth, M. J. (2001). A review of therapist characteristics and techniques negatively impacting the therapeutic alliance. Psychotherapy, 38, 2.
Ackerman, S. J., & Hilsenroth, M. J. (2003). A review of therapist characteristics and techniques positively impacting the therapeutic alliance. Clinical Psychology Review, 23, 1–33.
Ahmed, M., & Westra, H. A. (2009). Impact of a treatment rationale on expectancy and engagement in cognitive behavioral therapy for social anxiety. Cognitive Therapy and Research, 33, 314–322.
Ahn, H., & Wampold, B. E. (2001). Where oh where are the specific ingredients? A meta-analysis of component studies in counseling and psychotherapy. Journal of Counseling Psychology, 48(3), 251–257.
Amble, I., Gude, T., Stubdal, S., Andersen, B. J., & Wampold, B. E. (2015). The effect of implementing the Outcome Questionnaire-45.2 feedback system in Norway: A multisite randomized clinical trial in a naturalistic setting. Psychotherapy Research, 25(6), 669–677.
Anderson, T., Olges, B. M., Patterson, C. L., Lambert, M. J., & Vermeersch, D. A. (2009). Therapist effects: Facilitative interpersonal skills as a predictor of therapist success. Journal of Clinical Psychology, 65(7), 755–768.
Anderson, T., Lunnen, K. M., & Ogles, B. M. (2010). Putting models and techniques in context. In S. D. Miller, B. L. Duncan, M. A. Hubble, & B. E. Wampold (Eds.), The heart and soul of change (2nd ed., pp. 143–166). Washington, DC: American Psychological Association.
Anderson, T., Crowley, M. E. J., Himawan, L., Holmberg, J. K., & Uhlin, B. D. (2016). Therapist facilitative interpersonal skills and training status: A randomized clinical trial on alliance and outcome. Psychotherapy Research, 26(5), 511–529.
APA Presidential Task Force on Evidence-Based Practice. (2006). Evidence-based practice in psychology. American Psychologist, 61, 271–285.
Asay, T. P., & Lambert, M. J. (1999). The empirical case for the common factors in therapy: Quantitative findings. In M. A. Hubble, B. L. Duncan, & S. D. Miller (Eds.), The heart and soul of change—what works in therapy (pp. 33–55). Washington, DC: American Psychological Association.
Asnaani, A., & Foa, E. B. (2014). Expanding the lens of evidence-based practice in psychotherapy to include a common factors perspective: Comment on Laska, Gurman, and Wampold. Psychotherapy, 51(4), 487–490.
Baardseth, T. P., Goldberg, S. B., Pace, B. T. Wislocki, A. P., Frost, N.D., Siddiqui, J.R., … Wampold, B. E. (2013). Cognitive-behavioral therapy versus other therapies: Redux. Clinical Psychology Review, 33, 395–405.
Baker, T. B., & McFall, R. (2014). The promise of science-based training and application in psychological clinical science. Psychotherapy, 51(4), 482–486.
Baldwin, S. A., & Imel, Z. E. (2013). Therapists effects. Findings and methods. In M. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and behavior change (pp. 258–297). New Jersey: Wiley.
Baldwin, S. A., Wampold, B. E., & Imel, Z. E. (2007). Untangling the alliance–outcome correlation: Exploring the relative importance of therapist and patient variability in the alliance. Journal of Consulting and Clinical Psychology, 75(6), 842–852.
Barlow, D. H. (2004). Psychological treatments. American Psychologist, 59(9), 869–878.
Barlow, D. H. (2010). The Dodo Bird-again-and again. The Behavior Therapist, 33(1), 15–16.
Bell, E. C., Marcus, D. K., & Godlad, J. K. (2013). Are the parts as good as the whole? A meta-analysis of component treatment studies. Journal of Consulting and Clinical Psychology, 81(4), 722–736.
Benish, S. G., Imel, Z. E., & Wampold, B. E. (2008). The relative efficacy of bona fide psychotherapies for treating post-traumatic stress disorder: A meta-analysis of direct comparisons. Clinical Psychology Review, 28, 746–758.
Bergin, A. E. (1963). The effects of psychotherapy: Negative results revisited. Journal of Counseling Psychology, 10, 244–250.
Beutler, L. E. (2014). Welcome to the party but…. Psychotherapy, 51(4), 496–499.
Beutler, L. E., Someah, K., Kimpara, S., & Miller, K. (2016). Selecting the most appropriate treatment for each patient. International Journal of Clinical and Health Psychology, 16, 99–108.
Bickman, L., Kelley, S. D., Breda, C., Andrade, A. R., & Riemer, M. (2011). Effects of routine feedback to clinicians on mental health outcomes of youths: Results of a randomized trial. Psychiatric Services, 62(12), 1423–1429.
Bohart, A. C., & Tallman, K. (2010). Clients: The neglected common factor in psychotherapy. In B. L. Duncan, S. D. Miller, B. E. Wampold, & M. A. Hubble (Eds.), The heart and soul of change: Delivering what works in therapy (2nd ed., pp. 83–111). Washington, DC: American Psychological Association.
Bohart, A. C., & Wade, A. G. (2013). The client in psychotherapy. In M. J. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and behavior change (6th ed., pp. 219–257). Hoboken, NJ: Wiley.
Bordin, E. S. (1979). The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy: Theory, Research & Practice, 16(3), 252–260.
Boswell, J. F., Kraus, D. R., Castonguay, L. G., & Youn, S. J. (2015). Treatment outcome package: Measuring and facilitating multidimensional change. Psychotherapy, 52(4), 422–431.
Brosan, L., Reynolds, S., & Moore, R. G. (2008). Self-evaluation of cognitive therapy performance: Do therapists know how competent they are? Behavioural and Cognitive Psychotherapy, 36(5), 581–587.
Brown, G. S., Lambert, M., Jones, E. R., & Minami, T. (2005). Identifying highly effective psychotherapists in a managed care environment. The American Journal of Managed Care, 11(8), 513–520.
Budge, S. L., Owen, J. J., Kopta, S. M., Minami, T., Hanson, M. R., & Hirsch, G. (2013). Differences among trainees in client outcomes associated with the phase model of change. Psychotherapy, 50(2), 150–157.
Castonguay, L. G. (2013). Psychotherapy outcome: A problem worth re-revisiting 50 years later. Psychotherapy, 50, 52–67.
Castonguay, L. G., & Beutler, L. E. (2006). Principles of therapeutic change that work. New York: Oxford University Press.
Castonguay, L. G., Boswell, J. F., Zack, S. E., Baker, A., Boutselis, M. A., Chiswick, N. R., … Holtforth, M.G. (2010). Helpful and hindering events in psychotherapy: A practice research network study. Psychotherapy Theory, Research, Practice, 47(3), 327–344.
Castonguay, L. G., Barkham, M., Lutz, W., & McAleavey, A. (2013). Practice-oriented research. Approaches and applications. In M. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and Behavior Change, 85–133. New Jersey: Wiley.
Chambless, D. L., & Hollon, S. D. (1998). Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66, 7–18.
Chambless, D. L., Baker, M. J. Baucom, D. H., Beutler, L. E., Calhoun, K. S., Crits-Christoph, P., … Woody, S. R. (1998). Update on empirically validated therapies, II. The Clinical Psychologist, 51(1), 3–16.
Chapman, C., Burlingame, G. M., Gleave, R., Rees, F., Beecher, M., & Porter, G. S. (2012). Clinical prediction in group psychotherapy. Psychotherapy Research, 22(6), 673–681.
Chow, D., Miller, S. D., Seidel, J. A., Kane, R. T., Thornton, J. A., & Andrews, W. (2015). The role of deliberate practice in the development of highly effective psychotherapists. Psychotherapy, 52(3), 337–345.
Constantino, M. J., Arnkoff, D. B., Glass, C. R., Ametrano, R. M., & Smith, J. Z. (2011). Expectations. Journal of Clinical Psychology: In session, 67(2), 184–192.
Constantino, M. J., Ametrano, R. M., & Greenberg, R. P. (2012). Clinician interventions and participant characteristics that foster adaptive patient expectations for psychotherapy and psychotherapeutic Change. Psychotherapy, 49(4), 557–569.
Cook, J. M., Elhai, J., Biyanova, T., & Schnurr, P. (2010). What do psychotherapists really do in practice? An internet study of over 2,000 practitioners. Psychotherapy Theory, Research, Practice, Training, 47(2), 260–267.
Cooper, M. (2008). Essential research findings in counselling and psychotherapy. The facts are friendly. London: Sage.
Coughlan, E. K., Williams, A. M., McRobert, A. P., & Ford, P. R. (2014). How experts practice: A novel test of deliberate practice theory. Journal of Experimental Psychology. Learning, Memory, and Cognition, 40(2), 449–458.
Crits-Christoph, P. (1997). Limitations of the Dodo Bird verdict and the role of clinical trials in psychotherapy research: Comment on Wampold et al. Psychological Bulletin, 122(3), 216–220.
Crits-Christoph, P., Baranackie, K., Kurcias, J. S., Beck, A. T., Carrol, K., Perry, K., … Zitrin, C. (1991). Meta-analysis of therapist effects in psychotherapy outcome studies. Psychotherapy Research, 1(2), 81–91.
Crits-Christoph, P., Connolly Gibbons, M. B., Crits-Christoph, K., Narducci, J., Schamberger, M., & Gallop, R. (2006). Can therapists be trained to improve their alliances? A preliminary study of alliance-fostering psychotherapy. Psychotherapy Research, 16(3), 268–281.
Crits-Christoph, P., Connolly Gibbons, M. B., Hamilton, J., Ring-Kurtz, S., & Gallop, R. (2011). The dependability of alliance assessments: The alliance–outcome correlation is larger than you might think. Journal of Consulting and Clinical Psychology, 79, 267–278.
Crits-Christoph, P., Chambless, D. L., & Markell, H. M. (2014). Moving evidence-based practice forward successfully: Commentary on Laska, Gurman, and Wampold. Psychotherapy, 51(4), 491–495.
Cuijeprs, P., Driessen, E., Hollon, S. D., Van Oppen, P., Barth, J., & Andresson, G. (2012). The efficacy of non-directive supportive therapy for adult depression: A meta-analysis. Clinical Psychology Review, 32, 280–291.
De Jong, K., & De Goede, M. (2015). Why do some therapists not deal with outcome monitoring feedback? A feasibility study on the effect of regulatory focus and person—organization fit on attitude and outcome. Psychotherapy Research, 25(6), 661–668.
De Jong, K., Van Sluis, P., Nugter, M. A., Heiseder, W. J., & Spinhoven, P. (2012). Understanding the differential impact of outcome monitoring: Therapist variables that moderate feedback effects in a randomized clinical trial. Psychotherapy Research, 22(4), 464–474.
De Jong, K., Timman, R., Hakkaart-Van Roijen, L., Vermeulen, P., Kooiman, K., Passchier, J., et al. (2014). The effect of outcome monitoring feedback to clinicians and patients in short and long-term psychotherapy: A randomized controlled trial. Psychotherapy Research, 24(6), 629–639.
Del Re, A. C., Flückiger, C., Horvath, A. O., Symonds, D., & Wampold, B. E. (2012). Therapist effects in the therapeutic alliance–outcome relationship: A restricted-maximum likelihood meta-analysis. Clinical Psychology Review, 32(7), 642–649.
Delsignore, A., & Schnyder, U. (2007). Control expectancies as predictors of psychotherapy outcome: A systematic review. British Journal of Clinical Psychology, 46, 467–483.
Dinger, U., Strack, M., Leichsenring, F., Wilmers, F., & Schauenburg, H. (2008). Therapist effects on outcome and alliance in inpatient psychotherapy. Journal of Clinical Psychology, 64, 344–354.
Douglas, S. R., Jonghyuk, B., Andrade, A. R. V., Tomlinson, M. M., Hargraves, R. P., & Bickman, L. (2015). Feedback mechanisms of change: How problem alerts reported by youth clients and their caregivers impact clinician-reported session content. Psychotherapy Research, 25(6), 678–693.
Duncan, B. L., & Reese, R. J. (2015). The Partners for Change Outcome Management System (PCOMS). Revisiting the client’s frame of reference. Psychotherapy, 52(4), 391–401.
Duncan, B. L., Miller, S. D., Wampold, B. E., & Hubble, M. A. (2010). The heart and soul of change: Delivering what works in therapy (2nd ed.). Washington, DC: American Psychological Association.
Ekroll, V. B. S., & Rønnestad, M. H. (2016). Processes and changes experienced by clients during and after naturalistic good-outcome therapies conducted by experienced psychotherapists. Psychotherapy Research, 1–19.
Elliott, R., Bohart, A. C., Watson, J. C., & Greenberg, L. S. (2011). Empathy. Psychotherapy, 48, 43–49.
Ellsworth, J. R., Lambert, M. J., & Johnson, J. (2006). A comparison of the Outcome Questionnaire-45 and Outcome Questionnaire-30 in classification and prediction of treatment outcome. Clinical Psychology and Psychotherapy, 13, 380–391.
Emmelkamp, P. M. G., David, D., Beckers, T., Muris, P., Cuijpers, P., Lutz, W., … Vervliet, B. (2014). Advancing psychotherapy and evidence-based psychological interventions. International Journal of Methods in Psychiatric Research, 23(S1), 58–91.
Ericsson, K. A. (Ed.). (2009). Development of professional expertise: Toward measurement of expert performance and design of optimal learning environments. New York: Cambridge University Press.
Ericsson, K. A., Krampe, R. T., & Tesch-Romer, C. (1993). The role of deliberate practice in the acquisition of expert performance. Psychological Review, 100(3), 363–406.
Eysenck, H. J. (1952). The effects of psychotherapy: An evaluation. Journal of Consulting Psychology, 16, 319–324.
Falkenström, F., Granström, F., & Holmqvist, R. (2013). Therapeutic alliance predicts symptomatic improvement session by session. Journal of Counseling Psychology, 60(3), 317–328.
Flückiger, C., Del Re, A. C., Wampold, B. E., Symonds, D., & Horvath, A. O. (2012). How central is the alliance in psychotherapy? A multilevel longitudinal meta-analysis. Journal of Counseling Psychology, 59(1), 10–17.
Frank, J. D., & Frank, J. B. (1991). Persuasion and healing. A comparative study of psychotherapy (3rd ed.). Baltimore: John Hopkins University Press.
Garfield, S. (1997). The therapist as a neglected variable in psychotherapy research. Clinical Psychology: Science and Practice, 4(1), 40–43.
Geller, J. D. (2005). Style and its contribution to a patient-specific model of therapeutic technique. Psychotherapy: Theory, Research, Practice. Training, 42, 469–482.
Gelso, C. J. (2009). The real relationship in a postmodern world: Theoretical and empirical explorations. Psychotherapy Research, 19(3), 253–264.
Gelso, C. J. (2014). A tripartite model of the therapeutic relationship: Theory, research, and practice. Psychotherapy Research, 24(2), 117–131.
Gelso, C. J., Kivlighan, D. M., Busa-Knepp, J., Spiegel, E. B., Ain, S., Hummel, A. M., … Markin, R. D. (2012). The unfolding of the real relationship and the outcome of brief psychotherapy. Journal of Counseling Psychology, 59(4), 495–506.
Gibbons, M. B. C., Thompson, D. L., Eisen, S. V., Kurtz, J. E., Mack, R. A., Lee, J. K., … Crits-Christoph, P. (2015). The effectiveness of clinician feedback in the treatment of depression in the community mental health system. Journal of Consulting and Clinical Psychology, 83(4), 748–759.
Goldberg, S. B., Hoyt, W. T., Nissen-lie, H. A., Nielsen, S. L., & Wampold, B. E. (2016a). Unpacking the therapist effect: Impact of treatment length differs for high- and low-performing therapists. Psychotherapy Research.
Goldberg, S. B., Miller, S. D., Nielsen, S. L., Rousmaniere, T., Whipple, J., Hoyt, W. T., & Wampold, B. E. (2016b). Do psychotherapists improve with time and experience? A longitudinal analysis of outcomes in a clinical setting. Journal of Counseling Psychology, 63(1), 1–11.
Goldberg, S. B., Babins-Wagner, R., Rousmaniere, T., Berzins, S., Hoyt, W. T., Whipple, J., … Wampold, B. E. (2016c). Creating a climate for therapist improvement: A case study of an agency focused on outcome and deliberate practice. Psychotherapy, 53(3), 367–375.
Goldfried, M. (1980). Toward the delineation of therapeutic change principles. American Psychologist, 35(11), 991–999.
Goldfried, M. R., & Davila, J. (2005). The role of the relationship and technique in therapeutic change. Psychotherapy: Theory, Research, Practice, Training, 42, 421–430.
Goldfried, M. R., Patrick, J., Raue, P. J., & Castonguay, L. G. (1998). The therapeutic focus in significant sessions of master therapists: A comparison of cognitive-behavioral and psychodynamic-interpersonal interventions. Journal of Consulting and Clinical Psychology, 66(5), 803–810.
Goodman, J. D., McKay, J. R., & DePhilippis, D. (2013). Progress monitoring in mental health and addiction treatment: A means of improving care. Professional Psychology: Research and Practice, 44(4), 231–246.
Hannan, C., Lambert, M. J., Harmon, C., Nielsen, S. L., Smart, D. W., Shimokawa, K., & Sutton, S. W. (2005). A lab test and algorithms for identifying clients at risk for treatment failure. Journal of Clinical Psychology, 61, 155–163.
Hansen, B. P., Lambert, M. J., & Vlass, E. N. (2015). Sudden gains and sudden losses in the clients of a “Supershrink”: 10 case studies. Pragmatic Case Studies in Psychotherapy, 11(3), 154–201.
Hatfield, D., McCullough, L., Frantz, S. H. B., & Krieger, K. (2010). Do we know when our clients get worse? An investigation of therapists’ ability to detect negative client change. Clinical Psychology and Psychotherapy, 17, 25–32.
Heinonen, E., Lindfors, O., Laaksonen, M. A., & Knekt, P. (2012). Therapists’ professional and personal characteristics as predictors of outcome in short- and long-term psychotherapy. Journal of Affective Disorders, 138, 301–312.
Heinonen, E., Lindfors, O., Härkänen, T., Virtala, E., Jääskeläinen, T., & Knekt, P. (2014). Therapists’ professional and personal characteristics as predictors of working alliance in short-term and long-term psychotherapies. Clinical Psychology and Psychotherapy, 21, 475–494.
Hersoug, A. G., Høglend, P., Havik, O., Lippe, A. V. D., & Monsen, J. (2009). Therapist characteristics influencing the quality of alliance in long-term psychotherapy. Clinical Psychology and Psychotherapy, 16, 100–110.
Hill, C. (1995). Therapist techniques, client involvement, and the therapeutic relationship: Inextricably intertwined in the therapy process. Psychotherapy: Theory, Research, Practice, Training, 42, 431–442.
Hofmann, S. G., & Barlow, D. H. (2014). Evidence-based psychological interventions and the common factors approach: The beginnings of a rapprochement? Psychotherapy, 51(4), 510–513.
Holdsworth, E., Bowen, E., Brown, S., & Howat, D. (2014). Client engagement in psychotherapeutic treatment and associations with client characteristics, and treatment factors. Clinical Psychology Review, 34, 428–450.
Holt, H., Beutler, L. E., Kimpara, S., Macias, S., Haug, N. A., Shiloff, N., … Stein, M. (2015). Evidence-based supervision: Tracking outcome and teaching principles of change in clinical supervision to bring science to integrative practice. Psychotherapy, 52(2), 185–189.
Hook, J. N., Davis, D. E., Owen, J., Worthington, E. J., & Utsey, S. O. (2013). Cultural humility: Measuring openness to culturally diverse clients. Journal of Counseling Psychology, 60(3), 353–366.
Horvath, A. O., & Bedi, R. P. (2002). The alliance. In J. C. Norcross (Ed.), Psychotherapy relationships that work (pp.37–69). New York: Oxford University Press.
Horvath, A. O., & Luborsky, L. (1993). The role of the therapeutic alliance in psychotherapy. Journal of Consulting and Clinical Psychology, 61(4), 561–573.
Horvath, A. O., Del Re, A. C., Fluckiger, C., & Symonds, D. (2011). Alliance in individual psychotherapy. In Norcross, J. (Ed.), Psychotherapy relationships that work (2nd ed., pp. 76–89). New York: Oxford University Press.
Hubble, M. A., Duncan, B. L., Miller, S. C., & Wampold, B. E. (2010). Introduction. In B. L. Duncan, S. C. Miller, B. E. Wampold, & M. A. Hubble (Eds.), The heart and soul of change: Delivering what works in therapy (pp. 23–46). Washington, DC: American Psychological Association.
Imel, Z. A., Sheng, E., Baldwin, S. A., & Atkins, D. C. (2015). Removing very low-performing therapists: A simulation of performance-based retention in psychotherapy. Psychotherapy, 52(3), 329–336.
Jacobson, N. S., Dobson, K. S., Truax, P., Addis, M. E., Koerner, K., Gollan, J. K., … Prince, S. E. (1996). Component analysis of cognitive-behavioral treatment for depression. Journal of Consulting and Clinical Psychology, 64(2), 295–304.
Jennings, L., & Skovholt, T. M. (1999). The cognitive, emotional, and relational characteristics of master therapists. Journal of Counseling Psychology, 46(1), 3–11.
Jennings, L., Sovereign, A., Bottorff, N., Mussell, M. P., & Vye, C. (2005). Nine ethical values of master therapists. Journal of Mental Health Counseling, 27(1), 32–47.
Jennings, L., D’Rozario, V., Goh, M., Sovereign, A., Brogger, M., & Skovholt, T. (2008). Psychotherapy expertise in Singapore: A qualitative investigation. Psychotherapy Research, 18(5), 508–522.
Keenan, K., & Shawn, R. (2016). The good therapist: Evidence regarding the therapist’s contribution to psychotherapy. In Cain, D. J., Keenan, K., & Shawn, R. (Eds.), Humanistic psychotherapies: Handbook of research and practice (2nd ed., pp. 421–454). Washington, DC: American Psychological Association.
Kim, D., Wampold, B. E., & Bolt, D. M. (2006). Therapist effects in psychotherapy: A random-effects modeling of the National Institute of Mental Health Treatment of Depression Collaborative Research Program data. Psychotherapy Research, 16(2), 161–172.
Kivlighan, D. M., Jr., Gelso, C. J., Hummel, A. M., Ain, S., & Markin, R. D. (2015). The therapist, the client, and the real relationship: An actor–partner interdependence analysis of treatment outcome. Journal of Counseling Psychology, 62(2), 314–320.
Kraus, D. R., Castonguay, L., Boswell, J. F., Nordberg, S. S., & Hayes, J. A. (2011). Therapists effectiveness: Implications for accountability and patient care. Psychotherapy Research, 21(3), 267–276.
Kraus, D. R., Baxter, E. E., Alexander, P. C., & Bentley, J. H. (2015). The Treatment Outcome Package (TOP): A multi-dimensional level of care matrix for child welfare. Children and Youth Services Review, 57, 171–178.
Kraus, D. R., Bentley, J. H., Alexander, P. C., Boswell, J. F., Constantino, M. J., Baxter, E. E., et al. (2016). Predicting therapist effectiveness from their own practice-based evidence. Journal of Consulting and Clinical Psychology, 84(6), 473–483.
Krause, M. S., & Lutz, W. (2009). Process transforms inputs to determine outcomes: Therapists are responsible for managing process. Clinical Psychology: Science and Practice, 16(1), 73–81.
Kruger, J., & Dunning, D. (1999). Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology, 77(6), 1121–1134.
Lambert, M. J. (2005). Early response in psychotherapy: Further evidence for the importance of common factors rather “placebo effects”. Journal of Clinical Psychology, 61(7), 855–869.
Lambert, M. J. (2013a). Bergin and Garfield’s handbook of psychotherapy and behavior change. Hoboken, NJ: Wiley.
Lambert, M. J. (2013b). Outcome in psychotherapy: The past and important advances. Psychotherapy, 50(1), 42–51.
Lambert, M. J. (2015). Progress feedback and the OQ-System: The past and the future. Psychotherapy, 52(4), 381–390.
Lambert, M. J., & Baldwin, S. A. (2009). Some observations on studying therapists instead of treatment packages. Clinical Psychology Science Practice, 16, 82–85.
Lambert, M. J., & Cattani, K. (2012). Practice-friendly research review: Collaboration in routine care. Journal of Clinical Psychology. In Session, 68(2), 209–220.
Lambert, M. J., & Ogles, B. M. (2014). Common factors: Post hoc explanation or empirically based therapy approach? Psychotherapy, 51(4), 500–504.
Lambert, M. J., & Shimokawa, K. (2011). Collecting client feedback. Psychotherapy, 48(1), 72–79.
Laska, K. M., & Wampold, B. E. (2014). Ten things to remember about common factor theory. Psychotherapy, 51(4), 519–524.
Laska, K. M., Smith, T. L., Wislocki, A. P., Minami, T., & Wampold, B. E. (2013). Uniformity of evidence-based treatments in practice? Therapist effects in the delivery of cognitive processing therapy for PTSD. Journal of Counseling Psychology, 60(1), 31–41.
Laska, K. M., Gurman, A. S., & Wampold, B. E. (2014). Expanding the lens of evidence-based practice in psychotherapy: A common factors perspective. Psychotherapy, 51(4), 467–481.
Lehmann, A. C., & Ericsson, K. A. (1997). Research on expert performance and deliberate practice: Implications for the education of amateur musicians and music students. Psychomusicology, 16, 40–58.
Levitt, H. M. (2015). Qualitative psychotherapy research: The journey so far and future directions. Psychotherapy, 52(1), 31–37.
Levitt, H. M., Pomerville, A., & Surace, F. I. (2016). A qualitative meta-analysis examining clients’ experiences of psychotherapy: A new agenda. Psychological Bulletin, 142(8), 801–830.
Lilienfeld, S. O., Ritschel, L. A., Lynn, S. J., Cautin, R. L., & Latzman, R. D. (2013). Why many clinical psychologists are resistant to evidence-based practice: Root causes and constructive remedies. Clinical Psychology Review, 33, 883–900.
Little, J. H. (2010). In B. L. Duncan, S. D. Miller, B. E. Wampold & Hubble, M. A. (Eds.), The heart and soul of change: Delivering what works in therapy (2nd ed., pp. 167–198). Washington, DC: American Psychological Association.
Lo Coco, G., Gullo, S., Prestano, C., & Gelso, C. J. (2011). Relation of the real relationship and the working alliance to the outcome of brief psychotherapy. Psychotherapy, 48(4), 359–367.
Luborsky, L., Singer, B., & Luborsky, L. (1975). Comparative studies of psychotherapies: Is it true that “everyone has won and all must have prizes”? Archives of General Psychiatry, 32, 995–1008.
Luborsky, L., Crits-Christoph, P., McLellan, A. T., Woody, G. Piper, W., Liberman, B., … Pilkonis, P. (1986). Do therapists vary much in their success? Findings from four outcome studies. American Journal of Orthopsychiatry, 56(4), 501–512.
Lucock, M., Halstead, J., Leach, C., Barkham, M., Tucker, S., Randal, C., … Saxon, D. (2015). A mixed-method investigation of patient monitoring and enhanced feedback in routine practice: Barriers and facilitators. Psychotherapy Research, 25(6), 633–646.
Lutz, W., Lambert, M. J., Harmon, S. C., Tschitsaz, A., Schürch, E., & Stulz, N. (2006). The probability of treatment success, failure and duration— what can be learned from empirical data to support decision making in clinical practice? Clinical Psychology and Psychotherapy, 13, 223–232.
Lutz, W., Leon, S. C., Martinovich, Z., Lyons, J. S., & Stiles, W. B. (2007). Therapist effects in outpatient psychotherapy: A three-level growth curve approach. Journal of Counselling Psychology, 54(1), 32–39.
Lutz, W., Rubel, J., Schiefele, A. K., Zimmemann, D., Bohnke, J. R., & Wittmann, W. W. (2015). Feedback and therapist effects in the context of treatment outcome and treatment length. Psychotherapy Research, 25(6), 647–660.
Mackrill, T. (2011). Differentiating life goals and therapeutic goals: Expanding our understanding of the working alliance. British Journal of Guidance and Counselling, 39(1), 25–39.
Marcus, D. K., O’Connel, D., Norris, A. L., & Sawaqdeh, A. (2014). Is the Dodo bird endangered in the 21st century? A meta-analysis of treatment comparison studies. Clinical Psychology Review, 34, 519–530.
McKay, K. M., Imel, Z. E., & Wampold, B. E. (2006). Psychiatrist effects in the psychopharmacological treatment of depression. Journal of Affective Disorders, 92, 287–290.
Miller, S. D., Duncan, B. L., Sorrell, R., & Brown, G. S. (2005). The partners for change outcome system. Journal of Clinical Psychology. In Session, 61, 199–208.
Miller, S.D., Hubble, M., & Duncan, B. (2008). Supershrinks: What is the secret of their success? Psychotherapy in Australia, 14(4), 14.
Miller, S. D., Hubble, M. A., Chow, D. L., & Seidel, J. A. (2013). The outcome of psychotherapy: Yesterday, today, and tomorrow. Psychotherapy, 50(1), 88–97.
Miller, S. D., Hubble, M. A., Chow, D. L., & Seidel, J. A. (2015). Beyond measures and monitoring: Realizing the potential of feedback-informed treatment. Psychotherapy, 52(4), 449–457.
Minami, T., Brown, G. S., McCulloch, J. M., & Bolstrom, B. J. (2012). Benchmarking therapists: Furthering the benchmarking method in its application to clinical pratice. Quality and Quantity: International Journal of Methodology, 46, 1699–1708.
Nissen-Lie, H. A., Monsen, J. T., Ulleberg, P., & Rønnestad, M. H. (2010). Therapist predictors of early patient-rated working alliance: A multilevel approach. Psychotherapy Research, 20(6), 627–646.
Nissen-Lie, H. A., Havik, O. E., Høglend, P. A., Monsen, J. T., & Rønnestad, M. H. (2013a). The contribution of the quality of therapists’ personal lives to the development of the working alliance. Journal of Counseling Psychology, 60(4), 483–495.
Nissen-Lie, H. A., Monsen, J. T., Ulleberg, P., & Rønnestad, M. H. (2013b). Psychotherapists’ self-reports of their interpersonal functioning and difficulties in practice as predictors of patient outcome. Psychotherapy Research, 23(1), 86–104.
Nissen-Lie, H. A., Havik, O. E., Høglend, P. A., Rønnestad, M. H., & Monsen, J. T. (2015a). Patient and therapist perspectives on alliance development: Therapists’ practice experiences as predictors. Clinical Psychology and Psychotherapy, 22(4), 317–327.
Nissen-Lie, H. A., Rønnestad, M. H., Høglend, P. A., Havik, O. E., Solbakken, O. A., Stiles, T. C., & Monsen, J. T. (2015b). Love yourself as a person, doubt yourself as a therapist? Clinical Psychology & Psychotherapy.
Norcross, J. (2010). The therapeutic relationship. In B. L. Duncan, S. D. Miller, B. E. Wampold, & M. A. Hubble (Eds.), The heart and soul of change: Delivering what works in therapy (2nd ed., pp. 113–141). Washington, DC: American Psychological Association.
Norcross, J. (2011). Psychotherapy relationships that work (2nd ed.). New York: Oxford University Press.
Norcross, J. & Lambert, M. (2011). Psychotherapy relationships that work II. Psyhcotherapy, 48(1), 4–8.
Norcross, J. C., & Wampold, B. E. (2011). What works for whom: Tailoring psychotherapy to the person. Journal of Clinical Psychology. In Session, 67(2), 127–132.
Norcross, J. C., Krebs, P. M., & Prochaska, J. O. (2011). Stages of Change. Journal of Clinical Psychology. In Session, 67(2), 143–154.
Nyman, S. J., Nafziger, M. A., & Smith, T. B. (2010). Client outcomes across counselor training level within a multitiered supervision model. Journal of Counseling & Development, 88, 204–209.
Oddli, H. W., Halvorsen, M. S., & Rønnestad, M. H. (2014a). Expertise demonstrated: What does it mean to be an expert psychotherapist? Retrieved from http://societyforpsychotherapy.org/expertise-demonstrated.
Oddli, H. W., McLeod, J., Reichelt, S., & Rønnestad, M. H. (2014b). Strategies used by experienced therapists to explore client goals in early sessions of psychotherapy. European Journal of Psychotherapy & Counselling, 16(3), 245–266.
Okiishi, J. C., Lambert, M. J., Eggett, D., Nielsen, L., Dayton, D. D., & Vermeersch, D. A. (2006). An analysis of therapist treatment effects: Toward providing feedback to individual therapists on their clients’ psychotherapy outcome. Journal of Clinical Psychology, 62(9), 1157–1172.
Owen, J., & Hilsenroth, M. J. (2014). Treatment adherence: The importance of therapist flexibility in relation to therapy outcomes. Journal of Counseling Psychology, 61(2), 280–288.
Owen, J., Drinane, J. M., Idigo, K. C., & Valentine, J. C. (2015). Psychotherapist effects in meta-analyses: How accurate are treatment effects? Psychotherapy, 52(3), 321–328.
Owen, J., Wampold, B. E., Kopta, M., Rousmaniere, T., & Miller, S. D. (2016). As good as it gets? Therapy outcomes of trainees over time. Journal Of Counseling Psychology, 63(1), 12–19.
Paul, G. (1967). Strategy in outcome research in psychotherapy. Journal of Consulting Psychology, 31, 109–118.
Platz, F., Kopiez, R., Lehmann, A. C., & Wolf, A. (2014). The influence of deliberate practice on musical achievement: A meta-analysis. Frontiers in Psychology, 5, 1–13.
Probst, T., Lambert, M. J., Loew, T. H., Dahlbender, R. W., Göllner, R., & Tritt, K. (2013). Feedback on patient progress and clinical support tools for therapists: Improved outcome for patients at risk of treatment failure in psychosomatic in- patient therapy under the conditions of routine practice. Journal of Psychosomatic Research, 75(3), 255–261.
Probst, T., Lambert, M. J., Loew, T. H., Dahlbender, R. W., & Tritt, K. (2015). Extreme deviations from expected recovery curves and their associations with therapeutic alliance, social support, motivation, and life events in psychosomatic in-patient therapy. Psychotherapy Research, 25(6), 714–723.
Puschner, B., Wolf, M., & Kraft, S. (2008). Helping alliance and outcome in psychotherapy: What predicts what in routine outpatient treatment? Psychotherapy Research, 18(2), 167–178.
Reese, R. J., Norsworthy, L. A., & Rowlands, S. R. (2009). Does a continuous feedback system improve psychotherapy outcome? Psychotherapy Theory, Research, Practice, Training, 46(4), 418–431.
Restifo, E., Kashyap, S., Hooke, G. R., & Page, A. C. (2015). Daily monitoring of temporal trajectories of suicidal ideation predict self-injury: A novel application of patient progress monitoring. Psychotherapy Research, 25(6), 705–713.
Rønnestad, M. H. (2016). Is expertise in psychotherapy a useful construct? Psychotherapy Bulletin, 51(1), 11–13.
Rønnestad, M. H., & Skovholt, T. M. (2001). Learning arenas for professional development: Retrospective accounts of senior psychotherapists. Professional Psychology: Research and Practice, 32(2), 181–187.
Rønnestad, M. H., & Skovholt, T. M. (2013). The developing practitioner: Growth and stagnation of therapists and counselors. New York: Routledge.
Roos, J., & Werbart, A. (2013). Therapist and relationship factors influencing dropout from individual psychotherapy: A literature review. Psychotherapy Research, 23(4), 394–418.
Rosenzweig, S. (1936). Some implicit common factors in diverse methods of psychotherapy. American Journal of Orthopsychiatry, 6, 412–415.
Rosenzweig, S. (1954). A transvaluation of psychotherapy; a reply to Hans Eysenck. The Journal of Abnormal and Social Psychology, 49, 298–304.
Safran, J. D., & Kraus, J. (2014). Alliance ruptures, impasses, and enactments: A relational perspective. Psychotherapy, 51(3), 381–387.
Safran, J. D., & Muran, J. C. (2000). Negotiating the therapeutic alliance. New York: Guildford.
Safran, J. D., & Muran, J. C. (2006). Has the concept of the therapeutic alliance outlived its usefulness? Psychotherapy: Theory, Research, Practice, Training, 43(3), 286–291.
Safran, J. D., Muran, J. C., & Eubanks-Carter, F. (2011). Repairing alliance ruptures. Psychotherapy, 48(1), 80–87.
Safran, J. D., Muran, J. C., Demaria, A., Boutwell, C., Eubanks-Carter, C., & Winston, A. (2014). Investigating the impact of alliance-focused training on interpersonal process and therapists’ capacity for experiential reflection. Psychotherapy Research, 24(3), 269–285.
Saxon, D., & Barkham, M. (2012). Patterns of therapist variability: Therapist effects and the contribution of patient severity and risk. Journal of Consulting and Clinical Psychology, 80(4), 535–546.
Sharf, J., Primavera, L. H., & Diener, M. J. (2010). Dropout and therapeutic alliance: A meta-analysis of adult individual psychotherapy. Psychotherapy Theory, Research, Practice, Training, 47(4), 637–645.
Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010). Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78, 298–311.
Simon, W., Lambert, M. J., Harris, M. W., Busath, G., & Vazquez, A. (2012). Providing patient progress information and clinical support tools to therapists: Effects on patients at risk of treatment failure. Psychotherapy Research, 22(6), 638–647.
Slife, B. D., Wiggins, B. J., & Graham, J. T. (2005). Avoiding an EST monopoly: Toward a pluralism of philosophies and methods. Journal of Contemporary Psychotherapy, 35(1), 83–97.
Slone, N. C., Mathews-Duvall, S., Reese, R. J., & Kodet, J. (2015). Evaluating the efficacy of client feedback in group psychotherapy. Group Dynamics: Theory, Research, and Practice, 19(2), 122–136.
Smith, M. L., & Glass, G. V. (1977). Meta-analysis of psychotherapy outcome studies. American Psychologist, 32(9), 752–760.
Smith, M. L., Glass, G. V., & Miller, T. I. (1980). The benefits of psychotherapy. Baltimore: The John Hopkins University Press.
Sperry, L., & Carlson, J. (2014). How master therapists work: Effecting change from the first through the last session and beyond. New York: Routledge.
Spielmans, G. I., Masters, K. S., & Lambert, M. J. (2006). A comparison of rational versus empirical methods in the prediction of psychotherapy outcome. Clinical Psychology and Psychotherapy, 13, 202–214.
Stiles, W. B. (2009). Responsiveness as an obstacle for psychotherapy outcome research: It’s worse than you think. Clinical Psychology: Science and Practice, 16, 86–91.
Stiles, W. B. (2013). The variables problem and progress in psychotherapy research. Psychotherapy, 50(1), 33–41.
Swift, J. K., & Callahan, J. L. (2011). Decreasing treatment dropout by addressing expectations for treatment length. Psychotherapy Research, 21(2), 193–200.
Swift, J. K., & Greenberg, R. P. (2012). Premature discontinuation in adult psychotherapy: A meta-analysis. Journal of Consulting and Clinical Psychology, 80(4), 547–559.
Swift, J. K., & Greenberg, R. P. (2014). A treatment by disorder meta-analysis of dropout from psychotherapy. Journal of Psychotherapy Integration, 24(3), 193–207.
Tasca, G. A., & Lampard, A. M. (2013). Reciprocal influence of alliance to the group and outcome in day treatment for eating disorders. Journal of Counseling Psychology, 59(4), 507–517.
Thoma, N. C., & Cecero, J. J. (2009). Is integrative use of techniques in psychotherapy the exception or the rule? Results of a national survey of doctoral-level practitioners. Psychotherapy Theory, Research, Practice, 46(4), 405–417.
Tracey, T. J. G., Wampold, B. E., Lichtenberg, J. W., & Goodyear, R. K. (2014). Expertise in psychotherapy. An elusive goal? American Psychologist, 69(3), 218–229.
Tryon, G. S., & Winograd, G. (2011). Goal consensus and collaboration. Psychotherapy, 48(1), 50–57.
Tschuschke, V., Crameri, A., Koehler, M., Berglar, J., Muth, K., Staczan, P., … Koemeda-Lutz, M. (2015). The role of therapists’ treatment adherence, professional experience, therapeutic alliance, and clients’ severity of psychological problems: Prediction of treatment outcome in eight different psychotherapy approaches. Preliminary results of a naturalistic study. Psychotherapy Research, 25(4), 420–434.
Wachtel, P. (2010). Beyond “Tratamentos empriricamente suportados”. Problematic assumptions in the pursuit of evidence-based practice. Psychoanalytic Psychology, 27(3), 251–272.
Walfish, S., McAlister, B., O’Donnell, P., & Lambert, M. J. (2012). An investigation of self-assessment bias in mental health providers. Psychological Reports, 110(2), 639–644.
Wampold, B. E. (2007). Psychotherapy: The humanistic (and effective) treatment. American Psychologist, 62(8), 857–873.
Wampold, B. E. (2011). Qualities and actions of effective therapists. American Psychological Association. Retrieved from https://www.apa.org/education/ce/effective-therapists.pdf.
Wampold, B. (2015). Humanism as a common factor in psychotherapy.In The handbook of humanistic psychology: Theory, research, and practice (2nd ed., pp. 400–408) (e-book). Thousand Oaks, CA: Sage.
Wampold, B. E., & Brown, G. S. (2005). Estimating variability in outcomes attributable to therapists: A naturalistic study of outcomes in managed care. Journal of Consulting and Clinical Psychology, 73(5), 914–923.
Wampold, B. E., & Imel, Z. E. (2015). The great psychotherapy debate: The evidence for what makes psychotherapy work (2nd ed.). New York: Routledge.
Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H. (1997). A meta-analysis of outcomes studies comparing bona fide psychotherapies: Empirically: “All must have prizes”. Psychological Bulletin, 122, 203–215.
Wampold, B. E., Imel, Z. E., Laska, K. M., Benish, S. Miller, S. D., Flückiger, C., … Budge, S. (2010). Determining what works in the treatment of PTSD. Clinical Psychology Review 30, 923–933.
Wampold, B. E., Frost, N. D., & Yulish, N. E. (2016). Placebo effects in psychotherapy: A flawed concept and a contorted history. Psychology of Consciousness: Theory, Research, and Practice, 3(2), 108–120.
Wampold, B. E., Lichtenberg, J. W., Goodyear, R. K., & Tracey, T. J. G. (in press). Clinical expertise: A critical issue in the age of evidence-based practice. In S. Dimidjian (Ed.), Evidence-based practice in action. New York: Guilford.
Warren, J. S., Nelson, P. L., Mondragon, S. A., Baldwin, S. A., & Burlingame, G. M. (2010). Youth psychotherapy change trajectories and outcomes in usual care: Community mental health versus managed care settings. Journal of Consulting and Clinical Psychology, 78(2), 144–155.
Werbart, A., Von Below, C., Brun, J., & Gunnarsdottir, H. (2015). ‘Spinning one’s wheels’: Nonimproved patients view their psychotherapy. Psychotherapy Research, 25(5), 546–564.
Wierzbicki, M., & Pekarik, G. (1993). A meta-analysis of psychotherapy dropout. Professional Psychology: Research and Practice, 24(2), 190–195.
Zeeck, A., Orlinsky, D. E., Hermann, S., Joos, A., Wirsching, M., Weidmann, W., et al. (2012). Stressful involvement in psychotherapeutic work: Therapist, client and process correlates. Psychotherapy Research, 22(5), 543–555.
Zilcha-Mano, S., Eubanks-Carter, F., Muran, J. C., Hungr, C., Safran, J. D., & Winston, A. (2016). The relationship between alliance and outcome: Analysis of a two-person perspective on alliance and session outcome. Journal of Consulting and Clinical Psychology, 84(6), 484–496.
Zuroff, D. C., Kelly, A. C., Leybman, M. J., Blatt, S. J., & Wampold, B. E. (2010). Between-therapist and within-therapist differences in the quality of the therapeutic relationship: Effects on maladjustment and self-critical perfectionism. Journal of Clinical Psychology, 66(7), 681–697.
Zuroff, D. C., Shahar, G., Blatt, S. J., Kelly, A. C., & Leybman, M. J. (2016). Predictors and moderators of between-therapists and within-therapist. Differences in depressed outpatients’ experiences of the rogerian conditions. Journal of Counseling Psychology, 63(2), 162–172.
Author information
Authors and Affiliations
Corresponding author
Copyright information
© 2017 The Author(s)
About this chapter
Cite this chapter
Sousa, D. (2017). Scientific Research into Psychotherapy. In: Existential Psychotherapy. Palgrave Macmillan, New York. https://doi.org/10.1057/978-1-349-95217-5_1
Download citation
DOI: https://doi.org/10.1057/978-1-349-95217-5_1
Published:
Publisher Name: Palgrave Macmillan, New York
Print ISBN: 978-1-349-95216-8
Online ISBN: 978-1-349-95217-5
eBook Packages: Behavioral Science and PsychologyBehavioral Science and Psychology (R0)