Abstract
To understand how and why psychotherapy works, it is necessary to focus on (both) the process of psychotherapy (i.e., what takes place during the treatment) and the relationship between this process and the outcome of psychotherapy (i.e., the treatment’s clinical effects). In the present chapter, we provide an overview of three main quantitative research strategies that may be differently used to fulfill this aim. These include treatment process research (which investigates what takes place during psychotherapy, regardless of its clinical meaningfulness), change process research (which investigates what takes place during psychotherapy, with regard to its clinical meaningfulness), and process-outcome research (which investigates the relationship between what takes place during psychotherapy and its clinical effects). We first define the process and outcome of psychotherapy; then, for each research approach proposed, we review the research design, data collection, and data analysis issues; finally, we conclude with suggestions for future research.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Actually, quantitative research may also be described with regard to other aspects that are related to the research methods (e.g., data collection, sampling, and research designs) as well as with reference to the methodological principles that underlie these methods and the philosophical worldviews that are the basis of these methodological principles. However, we believe that, at a very pragmatic and procedural level, considering data analysis is enough to characterize the quantitative approaches to empirical research (see Gelo 2012; Gelo et al. 2008, 2009; Polkinghorne 1983; and Ponterotto 2005 for an articulated discussion; also see Chap. 4).
- 2.
Elaborated with the aim to coherently organize the empirical literature that links the therapeutic process to the outcome (see Sect. 13.3.3 for more details on process-outcome research), it offers a very useful abstract and synthetic representation of what can be considered the main dimensions of the therapeutic process. Beyond this process, the Generic Model of Psychotherapy also encompasses the input (i.e., antecedents of the process) and the output [i.e., the consequences of the process, which include the therapy outcome (see Sect. 13.2.2)] (see Orlinsky 2009 for a detailed overview).
- 3.
Actually, a sixth facet exists, temporal patterns, which was introduced in the fourth edition of the Handbook of Psychotherapy and Behaviour Change. This facet describes a specific way of analyzing one or more process variables and, for this reason, will be introduced later in this chapter (see Sect. 13.3.3.1).
- 4.
- 5.
It should be noted that the term of process research may also be used to refer to any kind of research that focuses on the process, either alone (see Chap. 1 and 9) or with regard to its relationship with the outcome (see Sect. 13.3.3).
- 6.
The term naturalistic is often used to describe the approach used by qualitative research (see Chap. 20).
- 7.
At a very pragmatic level, the difference between an experiment and a quasi-experiment is that in the former case, subjects are randomized to the different conditions, while this is not the case for quasi-experiments. Both include the manipulation of an independent variable.
- 8.
Although experimental research presents higher internal validity (due to the greater control of confounding variables with regard to the investigated cause-effect relationships) and external validity (due to the higher control of sampling procedures that allow the results to be generalized from the sample to the population), non-experimental research presents a higher ecologic validity (which addresses the degree to which we may generalize our results to real-life contexts outside the laboratory) due to being characterized by less strict control. Different researchers, who provide different emphasis on either internal and external validity or ecological validity, will, consequently, prefer to use either an experimental or non-experimental approach.
- 9.
We should stress that this difference is of a more heuristic and theoretical/conceptual nature and does not necessarily have practical implications for the practice of psychotherapy research.
- 10.
In contrast, more complex, mixed-method approaches to CPR, belonging to the so called significant event approache (see Elliott 2010 for an overview; also see Rice and Greenberg 1984), make use of a combination of both theoretical and empirical ways to identify significant events. Prototypical examples of this approach include task analysis (e.g., Greenberg 2007; Pascual-Leone et al. 2009), comprehensive process analysis (e.g., Elliott et al. 1994), and assimilation analysis (Stiles et al. 1990).
- 11.
This work of Safran and Muran (1996) actually represents a more complex design where, prior to the quantitative assessment of the relationship among the variables of interest, a performance model was created following an empirical-rational approach. This is a prototypical example of what Greenberg (2007) calls task analysis.
- 12.
- 13.
It should be noted that, beginning with the fourth edition of the handbook, the GMP was enriched with a sixth dimension, temporal patterns. Because these address a specific way of analyzing the process rather than a constitutive conceptual element of it, we will refer to it later when discussing data analysis in POR (see Sect. 13.3.3.3).
- 14.
- 15.
- 16.
Dynamic systems theory (DST) has been recently applied to psychotherapy research in order to explain the dynamic nature of clinical processes. A theoretical and methodological account of this is offered in Chap. 10. See Tschacher, Gelo, Koch, & Salvatore (2014) for some empirical applications.
- 17.
MLMs represent a collective group, including, among others, hierarchical linear models, mixed-effects models, random regression models, and growth curve modeling (Tasca and Gallop 2009).
References
Angus L, Lewin J, Boritz T, Bryntwick E, Carpenter N, Watson-Gaze J et al (2012) Narrative processes coding system: a dialectical constructivist approach to assessing client change processes in emotion-focused therapy of depression. Res Psychother 15(2):54–61. doi:10.7411/RP.2012.006
Bakeman R, Gottman JM (1997) Observing interaction: an introduction to sequential analysis, 2nd edn. Cambridge University Press, Cambridge
Barber JP, Connolly MB, Crits-Christoph P, Gladis L, Siqueland L (2000) Alliance predicts patients’ outcome beyond in-treatment change in symptoms. J Consult Clin Psychol 68(6):1027–1032. doi:10.1037/0022-006X.68.6.1027
Barrett MS, Berman JS (2001) Is psychotherapy more effective when therapists disclose information about themselves? J Consult Clin Psychol 69(4):597–603. doi:10.1037/0022-006X.69.4.597
Barrett-Lennard GT (1962) Dimensions of therapist response as causal factors in therapeutic change. Psychol Monogr 76(43):1–36. doi:10.1037/h0093918
Battle CC, Imber SD, Hoehn-Saric R, Stone A, Nash ER, Frank JD (1966) Target complaints as criteria for improvement. Am J Psychother 20:184–192
Beck AT, Ward CH, Mendelson M, Mock J, Erbaugh J (1961) An inventory for measuring depression. Arch Gen Psychiatry 4:561–571. doi:10.1001/archpsyc.1961.01710120031004
Benjamin LS (1974) Structural analysis of social behavior. Psychol Rev 81(5):392–425. doi:10.1037/h0037024
Benjamin LS, Rothweiler JC, Critchfield KL (2006) The use of structural analysis of social behavior (SASB) as an assessment tool. Annu Rev Clin Psychol 2:83–109. doi:10.1146/annurev.clinpsy.2.022305.095337
Beutler LE, Moleiro C, Malik M, Mark Harwood T, Romanelli R, Gallagher-Thompson D et al (2003) A comparison of the Dodo, EST, and ATI factors among comorbid stimulant-dependent, depressed patients. Clin Psychol Psychother 10(2):69–85. doi:10.1002/cpp.354
Brossart DF, Willson VL, Patton MJ, Kivlighan DM Jr, Multon KD (1998) A time series model of the working alliance: a key process in short-term psychoanalytic counseling. Psychother Theory Res Pract Train 35(2):197–205. doi: 10.1037/h0087645
Bucci W, Maskit B (2006) A weighted dictionary for referential activity. In: Shanahan YJG, Wiebe Q (eds) Computing attitude and affect in text. Springer, Dordrecht, pp 49–60
Colli A, Lingiardi V (2009) The collaborative interactions scale: a new transcript-based method for the assessment of therapeutic alliance ruptures and resolutions in psychotherapy. Psychother Res 19(6):718–734. doi:10.1080/10503300903121098
Covner BJ (1942) Studies in phonographic recordings of verbal material: I. The use of phonographic recordings in counseling practice and research. J Consult Psychol 6(2):105–113. doi:10.1037/h0053878
Crits-Christoph P, Connolly G, Mukherjee D (2013) Psychotherapy process-outcome research. In: Lambert MJ (ed) Bergin and Garfield’s handbook of psychotherapy and behavior change, 4th edn. Wiley, New York, pp 298–340
Derogatis LR, Rickels K, Roch AF (1976) The SCL-90 and the MMPI: a step in the validation of a new self-report scale. Br J Psychiatry 128:280–289
Di Giuseppe M, Perry JC, Petraglia J, Janzen J, Lingiardi V (2014) Development of a Q-sort version of the defense mechanism rating scales (DMRS-Q) for clinical use. J Clin Psychol 70(5):452–465. doi:10.1002/jclp.22089
Dimaggio G, Procacci M, Nicolò G, Popolo R, Semerari A, Carcione A, Lysaker PH (2007) Poor metacognition in narcissistic and avoidant personality disorders: four psychotherapy patients analysed using the metacognition assessment scale. Clin Psychol Psychother 14(5):386–401. doi:10.1002/cpp.541
Dittes JE (1959) Previous studies bearing on content analysis of psychotherapy. In: Dollard J, Auld F (eds) Scoring human motives: a manual. Yale University Press, New Haven, pp 325–351
Doran JM, Safran JD, Waizmann V, Bolger K, Muran JC (2012) The alliance negotiation scale: psychometric construction and preliminary reliability and validity analysis. Psychother Res 22(6):710–719. doi:10.1080/10503307.2012.709326
Elliott R (1991) Five dimensions of therapy process. Psychother Res 1:92–103. doi:10.1080/10503309112331335521
Elliott R (2010) Psychotherapy change process research: realizing the promise. Psychother Res 20(2):123–135. doi:10.1080/10503300903470743
Elliott R, Anderson C (1994) Simplicity and complexity in psychotherapy research. In: Russell RL (ed) Reassessing psychotherapy research. Guilford, New York, NY, pp 65–113
Elliott R, Farber BA (2010) Carl Rogers: idealistic pragmatist and psychotherapy research pioneer. In: Castonguay LG, Muran JC, Angus L, Hayes JA, Ladany N, Anderson T (eds) Bringing psychotherapy research to life: understanding change through the work of leading clinical researchers. American Psychological Association, Washington, DC, pp 17–27
Elliott R, Hill CE, Stiles WB, Friedlander ML, Mahrer AR, Margison FR (1987) Primary therapist response modes: comparison of six rating systems. J Consult Clin Psychol 55(2):218–223. doi:10.1037/0022-006X.55.2.218
Elliott R, Shapiro DA, Firth-Cozens J, Stiles WB, Hardy G, Llewelyn SP et al (1994) Comprehensive process analysis of insight events in cognitive-behavioral and psychodynamic-interpersonal therapies. J Couns Psychol 41:449–463. doi: 10.1037/0022-0167.41.4.449
Endicott J, Spitzer RL, Fleiss JL, Cohen J (1976) The global assessment scale: a procedure for measuring overall severity of psychiatric disturbance. Arch Gen Psychiatry 33(6):766–771. doi:10.1001/archpsyc.1976.01770060086012
Evans C, Connell J, Barkham M, Margison F, McGrath G, Mellor-Clark J et al (2002) Towards a standardised brief outcome measure: psychometric properties and utility of the CORE–OM. Br J Psychiatry 180(1):51–60. doi:10.1192/bjp.180.1.51
Falkenstrom F, Granstrom F, Holmqvist R (2013) Therapeutic alliance predicts symptomatic improvement session by session. J Couns Psychol 60(3):317–328. doi:10.1037/a0032258
Falkenström F, Granström F, Holmqvist R (2014) Working alliance predicts psychotherapy outcome even while controlling for prior symptom improvement. Psychother Res 24(2):146–159. doi:10.1080/10503307.2013.847985
Feeley M, DeRubeis RJ, Gelfand LA (1999) The temporal relation of adherence and alliance to symptom change in cognitive therapy for depression. J Consult Clin Psychol 67(4):578–582. doi: 10.1037/0022-006X.67.4.578
Fertuck EA, Mergenthaler E, Target M, Levy KN, Clarkin JF (2012) Development and criterion validity of a computerized text analysis measure of reflective functioning. Psychother Res 22(3):298–305. doi:10.1080/10503307.2011.650654
Fisher AJ, Newman MG, Molenaar PCM (2011) A quantitative method for the analysis of nomothetic relationships between idiographic structures: dynamic patterns create attractor states for sustained posttreatment change. J Consult Clin Psychol 79:552–563. doi:10.1037/a0024069
Flückiger C, Regli D, Zwahlen D, Hostettler S, Caspar F (2010) Der berner patienten- und therapeutenstundenbogen 2000: Ein instrument zur erfassung von therapieprozessen (The Bern Post Session Report 2000, patient and therapist versions: measuring psychotherapeutic processes). Zeitschrift für Klinische Psychologie und Psychotherapie: Forschung und Praxis 39(2):71–79. doi:10.1026/1616-3443/a000015
Friedlander ML (1982) Counseling discourse as a speech event: revision and extension of the hill counselor verbal response category system. J Couns Psychol 29(4):425–429. doi:10.1037/0022-0167.29.4.425
Gallop R, Tasca GA (2009) Multilevel modelling of longitudinal data for psychotherapy researchers: II. The complexities. Psychother Res 19(4–5):438–52. doi:10.1080/10503300902849475
Gelo OCG (2012) On research methods and their philosophical assumptions: “raising the consciousness of researchers” again. Psychotherapie and Sozialwissenschaft 14:111–130
Gelo OCG, Mergenthaler E (2012) Unconventional metaphors and emotional-cognitive regulation in a metacognitive interpersonal therapy. Psychother Res 22(2):159–175. doi:10.1080/10503307.2011.629636
Gelo OCG, Braakmann D, Benetka G (2008) Quantitative and qualitative research: beyond the debate. Integr Psychol Behav Sci 42(3):266–290. doi:10.1007/s12124-008-9078-3
Gelo OCG, Braakmann D, Benetka G (2009) Erratum to “Quantitative and qualitative research: beyond the debate”. Integr Psychol Behav Sci 43:406–407. doi:10.1007/s12124-009-9107-x
Gelo OCG, Gelo C (2012) Dialogical relationships among scientific paradigms in psychotherapy research. In: Paper presented at the 3rd joint meeting of the society for psychotherapy research, European and UK Chapters, Porto, Portugal
Gelo OCG, Salcuni S, Antonello C (2012) Text analysis within quantitative and qualitative psychotherapy process research: introduction to special issue. Res Psychother 15(2):45–53. doi:10.7411/RP.2012.005
Gilles A, de Roten Y, Drapeau M, Despland JN (2007) Early change in maladaptive defence style and development of the therapeutic alliance. Clin Psychol Psychother 14(2):89–95. doi:10.1002/cpp.521
Gleser GC, Ihilevich D (1969) An objective instrument for measuring defense mechanisms. J Consult Clin Psychol 33(1):51–60. doi:10.1037/h0027381
Gloster AT, Klotsche J, Gerlach AL, Hamm A, Ströhle A, Gauggel S et al (2014) Timing matters: change depends on the stage of treatment in cognitive behavioral therapy for panic disorder with agoraphobia. J Consult Clin Psychol 82(1):141–153. doi:10.1037/a0034555
Gonçalves MM, Ribeiro AP, Mendes I, Matos M, Santos A (2011) Tracking novelties in psychotherapy process research: the innovative moments coding system. Psychother Res 21(5):497–509. doi:10.1080/10503307.2011.560207
Gonçalves MM, Mendes I, Cruz G, Ribeiro AP, Sousa I, Angus L et al (2012) Innovative moments and change in client-centered therapy. Psychother Res 22(4):389–401. doi:10.1080/10503307.2012.662605
Grabhorn R, Stenner H, Stangier U, Kaufhold J (2006) Social anxiety in anorexia and bulimia nervosa: the mediating role of shame. Clin Psychol Psychother 13(1):12–19. doi:10.1002/cpp.463
Greenberg LS (1986) Change process research. J Consult Clin Psychol 54(1):4–9. doi: 10.1037/0022-006X.54.1.4
Greenberg L (1991) Research on the process of change. Psychother Res 1(1):3–16. doi:10.1080/10503309112331334011
Greenberg LS (2007) A guide to conducting a task analysis of psychotherapeutic change. Psychother Res 17(1):15–30. doi:10.1080/10503300600720390
Greenberg LS, Pinsof WM (1986) The psychotherapeutic process: a research handbook. Routledge, New York
Hamilton MA (1960) A rating scale for depression. J Neurol Neurosurg Psychiatry 23(6):56–62
Hamilton J (1994) Time-series analysis. Princeton University Press, Princeton
Harmon SC, Lambert MJ, Smart DM, Hawkins E, Nielsen SL, Slade K et al (2007) Enhancing outcome for potential treatment failures: therapist-client feedback and clinical support tools. Psychother Res 17(4):379–392. doi:10.1080/10503300600702331
Hartley DE, Strupp HH (1983) The therapeutic alliance: Its relationship to outcome in brief psychotherapy. In: Masling J (ed) Empirical studies of psychoanalytical theories. Analytical Press, Hillsdale, NJ, pp 1–38
Hartmann A, Orlinsky DE, Geller JD, Zeeck A (2003) The intersession questionnaire–an inventory for the measurement of patients' processing of psychotherapy between sessions. Psychother Psychosom Med Psychol 53(11):464–468. doi:10.1055/s-2003-43391
Hartmann A, Orlinsky D, Weber S, Sandholz A, Zeeck A (2010) Session and intersession experience related to treatment outcome in bulimia nervosa. Psychother Theory Res Pract Train 47(3):355–370. doi:10.1037/a0021166
Hartmann A, Orlinsky D, Zeeck A (2011) The structure of intersession experience in psychotherapy and its relation to the therapeutic alliance. J Clin Psychol 67(10):1044–1063. doi:10.1002/jclp.20826
Harway NI, Dittmann AT, Raush HL, Bordin ES, Rigler D (1955) The measurement of depth of interpretation. J Consult Psychol 19(4):247–253. doi:10.1037/h0041396
Hawley LL, Ho M-HR, Zuroff DC, Blatt SJ (2006) The relationship of perfectionism, depression, and therapeutic alliance during treatment for depression: latent difference score analysis. J Consult Clin Psychol 74(5):930–942. doi: 10.1037/0022-006x.74.5.930
Hayes AM, Laurenceau J-P, Feldman G, Strauss JL, Cardaciotto L (2007) Change is not always linear: the study of nonlinear and discontinuous patterns of change in psychotherapy. Clin Psychol Rev 27(6):715–723. doi:10.1016/j.cpr.2007.01.008
Hersoug AG, Bøgwald K-P, Høglend P (2003) Are patient and therapist characteristics associated with the use of defence interpretation in brief dynamic psychotherapy? Clin Psychol Psychother 10(4):209–219. doi:10.1002/cpp.372
Hill CE (1978) Development of a counselor verbal response category. J Couns Psychol 25(5):461–468. doi:10.1037/0022-0167.25.5.461
Hill CE (1990) Exploratory in-session process research in individual psychotherapy: a review. J Consult Clin Psychol 58(3):288–294. doi:10.1037/0022-006X.58.3.288
Hill CE (1994) From an experimental to an exploratory naturalistic approach to studying psychotherapy process. In: Russell RL (ed) Reassessing psychotherapy research. Guilford, New York, pp 144–165
Hill CE, Gormally J (1977) Effects of reflection, restatement, probe, and nonverbal behaviors on client affect. J Couns Psychol 24(2):92–97. doi:10.1037/0022-0167.24.2.92
Hill CE, Lambert MJ (2004) Methodological issues in studying psychotherapeutic processes and outcome. In: Lambert MJ (ed) Bergin and Garfield’s handbook of psychotherapy and behaviour change, 5th edn. Wiley, New York, pp 55–71
Hill CE, Nutt EA, Jackson S (1994) Trends in psychotherapy process research: samples, measures, researchers, and classic publications. J Couns Psychol 41(3):364–377. doi:10.1037/0022-0167.41.3.364
Hilliard RB (1993) Single-case methodology in psychotherapy process and outcome research. J Consult Clin Psychol 61(3):373–380. doi:0022-006X.67.4.578/0022-006X.61.3.373
Hilsenroth MJ, Blagys MD, Ackerman SJ, Bonge DR, Blais MA (2005) Measuring psychodynamic-interpersonal and cognitive-behavioral techniques: Development of the comparative psychotherapy process scale. Psychother Theory Res Pract Train 42(3):340–356. doi: 10.1037/0033-3204.42.3.340
Hoffart A, Borge FM, Sexton H, Clark DM (2009) The role of common factors in residential cognitive and interpersonal therapy for social phobia: a process-outcome study. Psychother Res 19(1):54–67. doi:10.1080/10503300802369343
Hogue A, Henderson CE, Dauber S, Barajas PC, Fried A, Liddle HA (2008) Treatment adherence, competence, and outcome in individual and family therapy for adolescent behavior problems. J Consult Clin Psychol 76(4):544–555. doi:10.1037/0022-006X.76.4.544
Horowitz LM, Rosenberg SE, Baer BA, Ureño G, Villaseñor VS (1988) Inventory of interpersonal problems: psychometric properties and clinical applications. J Consult Clin Psychol 56(6):885–892. doi:10.1037/0022-006X.56.6.885
Horvath AO, Greenberg LS (1989) Development and validation of the working alliance inventory. J Couns Psychol 36(2):223–233. doi:10.1037/0022-0167.36.2.223
Iwakabe S, Gazzola N (2009) From single-case studies to practice-based knowledge: aggregating and synthesizing case studies. Psychother Res 19(4–5):601–611. doi:10.1080/10503300802688494
Jaycox LH, Foa EB, Morral AR (1998) Influence of emotional engagement and habituation on exposure therapy for PTSD. J Consult Clin Psychol 66(1):185–92. doi: 10.1037//0022-006x.66.1.185
Jones EE (1985) Manual for the psychotherapy process Q-set. University of California, Berkeley
Kazdin AE (2009) Understanding how and why psychotherapy leads to change. Psychother Res 19(4–5):418–428. doi:10.1080/10503300802448899
Kiesler DJ (1973) The process of psychotherapy: empirical foundations and systems of analysis. Aldine, Oxford
Klein MH, Mathieu PL, Gendlin ET, Kiesler DJ (1969) The experiencing scale: a research and training manual. Madison, Wisconsin
Klein MH, Mathieu-Coughlan P, Kiesler DJ (1986) The experiencing scales. In: Greenberg LS, Pinsof WM (eds) The psychotherapeutic process: a research handbook. Guilford, New York, pp 21–71
Klein DN, Schwartz JE, Santiago NJ, Vivian D, Vocisano C, Castonguay LG et al (2003) Therapeutic alliance in depression treatment: controlling for prior change and patient characteristics. J Consult Clin Psychol 71(6):997–1006. doi:10.1037/0022-006x.71.6.997
Kline RB (1998) Principles and practice of structural equation modeling. Guilford, New York
Kolden G (1991) The generic model of psychotherapy: an empirical investigation of patterns of process and outcome relationships. Psychother Res 1(1):62–73. doi:10.1080/10503309112331334071
Kolden GG (1996) Change in early sessions of dynamic therapy: universal processes and the generic model of psychotherapy. J Consult Clin Psychol 64(3):489–496. doi:10.1037/0022-006X.64.3.489
Kolden GG, Klein MH, Strauman TJ, Chisholm-Stockard S, Heerey E, Schneider KL et al (2005) Early psychotherapy process and cluster B and C personality pathology: similarities and differences in interactions with symptomatic and interpersonal distress. Psychother Res 15(3):165–177. doi:10.1080/10503300512331387825
Kolden GG, Chisholm-Stockard SM, Strauman TJ, Tierney SC, Mullen EA, Schneider KL (2006) Universal session-level change processes in an early session of psychotherapy: path models. J Consult Clin Psychol 74(2):327–336. doi: 10.1037/0022-006x.74.2.327
Krause MS, Lutz W, Saunders SM (2007) Empirically certified treatments or therapists: the issue of separability. Psychother Theory Res Pract Train 44(3):347–353. doi: 10.1037/0033-3204.44.3.347
Lambert MJ (2013) The efficacy and effectiveness of psychotherapy. In: Lambert MJ (ed) Bergin and Garfield’s handbook of psychotherapy and behavior change, 6th edn. WIley, New York, pp 169–218
Lambert MJ, Whipple JL, Smart DW, Vermeersch DA, Nielsen SL (2001) The effects of providing therapists with feedback on patient progress during psychotherapy: are outcomes enhanced? Psychother Res 11(1):49–68. doi:10.1080/713663852
Lambert MJ, Garfield SL, Bergin AE (2004) Overview, trends, and future issues. In: Lambert MJ (ed) Bergin and Garfield’s handbook of psychotherapy and behaviour change, 5th edn. Wiley, New York, pp 805–821
Lambert MJ, Morton JJ, Hatfield D, Harmon C, Hamilton S, Reid RC et al (2004) Administration and scoring manual for the outcome questionnaire-45. American Professional Credentialing Services, Orem
Lasswell HD (1935) Verbal references and physiological changes during the psychoanalytic interview: a preliminary communication. Psychoanal Rev 22:10–24
Laurenceau J-P, Hayes AM, Feldman GC (2007) Some methodological and statistical issues in the study of change processes in psychotherapy. Clin Psychol Rev 27(6):682–695. doi:10.1016/j.cpr.2007.01.007
Lepper G, Riding N (2006) Researching the psychotherapy process: a practical guide to transcript-based methods. Palgrave Macmillan, Basingstoke
Lingiardi V, Colli A, Gentile D, Tanzilli A (2011) Exploration of session process: relationship to depth and alliance. Psychotherapy (Chic) 48(4):391–400. doi:10.1037/a0025248
Loeb KL, Wilson GT, Labouvie E, Pratt EM, Hayaki J, Walsh BT et al (2005) Therapeutic alliance and treatment adherence in two interventions for Bulimia Nervosa: a study of process and outcome. J Consult Clin Psychol 73(6):1097–1107. doi:10.1037/0022-006x.73.6.1097
Luborsky L (1998) A guide to the CCRT method. In: Luborsky L, Crits-Christoph P (eds) Understanding transference: the core conflictual relationship theme method, 2nd edn. American Psychological Association, Washington, pp 15–42
Luborsky L, Auerbach AH, Chandler M, Cohen J, Bachrach HM (1971) Factors influencing the outcome of psychotherapy: a review of quantitative research. Psychol Bull 75(3):145–185. doi:10.1037/h0030480
Luborsky L, Crits-Christoph P, Alexander L, Margolis M, Cohen M (1983) Two helping alliance methods for predicting outcomes of psychotherapy: a counting signs vs. a global rating method. J Nerv Ment Dis 171(8):480–491. doi:10.1097/00005053-198308000-00005
Lundy MS, Orlinsky DE (1987) Therapists’ experiences of therapy between sessions. In: Paper presented at the 18th annual meeting of the society for psychotherapy research, Ulm
Lutz W, Knox S (2013) Quantitative and qualitative methods in psychotherapy research. Routledge, London
MacKenzie K (1983) The clinical application of a group climate measure. In: Dies RR, MacKenzie KR (eds) Advances in group psychotherapy: Integrating research and practice. International Universities Press, Madison, pp 159–170
Mahrer AR (1988) Discovery-oriented psychotherapy research: rationale, aims, and methods. Am Psychol 43(9):694–702. doi:10.1037/0003-066x.43.9.694
Marsden G (1971) Content analysis studies in psychotherapy: 1954 through 1968. In: Bergin AE, Garfield SL (eds) Handbook of psychotherapy and behavior change, 1st edn. Wiley, London, pp 345–407
Matos M, Santos A, Gonçalves M, Martins C (2009) Innovative moments and change in narrative therapy. Psychother Res 19(1):68–80. doi:10.1080/10503300802430657
McArdle JJ, Hamagami F (2001) Latent difference score structural models for linear dynamic analyses with incomplete longitudinal data. In: Collins LM, Sayer AG (eds) New methods for the analysis of change. American Psychological Association, Washington, pp 137–175
Meehl EE (1967) Theory-testing in psychology and physics: a methodological paradox. Philos Sci 34:103–115
Meehl PE (1978) Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. J Consult Clin Psychol 46:806–834. doi:10.1037/0022-006X.46.4.806
Meltzoff J, Kornreich M (1970) Research in psychotherapy. Atherton, New York
Mendes I, Ribeiro AP, Angus L, Greenberg LS, Sousa I, Gonçalves MM (2010) Narrative change in emotion-focused therapy: how is change constructed through the lens of the innovative moments coding system? Psychother Res 20:692–701. doi:10.1080/10503307.2010.514960
Mergenthaler E (1996) Emotion-abstraction patterns in verbatim protocols: a new way of describing psychotherapeutic processes. J Consult Clin Psychol 64:1306–1315. doi:10.1037//0022-006X.64.6.1306
Mergenthaler E (2008) Resonating minds: a school-independent theoretical conception and its empirical application to psychotherapeutic processes. Psychother Res 18(2):109–126. doi:10.1080/10503300701883741
Mergenthaler E, Bucci W (1999) Linking verbal and non-verbal representations: computer analysis of referential activity. Br J Med Psychol 72:339–354. doi:10.1348/000711299160040
Mergenthaler E, Stinson CH (1992) Psychotherapy transcription standards. Psychother Res 2(2):125–142. doi:10.1080/10503309212331332904
Michalak J, Wiethoff M, Schulte D (2005) Therapeutic alliance and behavior inhibition. Psychother Res 15(3):334–338. doi:10.1080/10503300500091207
Milbrath C, Bond M, Cooper S, Znoj HJ, Horowitz MJ, Perry JC (1999) Sequential consequences of therapists’ interventions. J Psychother Pract Res 8(1):40–55
Mintz J, Luborsky L, Christoph P (1979) Measuring the outcomes of psychotherapy: findings of the Penn psychotherapy project. J Consult Clin Psychol 47(2):319–334. doi:10.1037/0022-006X.47.2.319
Molenaar PCM, Campbell CG (2009) The new person-specific paradigm in psychology. Curr Dir Psychol Sci 18:112–117. doi:10.1111/j.1467-8721.2009.01619.x
Montgomery GH, Peck S, Vining GG (2012) Introduction to linear regression analysis, 5th edn. Wiley, Hoboken
Moyers TB, Miller WR, Hendrickson SML (2005) How does motivational interviewing work? Therapist interpersonal skill predicts client involvement within motivational interviewing sessions. J Consult Clin Psychol 73(4):590–598. doi:10.1037/0022-006X.73.4.590
Muran JC, Safran JD, Samstag LW, Winston A (1992) Patient and therapist postsession questionnaires, Version 1992. Beth Israel Medical Center, New York
Orlinsky DE (2009) The “Generic Model of Psychotherapy” after 25 years: evolution of a research-based metatheory. J Psychother Integr 19:319–339
Orlinsky DE, Howard KI (1978) The relation of process to outcome in psychotherapy. In: Garfield SL, Bergin AE (eds) Handbook of psychotherapy and behavior change, 2nd edn. Wiley, New York
Orlinsky DE, Howard KI (1984) A Generic Model of Psychotherapy. In: Paper presented at the 1st annual meeting of the society for the exploration of psychotherapy integration (SEPI), Annapolis
Orlinsky DE, Howard KI (1986) The psychological interior of psychotherapy: explorations with the Therapy Session Reports. In: Greenberg LS, Pinsof WM (eds) The psychotherapeutic process: a research handbook. Guilford, New York, pp 477–501 (Guilford clinical psychology and psychotherapy series)
Orlinsky DE, Grawe K, Parks B (1994) Process and outcome in psychotherapy—noch Einmal. In: Bergin AE, Garfield SL (eds) Handbook of psychotherapy and behavior change, 4th edn. Wiley, New York, pp 270–376
Orlinsky DE, Rønnestad MH, Willutzki U (2004) Fifty years of psychotherapy process-outcome research: continuity and change. In: Lambert MJ (ed) Bergin and Garfield’s handbook of psychotherapy and behavior change, 5th edn. Wiley, New York, pp 307–392
Owen J, Quirk K, Hilsenroth MJ, Rodolfa E (2012) Working through: in-session processes that promote between-session thoughts and activities. J Couns Psychol 59(1):161–167. doi:10.1037/a0023616
Pascual-Leone A (2009) Dynamic emotional processing in experiential therapy: two steps forward, one step back. J Consult Clin Psychol 77(1):113–126. doi:10.1037/a0014488
Pascual-Leone A, Greenberg LS, Pascual-Leone J (2009) Developments in task analysis: new methods to study change. Psychother Res 19(4):527–542. doi:10.1080/10503300902897797
Perry JC (1990) Defense mechanisms rating scale. Cambridge Hospital, Harvard Medical School, Boston, MA
Petrocelli JV (2003) Hierarchical multiple regression in counseling research: common problems and possible remedies. Meas Eval Couns Dev 36(1):9–22
Polkinghorne DE (1983) Methodology for the human sciences: systems of inquiry. State University of New York Press, Albany
Ponterotto JG (2005) Qualitative research in counseling psychology: a primer on research paradigms and philosophy of science. J Couns Psychol 52(2):126–136. doi:10.1037/0022-0167.52.2.126
Quintana SM, Maxwell SE (1999) Implications of recent developments in structural equation modeling for counseling psychology. Couns Psychol 27(4):485–527. doi:10.1177/0011000099274002
Ramseyer F, Tschacher W (2011) Nonverbal synchrony in psychotherapy: coordinated body movement reflects relationship quality and outcome. J Consult Clin Psychol 79:284–295. doi:10.1037/a0023419
Ramseyer F, Kupper Z, Caspar F, Znoj H, Tschacher W (2014) Time-series panel analysis (TSPA): multivariate modeling of temporal associations in psychotherapy process. J Consult Clin Psychol, No Pagination Specified. doi:10.1037/a0037168
Ramseyer F, Kupper Z, Caspar F, Znoj H, Tschacher W (2014) Time-series panel analysis (TSPA): multivariate modeling of temporal associations in psychotherapy process. J Consult Clin Psychol. doi:10.1037/a003716
Raudenbush S, Bryk AS (2002) Hierarchical linear models, 2nd edn. Sage, London
Rice LN, Greenberg LS (1984) Patterns of change. Guilford, New York
Rogers CR (1942) Counseling and psychotherapy. Houghton Mifflin, Boston
Rogers CR (1957) The necessary and sufficient conditions of therapeutic personality change. J Consult Psychol 21(2):95–103. doi:10.1037/h0045357
Rogers CR (1975) Empathic: an unappreciated way of being. Couns Psychol 5(2):2–10. doi:10.1177/001100007500500202
Rosenberg M (1965) Society and the adolescent self image. Princeton University Press, Princeton, NJ
Russell RL, Trull TJ (1986) Sequential analyses of language variables in psychotherapy process research. J Consult Clin Psychol 54(1):16–21. doi:10.1037/0022-006X.54.1.16
Safran JD, Muran JC (1996) The resolution of ruptures in the therapeutic alliance. J Consult Clin Psychol 64(3):447–458. doi:10.1037/0022-006X.64.3.447
Salvatore S, Tschacher W (2012) Time dependency of psychotherapeutic exchanges: the contribution of the theory of dynamic systems in analyzing process. Front Psychol 3:1–14. doi:10.3389/fpsyg.2012.00253
Salvatore S, Valsiner J (2010) Between the general and the unique. Theory Psychol 20:817–833. doi:10.1177/0959354310381156
Salvatore S, Gelo O, Gennaro A, Manzo S, Al Radaideh A (2009) Looking at the psychotherapy process as an intersubjective dynamic of meaning-making: a case study with discourse flow analysis. J Constr Psychol 23(3):195–230. doi:10.1080/10720531003765981
Salvatore S, Gennaro A, Auletta AF, Tonti M, Nitti M (2012) Automated method of content analysis: a device for psychotherapy process research. Psychother Res 22(3):256–273. doi:10.1080/10503307.2011.647930
Semerari A, Carcione A, Dimaggio G, Falcone M, Nicolo G, Procacci M et al (2003) How to evaluate metacognitive functioning in psychotherapy? The metacognition assessment scale and its applications. Clin Psychol Psychother 10(4):238–261. doi:10.1002/cpp.362
Sexton H (1993) Exploring a psychotherapeutic change sequence: relating process to intersessional and posttreatment outcome. J Consult Clin Psychol 61(1):128–136. doi:10.1037/0022-006X.61.1.128
Sexton HC, Hembre K, Kvarme G (1996) The interaction of the alliance and therapy microprocess: a sequential analysis. J Consult Clin Psychol 64(3):471–480. doi:10.1037/0022-006X.64.3.471
Shedler J, Westen D (2007) The Shedler–Westen assessment procedure (SWAP): making personality diagnosis clinically meaningful. J Pers Assess 89(1):41–55. doi:10.1080/00223890701357092
Siefert CJ, Hilsenroth MJ, Weinberger J, Blagys MD, Ackerman SJ (2006) The relationship of patient defensive functioning and alliance with therapist technique during short-term psychodynamic psychotherapy. Clin Psychol Psychother 13(1):20–33. doi:10.1002/cpp.469
Slife BD, Gantt E (1999) Methodological pluralism: a framework for psychotherapy research. J Clin Psychol 55(12):1–13
Snyder WU (1945) An investigation of the nature of non-directive psychotherapy. J Gen Psychol 33(2):193–223. doi:10.1080/00221309.1945.10544506
Spielberger CD, Gorsuch RL, Lushene R, Vagg PR, Jacobs GA (1983) Manual for the state-trait anxiety inventory. Consulting Psychologists Press, Palo Alto
Spitzer RL, Williams JBW, Gibbons M, First MB (1990) Structured clinical interview for DSM–III–R—personality disorders (SCID-II). American Psychiatric Press, Washington
Stevens CL, Muran JC, Safran JD, Gorman BS, Winston A (2007) Levels and patterns of the therapeutic alliance in brief psychotherapy. Am J Psychother 61(2):109–129
Stiles WB (1978) Verbal response modes and dimensions of interpersonal roles: a method of discourse analysis. J Pers Soc Psychol 36(7):693–703. doi:10.1037/0022-3514.36.7.693
Stiles WB (1979) Verbal response modes and psychotherapeutic technique. Psychiatry 42(1):49–62
Stiles WB (1988) Psychotherapy process-outcome correlations may be misleading. Psychotherapy 25:27–35. doi:10.1037/h0085320
Stiles WB (2007) Theory-building case studies of counselling and psychotherapy. Couns Psychother Res 7(2):122–127. doi:10.1080/14733140701356742
Stiles WB, Shapiro DA (1989) Abuse of the drug metaphor in psychotherapy process-outcome research. Clin Psychol Rev 9:521–543. doi:10.1016/0272-7358(89)90007-X
Stiles WB, Shapiro DA (1994) Disabuse of the drug metaphor: psychotherapy process-outcome correlations. J Consult Clin Psychol 62:942–948
Stiles WB, Snow JS (1984a) Counseling session impact as viewed by novice counselors and their clients. J Couns Psychol 31(1):3–12. doi:10.1037/0022-0167.31.1.3
Stiles WB, Snow JS (1984b) Dimensions of psychotherapy session impact across sessions and across clients. Br J Clin Psychol 23(1):59–63. doi:10.1111/j.2044-8260.1984.tb00627.x
Stiles WB, Elliott R, Llewelyn SP, Firth-Cozens JA, Margison FR, Shapiro DA et al (1990) Assimilation of problematic experiences by clients in psychotherapy. Psychotherapy 27(3):411–420. doi:10.1037/0033-3204.27.3.411
Stiles WB, Honos-Webb L, Surko M (1998) Responsiveness in psychotherapy. Clin Psychol 5(4):439–458. doi:10.1111/j.1468-2850.1998.tb00166.x
Strauss JL, Hayes AM, Johnson SL, Newman CF, Brown GK, Barber JP et al (2006) Early alliance, alliance ruptures, and symptom change in a nonrandomized trial of cognitive therapy for avoidant and obsessive-compulsive personality disorders. J Consult Clin Psychol 74(2):337–345. doi:10.1037/0022-006X.74.2.337
Tasca GA, Balfour L, Ritchie K, Bissada H (2006) Developmental changes in group climate in two types of group therapy for binge-eating disorder: a growth curve analysis. Psychother Res 16(4):499–514. doi:10.1080/10503300600593359
Tasca GA, Gallop R (2009) Multilevel modeling of longitudinal data for psychotherapy researchers: I. The basics. Psychother Res 19(4–5):429–37. doi:10.1080/10503300802641444
Tomori C, Bavelas JB (2007) Using microanalysis of communication to compare solution-focused and client-centered therapies. J Fam Psychother 18(3):25–43. doi:10.1300/J085v18n03_03
Trijsburg RW, Frederiks G, Gorlee M, Klouwer E, den Hollander AM, Duivenvoorden HJ (2002) Development of the comprehensive psychotherapeutic interventions rating scale (CPIRS). Psychother Res 12(3):287–317. doi:10.1093/ptr/12.3.287
Tschacher W, Gelo OCG, Koch SC, & Salvatore S (2014). Dynamic systems theory and embodiment in psychotherapy research. A new look at process and outcome [Special issue]. Front. Psychol. 5:1089. http://journal.frontiersin.org/ResearchTopic/1744#overview
Tschacher W, Ramseyer F (2009) Modeling psychotherapy process by time-series panel analysis (TSPA). Psychother Res 19(4):469–481. doi:10.1080/10503300802654496
Tschacher W, Baur N, Grawe K (2000) Temporal interaction of process variables in psychotherapy. Psychother Res 10(3):296–309. doi:10.1093/ptr/10.3.296
Watson JC, Bedard DL (2006) Clients’ emotional processing in psychotherapy: a comparison between cognitive-behavioral and process-experiential therapies. J Consult Clin Psychol 74(1):152–159. doi:10.1037/0022-006X.74.1.152
Watson JC, Gordon LB, Stermac L, Kalogerakos F, Steckley P (2003) Comparing the effectiveness of process-experiential with cognitive-behavioral psychotherapy in the treatment of depression. J Consult Clin Psychol 71(4):773–781. doi:10.1037/0022-006X.71.4.773
Weerasekera P, Linder B, Greenberg L, Watson J (2001) The working alliance in client-centered and process-experiential therapy of depression. Psychother Res 11(2):221–233. doi:10.1093/ptr/11.2.221
Weissman AN, Beck AT (1978) Development and validation of the dysfunctional attitudes scale: a preliminary investigation. In: Paper presented at the 86th annual convention of the american psychological association, Toronto
Williams EN, Fauth J (2005) A psychotherapy process study of therapist in session self-awareness. Psychother Res 15(4):374–381. doi:10.1080/10503300500091355
Zuroff DC, Blatt SJ, Sotsky SM, Krupnick JL, Martin DJ, Sanislow CA III et al (2000) Relation of therapeutic alliance and perfectionism to outcome in brief outpatient treatment of depression. J Consult Clin Psychol 68(1):114–124. doi:10.1037/0022-006X.68.1.114
Acknowledgment
We would like to thank David Orlinsky and Marcello Gallucci for their discussions, which helped to inform the contents of this chapter. However, as the authors, we are solely responsible for the content of this chapter.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer-Verlag Wien
About this chapter
Cite this chapter
Gelo, O.C.G., Manzo, S. (2015). Quantitative Approaches to Treatment Process, Change Process, and Process-Outcome Research. In: Gelo, O., Pritz, A., Rieken, B. (eds) Psychotherapy Research. Springer, Vienna. https://doi.org/10.1007/978-3-7091-1382-0_13
Download citation
DOI: https://doi.org/10.1007/978-3-7091-1382-0_13
Published:
Publisher Name: Springer, Vienna
Print ISBN: 978-3-7091-1381-3
Online ISBN: 978-3-7091-1382-0
eBook Packages: MedicineMedicine (R0)