Nonverbal Synchrony of Facial Movements and Expressions Predict Therapeutic Alliance During a Structured Psychotherapeutic Interview
Nonverbal synchrony (NVS) of a patient’s and therapist’s body parts during a therapy session has been linked with therapeutic alliance. However, the link between NVS of face parts with therapeutic alliance remains unclear. The clarification of this link is important in understanding NVS. Accordingly, we used a video imaging technique to provide quantitative evidence of this link. The 55 participants in this study were the same as in a previous study. Both the participants’ and the therapist’s faces were video recorded during structured psychotherapeutic interviews. Our machine quantified 500,500 participants’ faces and 500,500 therapists’ faces from the perspectives of facial movements and expressions. Results show that absolute synchrony of happy and scared expressions were positively related to therapeutic alliance. However, symmetrical synchrony of left eye movements negatively predicted therapeutic alliance, although participants’ sex, age, volume of facial movements, and volume of facial expressions were controlled. Absolute synchrony of facial expressions was regarded as emotional interaction within 2 s delay, whereas symmetrical synchrony of left eye movements was regarded as a blocker of emotional interaction.
KeywordsNonverbal synchrony Facial movement Facial expression Video imaging technique Structured psychotherapeutic interview Symmetrical communication pattern
We appreciate Dr. Kurosawa, Tai for his insightful feedbacks on our early draft.
The present study was funded by a Grant from the Foundation for the Fusion of Science and Technology (Heisei27-10) and from the Japan Society for the Promotion of Science Grants-in-Aid for Scientific Research(18K02141).
- Baron-Cohen, S., Wheelwright, S., Hill, J., Raste, Y., & Plumb, I. (2001). The “reading the mind in the eyes” test, revised version: A study with normal adults, and adults with Asperger syndrome or high-functioning autism. Journal of Child Psychology and Psychiatry, 42(2), 241–251. https://doi.org/10.1111/1469-7610.00715.CrossRefPubMedGoogle Scholar
- Bradski, G., & Kaehler, A. (2008). Learning OpenCV: Computer vision with the OpenCV library. O’Reilly Media, Inc.Google Scholar
- Carrier, P.-L., Courville, A., Goodfellow, I. J., Mirza, M., & Bengio, Y. (2013). FER-2013 face database. Universit de Montral.Google Scholar
- Chartrand, T. L., & Lakin, J. L. (2013). The antecedents and consequences of human behavioral mimicry. Annual Review of Psychology, 64(1), 285–308. https://doi.org/10.1146/annurev-psych-113011-143754.CrossRefPubMedGoogle Scholar
- de la Peña, C. M., Friedlander, M. L., Escudero, V., & Heatherington, L. (2012). How do therapists ally with adolescents in family therapy? An examination of relational control communication in early sessions. Journal of Counseling Psychology, 59(3), 339–351. https://doi.org/10.1037/a0028063.CrossRefPubMedGoogle Scholar
- First, M. B., Spitzer, R. L., Gibbon, M., & Williams, J. B. W. (1997). Structured clinical interview for DSM-IV axis I disorders. Washington, DC: American Psychiatric Publishing Inc.Google Scholar
- First, M. B., Spitzer, R. L., Gibbon, M., & Williams, J. B. W. (2010). Structured clinical interview for DSM-IV axis I disorders (S. Takahashi, T. Kitamura, T. Okano, & A. Kikuchi, Trans.). Tokyo: Nippon Hyoron Sha co., Ltd. (Original work published 1997)Google Scholar
- Fraser, S., Vachon, M., Hassan, G., & Parent, V. (2016). Communicating power and resistance: Exploring interactions between aboriginal youth and non-aboriginal staff members in a residential child welfare facility. Qualitative Research in Psychology, 13(1), 67–91. https://doi.org/10.1080/14780887.2015.1106629.CrossRefGoogle Scholar
- King, D. E. (2009). Dlib-ml: A machine learning toolkit. Journal of Machine Learning Research, 10, 1755–1758.Google Scholar
- Langlois, J. H., & Roggman, L. A. (1990). Attractive faces are only average. Psychological Science, 1(2), 115–121. https://doi.org/10.1111/j.1467-9280.1990.tb00079.x.CrossRefGoogle Scholar
- Levi, G., & Hassner, T. (2015). Emotion recognition in the wild via convolutional neural networks and mapped binary patterns. In Proceedings of the 2015 ACM on international conference on multimodal interaction (pp. 503–510). https://doi.org/10.1145/2818346.2830587.
- Lozza, N., Spoerri, C., Ehlert, U., Kesselring, M., Hubmann, P., Tschacher, W., et al. (2018). Nonverbal synchrony and complementarity in unacquainted same-sex dyads: A comparison in a competitive context. Journal of Nonverbal Behavior, 42(2), 179–197. https://doi.org/10.1007/s10919-018-0273-8.CrossRefGoogle Scholar
- Paulick, J., Deisenhofer, A.-K., Ramseyer, F., Tschacher, W., Boyle, K., Rubel, J., et al. (2017). Nonverbal synchrony: A new approach to better understand psychotherapeutic processes and drop-out. Journal of Psychotherapy Integration, No Pagination Specified-No Pagination Specified.. https://doi.org/10.1037/int0000099.CrossRefGoogle Scholar
- Paulick, J., Rubel, J. A., Deisenhofer, A.-K., Schwartz, B., Thielemann, D., Altmann, U., et al. (2018). Diagnostic features of nonverbal synchrony in psychotherapy: Comparing depression and anxiety. Cognitive Therapy and Research, 42(5), 539–551. https://doi.org/10.1007/s10608-018-9914-9.CrossRefGoogle Scholar
- Riehle, M., Kempkensteffen, J., & Lincoln, T. M. (2017). Quantifying facial expression synchrony in face-to-face dyadic interactions: Temporal dynamics of simultaneously recorded facial EMG signals. Journal of Nonverbal Behavior, 41(2), 85–102. https://doi.org/10.1007/s10919-016-0246-8.CrossRefGoogle Scholar
- Rogers, L. E., & Farace, R. V. (1975). Analysis of relational communication in dyads: New measurement procedures. Human Communication Research, 1(3), 222–239. https://doi.org/10.1111/j.1468-2958.1975.tb00270.x.CrossRefGoogle Scholar
- Semin, G. R., & Cacioppo, J. T. (2008). Grounding social cognition: Synchronization, coordination, and co-regulation. In Embodied grounding: Social, cognitive, affective, and neuroscientific approaches (pp. 119–147). https://doi.org/10.1017/CBO9780511805837.006.
- Stratou, G., Hoegen, R., Lucas, G., & Gratch, J. (2017). Investigating gender differences in temporal dynamics during an iterated social dilemma: An automatic analysis using networks. In 2017 Seventh international conference on affective computing and intelligent interaction (ACII) (pp. 531–536). https://doi.org/10.1109/ACII.2017.8273650.
- Watzlawick, P., Bavelas, J. B., & Jackson, D. D. (2011). Pragmatics of human communication: A study of interactional patterns, pathologies and paradoxes. New York: W. W. Norton & Company.Google Scholar